justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 241626.0@dunegpschedd01.fnal.gov

Jobsub ID241626.0@dunegpschedd01.fnal.gov
Workflow ID9509
Stage ID1
User namepmelas@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2025-11-01 09:36:05
SiteUK_QMUL
EntryDUNE_UK_London_QMUL_arcce02
Last heartbeat2025-11-01 14:18:23
From worker nodeHostnamecn060.htc.esc.qmul
cpuinfoIntel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-01 09:36:47
Input filesmonte-carlo-009509-000001
JobscriptExit code0
Real time4h (16673s)
CPU time4h (16419s = 98%)
Max RSS bytes4525850624 (4316 MiB)
Outputting started2025-11-01 14:14:41
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09509/1/001/reco_stage1.root
Finished2025-11-01 14:18:23
Saved logsjustin-logs:241626.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ing tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 155616 traces, 0 summary
Retagger: tagging trace set: gauss with 121080 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 121080 traces tagged "gauss"
FrameSaver: q=3.96299e+06 n=2140188 tag=gauss
wclsFrameSaver: saving 155616 traces tagged "wiener"
FrameSaver: q=4.1652e+06 n=1886299 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 45373 XUs and 52603 XVs -> 641 XUVs
C:0 T:1 119271 XUs and 131733 XVs -> 8384 XUVs
C:0 T:2 88870 XUs and 112701 XVs -> 5966 XUVs
C:0 T:3 45278 XUs and 43052 XVs -> 294 XUVs
C:0 T:4 13216 XUs and 13377 XVs -> 101 XUVs
C:0 T:5 48674 XUs and 38133 XVs -> 3325 XUVs
C:0 T:6 79298 XUs and 110612 XVs -> 3252 XUVs
C:0 T:7 29842 XUs and 43083 XVs -> 246 XUVs
C:0 T:8 11201 XUs and 13086 XVs -> 142 XUVs
C:0 T:9 74430 XUs and 106578 XVs -> 5647 XUVs
C:0 T:10 26070 XUs and 26314 XVs -> 3345 XUVs
C:0 T:11 114 XUs and 75 XVs -> 10 XUVs
31353 XUVs total
15519 collection wire objects
28484 potential space points
Neighbour search...
1126596 tests to find 613082 neighbours
Iterating with no regularization...
Begin: 7.93389e+07
0 6.343e+07
1 6.23354e+07
2 6.2205e+07
3 6.21676e+07
Now with regularization...
Begin: 5.08727e+07
0 5.08486e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410245083
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410245083
fLifetime: 30000 [us]
01-Nov-2025 14:14:38 GMT  Closed output file "reco_stage1.root"
01-Nov-2025 14:14:38 GMT  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          543.624       781.89        1004.21       767.549       133.31         10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00162499     0.0059547     0.0179694    0.00537624    0.00432929       10     
reco:ophit:OpHitFinder                             0.274985      0.379095      0.559637      0.359053      0.103757        10     
reco:opflash:OpFlashFinder                         0.240704      0.337267      0.632333      0.308184      0.112711        10     
reco:opslicer:OpSlicer                             0.601265      0.927593       1.46895      0.844137      0.292687        10     
reco:caldata:DataPrepModule                         4.99272       7.12138       9.63052       6.98359       1.88384        10     
reco:wclsdatasp:WireCellToolkit                     45.1619       63.2607       74.5832       66.8108       10.9579        10     
reco:gaushit:GausHitFinder                          1.43042       2.11936       2.82633       2.30568      0.557317        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000881877   0.00122948    0.00161576    0.00117904    0.000266907      10     
reco:reco3d:SpacePointSolver                        15.6751       23.5012       37.7266       18.8394       7.58538        10     
reco:hitpdune:DisambigFromSpacePoints               2.26364       3.85332       6.94021       3.37851       1.56722        10     
reco:pandora:StandardPandora                        42.0856       85.757        152.293       73.3924       33.4557        10     
reco:pandoraWriter:StandardPandora                 0.530639      0.769857      0.975743      0.821674      0.140058        10     
reco:pandoraTrack:LArPandoraTrackCreation           13.2423       20.6249       30.7681       18.6314       5.06168        10     
reco:pandoraShower:LArPandoraShowerCreation         18.611        22.5915       26.3301       22.2329       2.43293        10     
reco:pandoracalo:Calorimetry                        6.6268        9.68827       14.9869       9.74521       2.24045        10     
reco:pandoracalonosce:Calorimetry                   7.38495       9.16864       13.0022       8.66038       1.62606        10     
reco:pandorapid:Chi2ParticleID                    0.00663831     0.0100304     0.0189171    0.00932791    0.00340218       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0709855     0.0960077     0.138971      0.0891816     0.0241071       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00643833    0.00899012     0.012882     0.00851881     0.0021478       10     
reco:pandoraShowercalo:ShowerCalorimetry            20.5524       23.9907       31.3375       22.8642       3.26727        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       18.1001       23.719        30.5454       23.3379       3.81284        10     
reco:emtrkmichelid:EmTrackMichelId                  170.078       285.911       412.381       285.727       72.1318        10     
reco:crttag:SingleCRTMatchingProducer              0.032852      0.0484601     0.0757878     0.0475266     0.0105927       10     
reco:crtreco:TwoCRTMatchingProducer                0.0273502     0.041773      0.0731344     0.0390452     0.0115661       10     
reco:anodepiercerst0:T0RecoAnodePiercers            1.05188       1.75618       2.46193       1.56285      0.470318        10     
reco:pandora2Track:LArPandoraTrackCreation          40.196        64.025        79.3795       63.2966       12.0424        10     
reco:pandora2calo:Calorimetry                       18.1462       30.473         40.93        29.6315       6.43399        10     
reco:pandora2calonosce:Calorimetry                  17.9481       29.5241       39.7449       28.4273       6.84981        10     
reco:pandora2pid:Chi2ParticleID                    0.0135301     0.0240273     0.0355812     0.0253487    0.00783267       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0740553     0.122026      0.164774      0.130165      0.0333056       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0130476     0.0238832     0.0355848     0.0247681    0.00812794       10     
reco:pandora2Shower:LArPandoraShowerCreation        13.2258       20.8785       26.2417       21.8207       4.28122        10     
reco:pandora2Showercalo:ShowerCalorimetry           16.8127       25.2461       32.8674       24.7235       5.17895        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      14.1717       21.8911       31.6103       20.163        4.72505        10     
[art]:TriggerResults:TriggerResultInserter        4.4093e-05    0.000101158   0.000251443   8.29435e-05   6.28256e-05      10     
end_path:out1:RootOutput                           7.385e-06    1.22257e-05   2.1538e-05    1.06075e-05   4.62654e-06      10     
end_path:out1:RootOutput(write)                     2.44816       3.74044       4.99644       3.55527      0.849814        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5327.27 MB
  Peak resident set size usage (VmHWM): 4525.85 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.12 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.29 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   4.35 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.23 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11827652
-rw-r--r-- 1 pildune22 pildune 2721123207 Nov  1 12:01 detsim_stage2.root
-rw-r--r-- 1 pildune22 pildune 2579811258 Nov  1 11:58 detsim_stage1.root
-rw-r--r-- 1 pildune22 pildune 2467924929 Nov  1 14:14 reco_stage1.root
-rw-r--r-- 1 pildune22 pildune 2171843986 Nov  1 10:15 g4_stage2.root
-rw-r--r-- 1 pildune22 pildune 2081023089 Nov  1 09:46 g4_stage1.root
-rw-r--r-- 1 pildune22 pildune   89175480 Nov  1 14:04 Pandora_Events.pndr
-rw-r--r-- 1 pildune22 pildune     243175 Nov  1 14:14 jobscript.log
-rw-r--r-- 1 pildune22 pildune     217088 Nov  1 14:14 mem.db
-rw-r--r-- 1 pildune22 pildune      62376 Nov  1 14:14 Pandora_Geometry.xml
-rw-r--r-- 1 pildune22 pildune      36864 Nov  1 14:14 time.db
-rw-r--r-- 1 pildune22 pildune        519 Nov  1 12:01 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 pildune22 pildune        519 Nov  1 10:15 g4_protoDUNE_hist.root
-rw-r--r-- 1 pildune22 pildune        519 Nov  1 14:14 protoDUNE_reco1_hist.root
-rw-r--r-- 1 pildune22 pildune         52 Nov  1 09:36 all-input-dids.txt
-rw-r--r-- 1 pildune22 pildune          7 Nov  1 14:14 justin-processed-pfns.txt
-rw-r--r-- 1 pildune22 pildune          0 Nov  1 12:12 ProtoDUNE.log
-rw-r--r-- 1 pildune22 pildune          0 Nov  1 12:01 debugprod.log
justIN time: 2026-02-11 15:10:03 UTC       justIN version: 01.06.00