justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 275406.1@dunegpschedd02.fnal.gov

Jobsub ID275406.1@dunegpschedd02.fnal.gov
Workflow ID12075
Stage ID1
User namepmelas@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2026-01-18 15:13:51
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce04
Last heartbeat2026-01-18 20:07:14
From worker nodeHostnameccwcondor0577
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit106200 (29 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-18 15:15:13
Input filesmonte-carlo-012075-000001
JobscriptExit code0
Real time4h (17411s)
CPU time4h (16733s = 96%)
Max RSS bytes4319059968 (4118 MiB)
Outputting started2026-01-18 20:05:24
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12075/1/001/reco_stage1.root
Finished2026-01-18 20:07:14
Saved logsjustin-logs:275406.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ng tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare:   Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 185490 traces, 0 summary
Retagger: tagging trace set: gauss with 138412 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 138412 traces tagged "gauss"
FrameSaver: q=4.78269e+06 n=2440358 tag=gauss
wclsFrameSaver: saving 185490 traces tagged "wiener"
FrameSaver: q=5.09303e+06 n=2157346 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 27276 XUs and 31590 XVs -> 212 XUVs
C:0 T:1 59039 XUs and 62190 XVs -> 5121 XUVs
C:0 T:2 188929 XUs and 175137 XVs -> 23123 XUVs
C:0 T:3 73495 XUs and 49934 XVs -> 634 XUVs
C:0 T:4 13905 XUs and 18384 XVs -> 106 XUVs
C:0 T:5 72479 XUs and 62213 XVs -> 5061 XUVs
C:0 T:6 324447 XUs and 276945 XVs -> 15650 XUVs
C:0 T:7 96882 XUs and 86158 XVs -> 1490 XUVs
C:0 T:8 6083 XUs and 6825 XVs -> 483 XUVs
C:0 T:9 44704 XUs and 53838 XVs -> 12562 XUVs
C:0 T:10 112779 XUs and 59744 XVs -> 12726 XUVs
C:0 T:11 476 XUs and 372 XVs -> 38 XUVs
77206 XUVs total
17093 collection wire objects
69320 potential space points
Neighbour search...
12480212 tests to find 5352562 neighbours
Iterating with no regularization...
Begin: 9.43429e+07
0 7.47966e+07
1 7.35894e+07
2 7.34263e+07
3 7.33789e+07
Now with regularization...
Begin: 6.127e+07
0 6.1211e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411818976
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411818976
fLifetime: 30000 [us]
18-Jan-2026 21:05:22 CET  Closed output file "reco_stage1.root"
18-Jan-2026 21:05:22 CET  Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================================
TimeTracker printout (sec)                            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================================
Full event                                          378.059       630.422       898.013       636.653       131.856        10     
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                            0.00214574    0.00605382     0.0104502    0.00655295    0.00273925       10     
reco:ophit:OpHitFinder                             0.311169      0.389463      0.492469       0.38713      0.0431175       10     
reco:opflash:OpFlashFinder                         0.192421      0.261078      0.348192      0.244696      0.0481901       10     
reco:opslicer:OpSlicer                             0.673572      0.921648       1.05357      0.974787      0.124356        10     
reco:caldata:DataPrepModule                         6.24117       7.15963       7.95118       7.15836      0.502586        10     
reco:wclsdatasp:WireCellToolkit                     43.005        46.1427       49.7405        45.85        2.10787        10     
reco:gaushit:GausHitFinder                          1.13741       2.10099       2.81326       2.12949      0.443006        10     
reco:nhitsfilter:NumberOfHitsFilter               0.000541175   0.000843516   0.00128844    0.000849632   0.000209678      10     
reco:reco3d:SpacePointSolver                        15.4164       32.6716       64.3928       27.499        15.9001        10     
reco:hitpdune:DisambigFromSpacePoints               1.65733       2.99809       4.65443       2.91555      0.811255        10     
reco:pandora:StandardPandora                        34.2197       76.8814       165.198       69.4004       32.5577        10     
reco:pandoraWriter:StandardPandora                 0.457796      0.695909      0.836169       0.72475      0.113833        10     
reco:pandoraTrack:LArPandoraTrackCreation           7.99323       11.1562       15.7239       10.8634       2.29348        10     
reco:pandoraShower:LArPandoraShowerCreation         7.32846       14.5086       21.6819       15.0135       4.55455        10     
reco:pandoracalo:Calorimetry                        4.07954       7.16277       9.65029       7.27699       1.60834        10     
reco:pandoracalonosce:Calorimetry                   3.89655       7.0819        9.25243       7.07054       1.48099        10     
reco:pandorapid:Chi2ParticleID                    0.00743896     0.0106845     0.0127634     0.0108478    0.00157833       10     
reco:pandoracalinoxyzt:CalibrationdEdXPDSP         0.0616817     0.0936313     0.131158      0.0894978     0.0184898       10     
reco:pandoracalipidnoxyzt:Chi2ParticleID          0.00791004    0.00916319     0.0101472    0.00947321    0.000726869      10     
reco:pandoraShowercalo:ShowerCalorimetry            5.64299       15.9321       21.1194       16.1166       4.48302        10     
reco:pandoraShowercalonosce:ShowerCalorimetry       5.89962       16.5366       23.473        16.9116       5.10888        10     
reco:emtrkmichelid:EmTrackMichelId                  177.14        264.66        338.676       270.356       38.2466        10     
reco:crttag:SingleCRTMatchingProducer              0.0184449     0.0373658     0.0698002     0.0336291     0.0141392       10     
reco:crtreco:TwoCRTMatchingProducer                0.0140965     0.0252116     0.0352989     0.0247652    0.00604019       10     
reco:anodepiercerst0:T0RecoAnodePiercers           0.737831       1.20486       2.20774       1.13016      0.360948        10     
reco:pandora2Track:LArPandoraTrackCreation          17.0638       35.1784       50.8679       38.063        9.85833        10     
reco:pandora2calo:Calorimetry                       9.15225       21.3427       33.0937       20.5147       7.02743        10     
reco:pandora2calonosce:Calorimetry                  10.0602       19.2739       28.7382       18.4221       6.13961        10     
reco:pandora2pid:Chi2ParticleID                    0.0184925     0.0226656     0.0263303     0.0228173     0.0021231       10     
reco:pandora2calinoxyzt:CalibrationdEdXPDSP        0.0814165     0.115696      0.161771      0.113142      0.0200764       10     
reco:pandora2calipidnoxyzt:Chi2ParticleID          0.0168004     0.0219089     0.0259641     0.0217457    0.00227122       10     
reco:pandora2Shower:LArPandoraShowerCreation        7.04068       11.2145       15.5971       10.3837       3.15017        10     
reco:pandora2Showercalo:ShowerCalorimetry           6.30634       15.9203       23.7472       15.9293       4.91629        10     
reco:pandora2Showercalonosce:ShowerCalorimetry      6.78949       14.5947       25.0149       13.269        5.8215         10     
[art]:TriggerResults:TriggerResultInserter        7.7485e-05    0.000114334   0.000166813   0.000107161   3.01758e-05      10     
end_path:out1:RootOutput                          1.0911e-05    1.64471e-05   3.3653e-05    1.4658e-05    6.14682e-06      10     
end_path:out1:RootOutput(write)                     2.58845       3.84477       5.06724       3.82867      0.649465        10     
====================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5159.81 MB
  Peak resident set size usage (VmHWM): 4319.06 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor:  Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.10 sec/event
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.35 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.06 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   4.50 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.18 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.07 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11290400
-rw-r--r-- 1 dune001 lbno 2605565170 Jan 18 19:17 detsim_stage2.root
-rw-r--r-- 1 dune001 lbno 2471741750 Jan 18 19:14 detsim_stage1.root
-rw-r--r-- 1 dune001 lbno 2331157020 Jan 18 21:05 reco_stage1.root
-rw-r--r-- 1 dune001 lbno 2086512975 Jan 18 16:42 g4_stage2.root
-rw-r--r-- 1 dune001 lbno 1981059671 Jan 18 16:24 g4_stage1.root
-rw-r--r-- 1 dune001 lbno   84716850 Jan 18 20:55 Pandora_Events.pndr
-rw-r--r-- 1 dune001 lbno     242891 Jan 18 21:05 jobscript.log
-rw-r--r-- 1 dune001 lbno     217088 Jan 18 21:05 mem.db
-rw-r--r-- 1 dune001 lbno      62376 Jan 18 21:05 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 lbno      36864 Jan 18 21:05 time.db
-rw-r--r-- 1 dune001 lbno        519 Jan 18 19:17 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 lbno        519 Jan 18 16:42 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 lbno        519 Jan 18 21:05 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 lbno         52 Jan 18 16:15 all-input-dids.txt
-rw-r--r-- 1 dune001 lbno          7 Jan 18 21:05 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 lbno          0 Jan 18 19:25 ProtoDUNE.log
-rw-r--r-- 1 dune001 lbno          0 Jan 18 19:17 debugprod.log
justIN time: 2026-02-05 18:29:37 UTC       justIN version: 01.06.00