Jobsub ID 271722.0@dunegpschedd02.fnal.gov
| Jobsub ID | 271722.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11859 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-13 21:59:53 |
| Site | NL_SURFsara |
| Entry | DUNE_SurfSARA_arc02 |
| Last heartbeat | 2026-01-14 03:02:27 |
| From worker node | Hostname | wn-lb-08.gina.surf.nl |
| cpuinfo | AMD EPYC 9754 128-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-13 22:01:37 |
| Input files | monte-carlo-011859-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (17932s) |
| CPU time | 4h (17776s = 99%) |
| Max RSS bytes | 4608507904 (4395 MiB) |
| Outputting started | 2026-01-14 03:00:30 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11859/1/001/reco_stage1.root
|
| Finished | 2026-01-14 03:02:27 |
| Saved logs | justin-logs:271722.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
lSignalFinder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 127576 traces, 0 summary
Retagger: tagging trace set: gauss with 95154 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 95154 traces tagged "gauss"
FrameSaver: q=3.26746e+06 n=1618986 tag=gauss
wclsFrameSaver: saving 127576 traces tagged "wiener"
FrameSaver: q=3.47263e+06 n=1407484 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 37899 XUs and 39228 XVs -> 616 XUVs
C:0 T:1 81134 XUs and 97656 XVs -> 8796 XUVs
C:0 T:2 75019 XUs and 86285 XVs -> 3460 XUVs
C:0 T:3 38518 XUs and 31747 XVs -> 208 XUVs
C:0 T:4 11990 XUs and 13265 XVs -> 88 XUVs
C:0 T:5 71096 XUs and 62316 XVs -> 7944 XUVs
C:0 T:6 81547 XUs and 94666 XVs -> 3494 XUVs
C:0 T:7 32998 XUs and 40305 XVs -> 421 XUVs
C:0 T:8 9173 XUs and 9096 XVs -> 189 XUVs
C:0 T:9 84853 XUs and 107234 XVs -> 11014 XUVs
C:0 T:10 14433 XUs and 4913 XVs -> 1504 XUVs
C:0 T:11 118 XUs and 68 XVs -> 12 XUVs
37746 XUVs total
12107 collection wire objects
33943 potential space points
Neighbour search...
3730041 tests to find 1759106 neighbours
Iterating with no regularization...
Begin: 6.36163e+07
0 4.93243e+07
1 4.81629e+07
2 4.80001e+07
3 4.79555e+07
Now with regularization...
Begin: 3.70042e+07
0 3.69391e+07
1 3.69133e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411723989
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411723989
fLifetime: 30000 [us]
14-Jan-2026 04:00:27 CET Closed output file "reco_stage1.root"
14-Jan-2026 04:00:27 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 425.125 526.657 740.692 500.792 87.1815 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00118951 0.00638659 0.0108115 0.00683246 0.00327238 10
reco:ophit:OpHitFinder 0.379974 0.447653 0.507143 0.443612 0.0400856 10
reco:opflash:OpFlashFinder 0.243371 0.325527 0.391676 0.321341 0.0489622 10
reco:opslicer:OpSlicer 0.67901 0.911659 1.18992 0.950382 0.144701 10
reco:caldata:DataPrepModule 6.41905 6.65621 7.2812 6.55413 0.266094 10
reco:wclsdatasp:WireCellToolkit 47.2756 67.1786 75.2406 73.232 10.0407 10
reco:gaushit:GausHitFinder 1.11328 1.59365 1.99413 1.58446 0.244245 10
reco:nhitsfilter:NumberOfHitsFilter 0.000515483 0.000638832 0.000920368 0.000555182 0.000150883 10
reco:reco3d:SpacePointSolver 16.1264 29.5395 49.2561 27.9674 11.4221 10
reco:hitpdune:DisambigFromSpacePoints 1.51238 2.31334 3.74806 2.17414 0.611047 10
reco:pandora:StandardPandora 34.9958 53.37 94.0359 44.447 17.5797 10
reco:pandoraWriter:StandardPandora 0.451982 0.563274 0.749133 0.55322 0.0781659 10
reco:pandoraTrack:LArPandoraTrackCreation 6.09567 8.45666 13.0216 8.28548 1.84834 10
reco:pandoraShower:LArPandoraShowerCreation 6.9195 10.8185 21.5843 9.58215 4.02916 10
reco:pandoracalo:Calorimetry 3.22875 4.58001 6.45536 4.44366 0.889317 10
reco:pandoracalonosce:Calorimetry 2.87874 4.42201 6.78633 4.41245 1.04561 10
reco:pandorapid:Chi2ParticleID 0.00582922 0.0071378 0.00915087 0.00725958 0.00101615 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0496749 0.0620762 0.0819545 0.0601621 0.00832891 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00561981 0.006811 0.00780508 0.00702845 0.000687497 10
reco:pandoraShowercalo:ShowerCalorimetry 7.01306 10.655 19.624 9.65529 3.60932 10
reco:pandoraShowercalonosce:ShowerCalorimetry 6.59702 10.2871 18.859 9.37076 3.39987 10
reco:emtrkmichelid:EmTrackMichelId 189.623 227.532 297.875 222 29.5921 10
reco:crttag:SingleCRTMatchingProducer 0.0150679 0.0203065 0.0336524 0.0189672 0.00475187 10
reco:crtreco:TwoCRTMatchingProducer 0.010721 0.0165698 0.0253496 0.0159782 0.00387578 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.03329 1.19702 1.53844 1.12164 0.173116 10
reco:pandora2Track:LArPandoraTrackCreation 18.5715 27.1294 49.2695 24.6929 8.55216 10
reco:pandora2calo:Calorimetry 9.54434 13.3697 22.8797 12.0811 3.84623 10
reco:pandora2calonosce:Calorimetry 8.78873 12.7037 22.1642 11.6502 3.84492 10
reco:pandora2pid:Chi2ParticleID 0.0132731 0.0167141 0.0213982 0.016229 0.00239065 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0667925 0.0812606 0.109156 0.0786073 0.0117401 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0132662 0.0168918 0.0216328 0.0164561 0.00243518 10
reco:pandora2Shower:LArPandoraShowerCreation 6.73323 8.97481 16.2795 8.05547 2.71184 10
reco:pandora2Showercalo:ShowerCalorimetry 8.55449 10.4494 17.2109 9.37909 2.54228 10
reco:pandora2Showercalonosce:ShowerCalorimetry 7.24571 8.70268 14.5386 7.77052 2.09065 10
[art]:TriggerResults:TriggerResultInserter 3.994e-05 5.7367e-05 0.000119649 4.8948e-05 2.29523e-05 10
end_path:out1:RootOutput 7.701e-06 8.7958e-06 1.314e-05 8.272e-06 1.50251e-06 10
end_path:out1:RootOutput(write) 3.20678 3.98363 5.30176 3.86189 0.561585 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5412.41 MB
Peak resident set size usage (VmHWM): 4608.51 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.29 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.14 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11439388
-rw-r--r--. 1 dune009 dune 2642902618 Jan 14 02:30 detsim_stage2.root
-rw-r--r--. 1 dune009 dune 2509779979 Jan 14 02:27 detsim_stage1.root
-rw-r--r--. 1 dune009 dune 2373320024 Jan 14 04:00 reco_stage1.root
-rw-r--r--. 1 dune009 dune 2092291480 Jan 13 23:26 g4_stage2.root
-rw-r--r--. 1 dune009 dune 2009792465 Jan 13 23:09 g4_stage1.root
-rw-r--r--. 1 dune009 dune 85234290 Jan 14 03:55 Pandora_Events.pndr
-rw-r--r--. 1 dune009 dune 242995 Jan 14 04:00 jobscript.log
-rw-r--r--. 1 dune009 dune 217088 Jan 14 04:00 mem.db
-rw-r--r--. 1 dune009 dune 62376 Jan 14 04:00 Pandora_Geometry.xml
-rw-r--r--. 1 dune009 dune 36864 Jan 14 04:00 time.db
-rw-r--r--. 1 dune009 dune 519 Jan 14 02:30 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 dune009 dune 519 Jan 13 23:26 g4_protoDUNE_hist.root
-rw-r--r--. 1 dune009 dune 519 Jan 14 04:00 protoDUNE_reco1_hist.root
-rw-r--r--. 1 dune009 dune 52 Jan 13 23:01 all-input-dids.txt
-rw-r--r--. 1 dune009 dune 7 Jan 14 04:00 justin-processed-pfns.txt
-rw-r--r--. 1 dune009 dune 0 Jan 14 02:38 ProtoDUNE.log
-rw-r--r--. 1 dune009 dune 0 Jan 14 02:30 debugprod.log