Jobsub ID 277220.1@dunegpschedd01.fnal.gov
| Jobsub ID | 277220.1@dunegpschedd01.fnal.gov |
| Workflow ID | 11830 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-13 15:41:29 |
| Site | NL_SURFsara |
| Entry | DUNE_SurfSARA_arc02 |
| Last heartbeat | 2026-01-13 20:19:15 |
| From worker node | Hostname | wn-la-23.gina.surf.nl |
| cpuinfo | AMD EPYC 9754 128-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-13 15:42:44 |
| Input files | monte-carlo-011830-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (16493s) |
| CPU time | 4h (16318s = 98%) |
| Max RSS bytes | 4232814592 (4036 MiB) |
| Outputting started | 2026-01-13 20:17:38 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11830/1/001/reco_stage1.root
|
| Finished | 2026-01-13 20:19:15 |
| Saved logs | justin-logs:277220.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 120304 traces, 0 summary
Retagger: tagging trace set: gauss with 85448 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 85448 traces tagged "gauss"
FrameSaver: q=3.0109e+06 n=1454654 tag=gauss
wclsFrameSaver: saving 120304 traces tagged "wiener"
FrameSaver: q=3.22773e+06 n=1266023 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 38246 XUs and 42325 XVs -> 489 XUVs
C:0 T:1 60155 XUs and 61182 XVs -> 4654 XUVs
C:0 T:2 115808 XUs and 164947 XVs -> 15396 XUVs
C:0 T:3 44324 XUs and 54383 XVs -> 382 XUVs
C:0 T:4 9533 XUs and 12239 XVs -> 224 XUVs
C:0 T:5 25566 XUs and 25273 XVs -> 3892 XUVs
C:0 T:6 90611 XUs and 85053 XVs -> 4781 XUVs
C:0 T:7 35226 XUs and 32163 XVs -> 471 XUVs
C:0 T:8 4253 XUs and 4763 XVs -> 117 XUVs
C:0 T:9 22977 XUs and 30859 XVs -> 3556 XUVs
C:0 T:10 23820 XUs and 18821 XVs -> 2727 XUVs
C:0 T:11 271 XUs and 198 XVs -> 22 XUVs
36711 XUVs total
10226 collection wire objects
33800 potential space points
Neighbour search...
3043592 tests to find 1558066 neighbours
Iterating with no regularization...
Begin: 4.5457e+07
0 3.60957e+07
1 3.5261e+07
2 3.51067e+07
3 3.50574e+07
4 3.50374e+07
Now with regularization...
Begin: 2.66139e+07
0 2.65715e+07
1 2.65473e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411718738
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411718738
fLifetime: 30000 [us]
13-Jan-2026 21:17:36 CET Closed output file "reco_stage1.root"
13-Jan-2026 21:17:36 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 361.016 481.371 659.205 447.776 99.1421 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00123158 0.00572796 0.00935753 0.00578591 0.00277255 10
reco:ophit:OpHitFinder 0.398339 0.456858 0.523179 0.458852 0.0439875 10
reco:opflash:OpFlashFinder 0.253912 0.345105 0.496803 0.355561 0.0654925 10
reco:opslicer:OpSlicer 0.647827 0.937485 1.12409 0.942131 0.13805 10
reco:caldata:DataPrepModule 6.25832 6.51142 7.22389 6.4484 0.253663 10
reco:wclsdatasp:WireCellToolkit 45.2403 60.3245 65.9753 63.5952 7.35142 10
reco:gaushit:GausHitFinder 1.10313 1.49943 2.14232 1.43853 0.300206 10
reco:nhitsfilter:NumberOfHitsFilter 0.000397303 0.000638173 0.00121735 0.00053213 0.000258808 10
reco:reco3d:SpacePointSolver 11.0405 20.2149 30.4574 19.0256 6.66882 10
reco:hitpdune:DisambigFromSpacePoints 1.12833 1.96965 2.88246 1.78619 0.618061 10
reco:pandora:StandardPandora 18.4327 47.2386 87.6544 39.7779 22.036 10
reco:pandoraWriter:StandardPandora 0.394913 0.52361 0.668417 0.505202 0.0921448 10
reco:pandoraTrack:LArPandoraTrackCreation 4.37872 7.6224 10.6546 7.49611 2.10361 10
reco:pandoraShower:LArPandoraShowerCreation 5.01297 8.76307 13.7092 7.92531 2.96805 10
reco:pandoracalo:Calorimetry 2.24604 4.13889 5.7207 3.99304 1.14905 10
reco:pandoracalonosce:Calorimetry 2.05718 3.82975 5.40967 3.67335 1.04485 10
reco:pandorapid:Chi2ParticleID 0.00518993 0.00683416 0.00939622 0.00650591 0.00114477 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0479085 0.0569407 0.0723144 0.0527947 0.00874983 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.0053386 0.00653755 0.0076187 0.00632284 0.000766221 10
reco:pandoraShowercalo:ShowerCalorimetry 4.76916 8.83824 14.5945 7.94943 3.25404 10
reco:pandoraShowercalonosce:ShowerCalorimetry 4.74328 8.38936 14.5588 7.21937 3.13984 10
reco:emtrkmichelid:EmTrackMichelId 175.949 225.428 285.975 213.41 36.5268 10
reco:crttag:SingleCRTMatchingProducer 0.0105265 0.0262864 0.0800775 0.021977 0.0188283 10
reco:crtreco:TwoCRTMatchingProducer 0.00929051 0.0155414 0.0203888 0.0164871 0.00377033 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.88331 1.08585 1.31136 1.00771 0.150622 10
reco:pandora2Track:LArPandoraTrackCreation 12.5219 23.2389 36.7634 19.8685 7.86965 10
reco:pandora2calo:Calorimetry 6.59902 11.4018 18.2186 10.1146 3.87453 10
reco:pandora2calonosce:Calorimetry 6.30713 10.632 16.6626 9.48993 3.2584 10
reco:pandora2pid:Chi2ParticleID 0.011826 0.0154872 0.0195608 0.0145065 0.00295398 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0586872 0.0738895 0.0948159 0.0695469 0.0121158 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0117481 0.0153651 0.019733 0.0143497 0.00285451 10
reco:pandora2Shower:LArPandoraShowerCreation 5.36714 7.69662 11.7144 7.45844 1.94402 10
reco:pandora2Showercalo:ShowerCalorimetry 5.6344 8.64083 12.7911 8.51985 2.24721 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.85884 7.60144 12.8933 7.32866 2.25304 10
[art]:TriggerResults:TriggerResultInserter 3.5663e-05 4.89872e-05 0.000117665 4.2429e-05 2.3119e-05 10
end_path:out1:RootOutput 6.839e-06 4.84984e-05 0.000415451 7.7265e-06 0.000122319 10
end_path:out1:RootOutput(write) 2.88105 3.59265 4.49745 3.36969 0.586028 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5170.54 MB
Peak resident set size usage (VmHWM): 4232.81 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.28 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11018140
-rw-r--r--. 1 dune009 dune 2560134788 Jan 13 19:55 detsim_stage2.root
-rw-r--r--. 1 dune009 dune 2424846373 Jan 13 19:52 detsim_stage1.root
-rw-r--r--. 1 dune009 dune 2266498781 Jan 13 21:17 reco_stage1.root
-rw-r--r--. 1 dune009 dune 2023344495 Jan 13 17:08 g4_stage2.root
-rw-r--r--. 1 dune009 dune 1927054201 Jan 13 16:50 g4_stage1.root
-rw-r--r--. 1 dune009 dune 80077490 Jan 13 21:13 Pandora_Events.pndr
-rw-r--r--. 1 dune009 dune 243058 Jan 13 21:17 jobscript.log
-rw-r--r--. 1 dune009 dune 217088 Jan 13 21:17 mem.db
-rw-r--r--. 1 dune009 dune 62376 Jan 13 21:17 Pandora_Geometry.xml
-rw-r--r--. 1 dune009 dune 36864 Jan 13 21:17 time.db
-rw-r--r--. 1 dune009 dune 519 Jan 13 19:55 detsim_single_protoDUNE_hist.root
-rw-r--r--. 1 dune009 dune 519 Jan 13 17:08 g4_protoDUNE_hist.root
-rw-r--r--. 1 dune009 dune 519 Jan 13 21:17 protoDUNE_reco1_hist.root
-rw-r--r--. 1 dune009 dune 52 Jan 13 16:42 all-input-dids.txt
-rw-r--r--. 1 dune009 dune 7 Jan 13 21:17 justin-processed-pfns.txt
-rw-r--r--. 1 dune009 dune 0 Jan 13 20:04 ProtoDUNE.log
-rw-r--r--. 1 dune009 dune 0 Jan 13 19:55 debugprod.log