Jobsub ID 281533.1@dunegpschedd01.fnal.gov
| Jobsub ID | 281533.1@dunegpschedd01.fnal.gov |
| Workflow ID | 12082 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-18 21:40:10 |
| Site | CZ_FZU |
| Entry | Nova_CZ_FZU_osgce2 |
| Last heartbeat | 2026-01-19 00:49:22 |
| From worker node | Hostname | lupin21.farm.particle.cz |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-18 21:41:34 |
| Input files | monte-carlo-012082-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (11223s) |
| CPU time | 3h (10879s = 96%) |
| Max RSS bytes | 4515966976 (4306 MiB) |
| Outputting started | 2026-01-19 00:48:38 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12082/1/001/reco_stage1.root
|
| Finished | 2026-01-19 00:49:22 |
| Saved logs | justin-logs:281533.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 161263 traces, 0 summary
Retagger: tagging trace set: gauss with 119469 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 119469 traces tagged "gauss"
FrameSaver: q=4.14617e+06 n=2056874 tag=gauss
wclsFrameSaver: saving 161263 traces tagged "wiener"
FrameSaver: q=4.41451e+06 n=1805588 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 23003 XUs and 22455 XVs -> 163 XUVs
C:0 T:1 40716 XUs and 39874 XVs -> 2693 XUVs
C:0 T:2 113527 XUs and 133067 XVs -> 6247 XUVs
C:0 T:3 51667 XUs and 53570 XVs -> 314 XUVs
C:0 T:4 12969 XUs and 13942 XVs -> 269 XUVs
C:0 T:5 59739 XUs and 72803 XVs -> 16299 XUVs
C:0 T:6 153701 XUs and 146615 XVs -> 9095 XUVs
C:0 T:7 44026 XUs and 53013 XVs -> 449 XUVs
C:0 T:8 10552 XUs and 13305 XVs -> 291 XUVs
C:0 T:9 74846 XUs and 109837 XVs -> 6113 XUVs
C:0 T:10 74392 XUs and 73737 XVs -> 8522 XUVs
C:0 T:11 220 XUs and 181 XVs -> 18 XUVs
50473 XUVs total
14510 collection wire objects
46417 potential space points
Neighbour search...
5464665 tests to find 2609198 neighbours
Iterating with no regularization...
Begin: 8.47419e+07
0 6.65105e+07
1 6.5345e+07
2 6.52042e+07
3 6.51606e+07
Now with regularization...
Begin: 5.30174e+07
0 5.29669e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411824343
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411824343
fLifetime: 30000 [us]
19-Jan-2026 01:48:36 CET Closed output file "reco_stage1.root"
19-Jan-2026 01:48:36 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 248.265 393.969 543.567 381.306 92.0923 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000966245 0.00323873 0.00536224 0.0033185 0.00142423 10
reco:ophit:OpHitFinder 0.257019 0.304997 0.376916 0.301905 0.0369458 10
reco:opflash:OpFlashFinder 0.146501 0.217178 0.30202 0.213091 0.0512769 10
reco:opslicer:OpSlicer 0.538693 0.726548 1.01614 0.694633 0.132193 10
reco:caldata:DataPrepModule 5.27802 5.44711 5.65229 5.45367 0.115341 10
reco:wclsdatasp:WireCellToolkit 32.0657 35.5703 38.2475 36.2708 2.38479 10
reco:gaushit:GausHitFinder 0.931746 1.33874 1.68965 1.24969 0.249293 10
reco:nhitsfilter:NumberOfHitsFilter 0.000432648 0.000594772 0.000806196 0.000587697 9.90463e-05 10
reco:reco3d:SpacePointSolver 8.73421 17.0182 31.2249 16.4525 6.94149 10
reco:hitpdune:DisambigFromSpacePoints 1.04338 1.9309 2.82988 1.83777 0.618044 10
reco:pandora:StandardPandora 17.8548 50.0563 99.0092 40.4946 24.419 10
reco:pandoraWriter:StandardPandora 0.335676 0.611587 0.973685 0.572169 0.20722 10
reco:pandoraTrack:LArPandoraTrackCreation 2.9574 5.86107 8.9519 5.61378 1.70049 10
reco:pandoraShower:LArPandoraShowerCreation 3.38339 6.85809 11.9731 6.88644 2.6812 10
reco:pandoracalo:Calorimetry 1.38143 2.82079 4.02903 2.77891 0.757763 10
reco:pandoracalonosce:Calorimetry 1.25211 2.59677 3.73224 2.54932 0.703128 10
reco:pandorapid:Chi2ParticleID 0.00506959 0.00705897 0.0124932 0.00656445 0.00196425 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0398484 0.0571857 0.0728466 0.0574328 0.0102839 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00492748 0.00624701 0.00765677 0.00609857 0.000784674 10
reco:pandoraShowercalo:ShowerCalorimetry 2.67673 6.16837 10.1422 6.42737 2.31716 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.61164 6.01829 10.055 6.19516 2.32396 10
reco:emtrkmichelid:EmTrackMichelId 133.42 189.04 242.746 185.504 34.2777 10
reco:crttag:SingleCRTMatchingProducer 0.011411 0.0164461 0.0219272 0.0165366 0.00425982 10
reco:crtreco:TwoCRTMatchingProducer 0.00712695 0.0114276 0.0148018 0.0118869 0.00224107 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.711043 0.999712 1.21657 1.07701 0.182036 10
reco:pandora2Track:LArPandoraTrackCreation 9.60525 19.3701 32.4945 19.5896 6.89127 10
reco:pandora2calo:Calorimetry 3.84374 8.49116 13.4179 8.71151 2.89117 10
reco:pandora2calonosce:Calorimetry 3.60717 8.00069 12.476 8.28259 2.66323 10
reco:pandora2pid:Chi2ParticleID 0.0134966 0.0183533 0.0222809 0.0180614 0.00333794 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0561734 0.080592 0.104121 0.0794716 0.0155741 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0133346 0.0181389 0.0217505 0.0186914 0.00308883 10
reco:pandora2Shower:LArPandoraShowerCreation 3.79444 7.24162 11.3341 7.26058 2.33211 10
reco:pandora2Showercalo:ShowerCalorimetry 3.30068 6.98676 10.7443 7.14436 2.13332 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.96341 6.1452 9.46583 6.06945 1.84969 10
[art]:TriggerResults:TriggerResultInserter 4.299e-05 6.15985e-05 0.000158549 5.03045e-05 3.30327e-05 10
end_path:out1:RootOutput 1.024e-05 1.21629e-05 1.8189e-05 1.153e-05 2.14624e-06 10
end_path:out1:RootOutput(write) 2.75972 3.80766 5.26971 3.86802 0.767491 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5322.88 MB
Peak resident set size usage (VmHWM): 4515.97 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.20 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.57 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.11 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11498152
-rw-r--r-- 1 fermilab users 2657246464 Jan 19 00:40 detsim_stage2.root
-rw-r--r-- 1 fermilab users 2524678825 Jan 19 00:38 detsim_stage1.root
-rw-r--r-- 1 fermilab users 2389026672 Jan 19 01:48 reco_stage1.root
-rw-r--r-- 1 fermilab users 2105251514 Jan 18 23:04 g4_stage2.root
-rw-r--r-- 1 fermilab users 2010870337 Jan 18 22:48 g4_stage1.root
-rw-r--r-- 1 fermilab users 86403150 Jan 19 01:43 Pandora_Events.pndr
-rw-r--r-- 1 fermilab users 242905 Jan 19 01:48 jobscript.log
-rw-r--r-- 1 fermilab users 217088 Jan 19 01:48 mem.db
-rw-r--r-- 1 fermilab users 62376 Jan 19 01:48 Pandora_Geometry.xml
-rw-r--r-- 1 fermilab users 36864 Jan 19 01:48 time.db
-rw-r--r-- 1 fermilab users 519 Jan 19 00:40 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 fermilab users 519 Jan 18 23:04 g4_protoDUNE_hist.root
-rw-r--r-- 1 fermilab users 519 Jan 19 01:48 protoDUNE_reco1_hist.root
-rw-r--r-- 1 fermilab users 52 Jan 18 22:41 all-input-dids.txt
-rw-r--r-- 1 fermilab users 7 Jan 19 01:48 justin-processed-pfns.txt
-rw-r--r-- 1 fermilab users 0 Jan 19 00:46 ProtoDUNE.log
-rw-r--r-- 1 fermilab users 0 Jan 19 00:40 debugprod.log
