Jobsub ID 281539.1@dunegpschedd01.fnal.gov
| Jobsub ID | 281539.1@dunegpschedd01.fnal.gov |
| Workflow ID | 12086 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-18 21:42:12 |
| Site | CZ_FZU |
| Entry | Nova_CZ_FZU_osgce1 |
| Last heartbeat | 2026-01-19 01:58:54 |
| From worker node | Hostname | milan25.farm.particle.cz |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-18 21:44:43 |
| Input files | monte-carlo-012086-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (15207s) |
| CPU time | 4h (14803s = 97%) |
| Max RSS bytes | 4715667456 (4497 MiB) |
| Outputting started | 2026-01-19 01:58:11 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12086/1/001/reco_stage1.root
|
| Finished | 2026-01-19 01:58:54 |
| Saved logs | justin-logs:281539.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
nder
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 154678 traces, 0 summary
Retagger: tagging trace set: gauss with 117350 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 117350 traces tagged "gauss"
FrameSaver: q=4.2997e+06 n=2104819 tag=gauss
wclsFrameSaver: saving 154678 traces tagged "wiener"
FrameSaver: q=4.58693e+06 n=1885224 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 38106 XUs and 36028 XVs -> 443 XUVs
C:0 T:1 72598 XUs and 64221 XVs -> 5643 XUVs
C:0 T:2 92266 XUs and 109341 XVs -> 6630 XUVs
C:0 T:3 42011 XUs and 33362 XVs -> 259 XUVs
C:0 T:4 18320 XUs and 16666 XVs -> 248 XUVs
C:0 T:5 63713 XUs and 57571 XVs -> 5300 XUVs
C:0 T:6 121109 XUs and 113808 XVs -> 5609 XUVs
C:0 T:7 49524 XUs and 47079 XVs -> 425 XUVs
C:0 T:8 9601 XUs and 10021 XVs -> 145 XUVs
C:0 T:9 56666 XUs and 83522 XVs -> 7370 XUVs
C:0 T:10 87450 XUs and 56565 XVs -> 9663 XUVs
C:0 T:11 736 XUs and 415 XVs -> 85 XUVs
41820 XUVs total
12891 collection wire objects
39035 potential space points
Neighbour search...
3496711 tests to find 1733318 neighbours
Iterating with no regularization...
Begin: 8.30073e+07
0 6.93485e+07
1 6.81778e+07
2 6.80036e+07
3 6.79542e+07
Now with regularization...
Begin: 5.51727e+07
0 5.51296e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411824320
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411824320
fLifetime: 30000 [us]
19-Jan-2026 02:58:09 CET Closed output file "reco_stage1.root"
19-Jan-2026 02:58:09 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 356.632 480.099 635.332 455.094 85.0757 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00105053 0.00351127 0.00536458 0.00394661 0.00131521 10
reco:ophit:OpHitFinder 0.334276 0.392726 0.479074 0.395831 0.0407643 10
reco:opflash:OpFlashFinder 0.195067 0.256317 0.362474 0.250877 0.0432746 10
reco:opslicer:OpSlicer 0.603503 0.918823 1.22188 0.927757 0.152042 10
reco:caldata:DataPrepModule 4.31915 6.39642 7.806 6.32564 0.91057 10
reco:wclsdatasp:WireCellToolkit 34.0995 37.209 39.5215 37.431 1.7122 10
reco:gaushit:GausHitFinder 1.02734 1.61554 2.21682 1.61282 0.377293 10
reco:nhitsfilter:NumberOfHitsFilter 0.000536501 0.000799981 0.00118315 0.000729692 0.000214092 10
reco:reco3d:SpacePointSolver 13.0597 23.8634 38.0396 21.5771 8.60098 10
reco:hitpdune:DisambigFromSpacePoints 1.48286 2.73308 3.878 2.62356 0.649991 10
reco:pandora:StandardPandora 24.8911 52.2408 88.0121 51.4712 17.5406 10
reco:pandoraWriter:StandardPandora 0.36711 0.601226 0.870049 0.602328 0.154918 10
reco:pandoraTrack:LArPandoraTrackCreation 3.79893 5.32299 8.02053 5.31 1.2594 10
reco:pandoraShower:LArPandoraShowerCreation 3.28218 6.10256 9.50391 6.11575 1.82787 10
reco:pandoracalo:Calorimetry 2.10931 2.77016 3.55146 2.88404 0.488345 10
reco:pandoracalonosce:Calorimetry 1.99433 2.52881 3.32922 2.4542 0.481838 10
reco:pandorapid:Chi2ParticleID 0.00453198 0.00714126 0.0104719 0.00720205 0.00176285 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0382958 0.0665936 0.109678 0.0648766 0.0198864 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00410955 0.00674686 0.00869691 0.00714543 0.00150924 10
reco:pandoraShowercalo:ShowerCalorimetry 4.35808 6.45 9.34097 6.52636 1.55986 10
reco:pandoraShowercalonosce:ShowerCalorimetry 4.34032 6.48563 8.93619 6.51379 1.56135 10
reco:emtrkmichelid:EmTrackMichelId 209.366 259.704 314.812 247.297 37.2309 10
reco:crttag:SingleCRTMatchingProducer 0.0154176 0.019096 0.0348593 0.0176527 0.00552801 10
reco:crtreco:TwoCRTMatchingProducer 0.00798467 0.0101743 0.0165048 0.00936181 0.00231739 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.775659 1.107 1.50556 1.03792 0.217988 10
reco:pandora2Track:LArPandoraTrackCreation 12.9838 18.8307 30.137 17.6381 5.33207 10
reco:pandora2calo:Calorimetry 5.46645 9.41204 15.0627 9.01247 2.46491 10
reco:pandora2calonosce:Calorimetry 5.73277 8.83132 14.9972 8.24746 2.56664 10
reco:pandora2pid:Chi2ParticleID 0.0162046 0.0215531 0.027404 0.0207667 0.0037065 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0763015 0.0990994 0.138647 0.0945065 0.0188342 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0120467 0.0198323 0.025874 0.020338 0.00413028 10
reco:pandora2Shower:LArPandoraShowerCreation 4.75541 6.58425 11.1113 5.82458 1.93693 10
reco:pandora2Showercalo:ShowerCalorimetry 6.10031 8.21985 12.7988 7.6694 1.95869 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.90364 7.41912 11.3513 7.01003 1.85926 10
[art]:TriggerResults:TriggerResultInserter 4.646e-05 7.76412e-05 0.00018187 6.7095e-05 3.66828e-05 10
end_path:out1:RootOutput 8.45e-06 1.3444e-05 2.799e-05 1.166e-05 5.16488e-06 10
end_path:out1:RootOutput(write) 2.9022 3.7429 5.46346 3.50844 0.781618 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5562.63 MB
Peak resident set size usage (VmHWM): 4715.67 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.30 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.96 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 12271372
-rw-r--r-- 1 fermilab users 2803990716 Jan 19 01:35 detsim_stage2.root
-rw-r--r-- 1 fermilab users 2655523093 Jan 19 01:32 detsim_stage1.root
-rw-r--r-- 1 fermilab users 2562253837 Jan 19 02:58 reco_stage1.root
-rw-r--r-- 1 fermilab users 2272198477 Jan 18 23:09 g4_stage2.root
-rw-r--r-- 1 fermilab users 2179445317 Jan 18 22:52 g4_stage1.root
-rw-r--r-- 1 fermilab users 91839900 Jan 19 02:52 Pandora_Events.pndr
-rw-r--r-- 1 fermilab users 242815 Jan 19 02:58 jobscript.log
-rw-r--r-- 1 fermilab users 217088 Jan 19 02:58 mem.db
-rw-r--r-- 1 fermilab users 62376 Jan 19 02:58 Pandora_Geometry.xml
-rw-r--r-- 1 fermilab users 36864 Jan 19 02:58 time.db
-rw-r--r-- 1 fermilab users 519 Jan 19 01:35 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 fermilab users 519 Jan 18 23:09 g4_protoDUNE_hist.root
-rw-r--r-- 1 fermilab users 519 Jan 19 02:58 protoDUNE_reco1_hist.root
-rw-r--r-- 1 fermilab users 52 Jan 18 22:44 all-input-dids.txt
-rw-r--r-- 1 fermilab users 7 Jan 19 02:58 justin-processed-pfns.txt
-rw-r--r-- 1 fermilab users 0 Jan 19 01:44 ProtoDUNE.log
-rw-r--r-- 1 fermilab users 0 Jan 19 01:35 debugprod.log
