Jobsub ID 301206.0@dunegpschedd01.fnal.gov
| Jobsub ID | 301206.0@dunegpschedd01.fnal.gov |
| Workflow ID | 12408 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-26 18:54:27 |
| Site | CZ_FZU |
| Entry | Nova_CZ_FZU_osgce1 |
| Last heartbeat | 2026-01-27 00:21:03 |
| From worker node | Hostname | mahagon24.farm.particle.cz |
| cpuinfo | AMD EPYC 7301 16-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-26 18:55:51 |
| Input files | monte-carlo-012408-000001
|
| Jobscript | Exit code | 0 |
| Real time | 5h (19414s) |
| CPU time | 5h (18666s = 96%) |
| Max RSS bytes | 4632854528 (4418 MiB) |
| Outputting started | 2026-01-27 00:19:26 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12408/1/001/reco_stage1.root
|
| Finished | 2026-01-27 00:21:03 |
| Saved logs | justin-logs:301206.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ToolBasedRawDigitPrepService:prepare: Running tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 123228 traces, 0 summary
Retagger: tagging trace set: gauss with 91372 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 91372 traces tagged "gauss"
FrameSaver: q=3.27383e+06 n=1595556 tag=gauss
wclsFrameSaver: saving 123228 traces tagged "wiener"
FrameSaver: q=3.48835e+06 n=1404390 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 22791 XUs and 22980 XVs -> 163 XUVs
C:0 T:1 44777 XUs and 51167 XVs -> 3990 XUVs
C:0 T:2 84526 XUs and 88186 XVs -> 5071 XUVs
C:0 T:3 39908 XUs and 34327 XVs -> 192 XUVs
C:0 T:4 13953 XUs and 9511 XVs -> 174 XUVs
C:0 T:5 57311 XUs and 34651 XVs -> 5770 XUVs
C:0 T:6 98669 XUs and 89891 XVs -> 3653 XUVs
C:0 T:7 39611 XUs and 34918 XVs -> 324 XUVs
C:0 T:8 10873 XUs and 11034 XVs -> 225 XUVs
C:0 T:9 72232 XUs and 120202 XVs -> 8215 XUVs
C:0 T:10 19018 XUs and 15069 XVs -> 3205 XUVs
C:0 T:11 53 XUs and 53 XVs -> 8 XUVs
30990 XUVs total
11508 collection wire objects
28495 potential space points
Neighbour search...
1975015 tests to find 1024930 neighbours
Iterating with no regularization...
Begin: 6.76188e+07
0 5.16083e+07
1 5.06e+07
2 5.04333e+07
3 5.03843e+07
Now with regularization...
Begin: 4.03669e+07
0 4.03223e+07
1 4.02994e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411982899
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411982899
fLifetime: 30000 [us]
27-Jan-2026 01:19:23 CET Closed output file "reco_stage1.root"
27-Jan-2026 01:19:23 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 429.721 688.712 1871.66 545.499 407.944 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.0017991 0.0046516 0.00742318 0.00475939 0.00161522 10
reco:ophit:OpHitFinder 0.324834 0.460607 0.606036 0.469183 0.0851634 10
reco:opflash:OpFlashFinder 0.157579 0.231167 0.315411 0.223853 0.0504378 10
reco:opslicer:OpSlicer 0.829287 1.1014 1.44867 1.01397 0.21921 10
reco:caldata:DataPrepModule 7.21572 9.04085 10.179 9.25132 0.881128 10
reco:wclsdatasp:WireCellToolkit 46.7904 56.5746 62.8586 57.9177 5.3188 10
reco:gaushit:GausHitFinder 1.08985 1.90935 2.66693 1.96367 0.508396 10
reco:nhitsfilter:NumberOfHitsFilter 0.000522888 0.000752573 0.00110755 0.000692759 0.000175252 10
reco:reco3d:SpacePointSolver 10.6332 21.8342 49.3647 17.7918 11.3273 10
reco:hitpdune:DisambigFromSpacePoints 1.02822 2.4213 4.34631 2.45064 0.986934 10
reco:pandora:StandardPandora 28.9827 150.941 1092.11 45.1 314.303 10
reco:pandoraWriter:StandardPandora 0.464941 0.7575 1.73836 0.625361 0.367543 10
reco:pandoraTrack:LArPandoraTrackCreation 3.43887 6.6737 12.5301 5.86635 2.47868 10
reco:pandoraShower:LArPandoraShowerCreation 2.53408 7.25574 12.6021 6.42396 3.16223 10
reco:pandoracalo:Calorimetry 1.96758 3.56439 5.61409 3.42592 1.17396 10
reco:pandoracalonosce:Calorimetry 1.4936 3.3528 6.36859 3.14117 1.43897 10
reco:pandorapid:Chi2ParticleID 0.00720361 0.0109612 0.0148187 0.0107253 0.00236246 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0560169 0.093239 0.127747 0.0969829 0.0259455 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.0056401 0.0100568 0.0136767 0.0101199 0.00241795 10
reco:pandoraShowercalo:ShowerCalorimetry 3.02972 7.35679 13.5958 7.05598 3.46375 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.19006 7.46465 13.0242 7.26082 3.19332 10
reco:emtrkmichelid:EmTrackMichelId 252.059 335.349 477.571 317.902 68.9018 10
reco:crttag:SingleCRTMatchingProducer 0.017938 0.0260985 0.0360005 0.0248193 0.00563501 10
reco:crtreco:TwoCRTMatchingProducer 0.0129611 0.0154697 0.021074 0.0149261 0.0025802 10
reco:anodepiercerst0:T0RecoAnodePiercers 1.08704 1.40459 1.9378 1.36242 0.253077 10
reco:pandora2Track:LArPandoraTrackCreation 10.9121 21.6072 34.1669 20.9354 8.06139 10
reco:pandora2calo:Calorimetry 4.64958 10.5252 16.7897 9.9021 3.75605 10
reco:pandora2calonosce:Calorimetry 4.22339 9.5853 15.1611 8.47203 3.74034 10
reco:pandora2pid:Chi2ParticleID 0.0181127 0.0261911 0.035344 0.0261155 0.00483992 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0819949 0.114086 0.161501 0.107831 0.0242602 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0169216 0.023874 0.0350808 0.0234286 0.0049801 10
reco:pandora2Shower:LArPandoraShowerCreation 4.71431 8.04802 12.6126 7.08154 2.6847 10
reco:pandora2Showercalo:ShowerCalorimetry 4.63134 8.49012 13.2252 8.01427 2.77546 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.14058 7.72581 12.041 6.99593 2.89009 10
[art]:TriggerResults:TriggerResultInserter 6.0825e-05 0.000132972 0.000387814 9.57155e-05 9.97268e-05 10
end_path:out1:RootOutput 1.1883e-05 1.7529e-05 2.9826e-05 1.68315e-05 5.3112e-06 10
end_path:out1:RootOutput(write) 3.67216 4.57507 6.85067 4.20543 0.982086 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5451.37 MB
Peak resident set size usage (VmHWM): 4632.85 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.36 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.07 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 5.60 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.21 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10499608
-rw-r--r-- 1 fermilab users 2491647532 Jan 26 23:20 detsim_stage2.root
-rw-r--r-- 1 fermilab users 2379552986 Jan 26 23:17 detsim_stage1.root
-rw-r--r-- 1 fermilab users 2156108630 Jan 27 01:19 reco_stage1.root
-rw-r--r-- 1 fermilab users 1875425252 Jan 26 20:23 g4_stage2.root
-rw-r--r-- 1 fermilab users 1777545612 Jan 26 20:06 g4_stage1.root
-rw-r--r-- 1 fermilab users 70686020 Jan 27 01:11 Pandora_Events.pndr
-rw-r--r-- 1 fermilab users 243421 Jan 27 01:19 jobscript.log
-rw-r--r-- 1 fermilab users 217088 Jan 27 01:19 mem.db
-rw-r--r-- 1 fermilab users 62376 Jan 27 01:19 Pandora_Geometry.xml
-rw-r--r-- 1 fermilab users 36864 Jan 27 01:19 time.db
-rw-r--r-- 1 fermilab users 519 Jan 26 23:20 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 fermilab users 519 Jan 26 20:23 g4_protoDUNE_hist.root
-rw-r--r-- 1 fermilab users 519 Jan 27 01:19 protoDUNE_reco1_hist.root
-rw-r--r-- 1 fermilab users 52 Jan 26 19:55 all-input-dids.txt
-rw-r--r-- 1 fermilab users 7 Jan 27 01:19 justin-processed-pfns.txt
-rw-r--r-- 1 fermilab users 0 Jan 26 23:29 ProtoDUNE.log
-rw-r--r-- 1 fermilab users 0 Jan 26 23:20 debugprod.log
