Jobsub ID 273251.0@dunegpschedd02.fnal.gov
| Jobsub ID | 273251.0@dunegpschedd02.fnal.gov |
| Workflow ID | 11958 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-15 10:55:47 |
| Site | FR_CCIN2P3 |
| Entry | DUNE_FR_CCIN2P3_cccondorce02 |
| Last heartbeat | 2026-01-15 15:18:57 |
| From worker node | Hostname | ccwcondor0051 |
| cpuinfo | AMD EPYC 9334 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 106200 (29 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-15 10:56:35 |
| Input files | monte-carlo-011958-000001
|
| Jobscript | Exit code | 0 |
| Real time | 4h (15640s) |
| CPU time | 4h (15209s = 97%) |
| Max RSS bytes | 4341886976 (4140 MiB) |
| Outputting started | 2026-01-15 15:17:16 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11958/1/001/reco_stage1.root
|
| Finished | 2026-01-15 15:18:57 |
| Saved logs | justin-logs:273251.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
eBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 152593 traces, 0 summary
Retagger: tagging trace set: gauss with 114206 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 114206 traces tagged "gauss"
FrameSaver: q=4.03624e+06 n=2010447 tag=gauss
wclsFrameSaver: saving 152593 traces tagged "wiener"
FrameSaver: q=4.28976e+06 n=1779447 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 23544 XUs and 37839 XVs -> 906 XUVs
C:0 T:1 73668 XUs and 140854 XVs -> 17483 XUVs
C:0 T:2 109778 XUs and 175012 XVs -> 7761 XUVs
C:0 T:3 50505 XUs and 61780 XVs -> 785 XUVs
C:0 T:4 14107 XUs and 19698 XVs -> 183 XUVs
C:0 T:5 69455 XUs and 99817 XVs -> 6915 XUVs
C:0 T:6 57255 XUs and 119388 XVs -> 5432 XUVs
C:0 T:7 25099 XUs and 35115 XVs -> 195 XUVs
C:0 T:8 9467 XUs and 11647 XVs -> 131 XUVs
C:0 T:9 72974 XUs and 111977 XVs -> 6644 XUVs
C:0 T:10 32628 XUs and 38903 XVs -> 4623 XUVs
C:0 T:11 36 XUs and 28 XVs -> 3 XUVs
51061 XUVs total
14083 collection wire objects
45833 potential space points
Neighbour search...
5041365 tests to find 2446126 neighbours
Iterating with no regularization...
Begin: 1.0143e+08
0 7.53336e+07
1 7.40442e+07
2 7.38379e+07
3 7.37739e+07
Now with regularization...
Begin: 6.08417e+07
0 6.07556e+07
1 6.07157e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411754991
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411754991
fLifetime: 30000 [us]
15-Jan-2026 16:17:14 CET Closed output file "reco_stage1.root"
15-Jan-2026 16:17:14 CET Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 436.666 571.944 734.238 569.435 86.844 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00126916 0.00494306 0.00747632 0.0053256 0.00192957 10
reco:ophit:OpHitFinder 0.362009 0.398117 0.457087 0.388217 0.0344973 10
reco:opflash:OpFlashFinder 0.23509 0.265171 0.318313 0.264735 0.0216788 10
reco:opslicer:OpSlicer 0.827726 0.942624 1.02616 0.944082 0.0621639 10
reco:caldata:DataPrepModule 5.9421 6.53701 7.20094 6.56493 0.307342 10
reco:wclsdatasp:WireCellToolkit 39.3961 43.9861 50.2809 43.1248 3.35323 10
reco:gaushit:GausHitFinder 1.30228 1.71624 2.23402 1.67269 0.252494 10
reco:nhitsfilter:NumberOfHitsFilter 0.00049503 0.0007301 0.00120341 0.000657182 0.000224757 10
reco:reco3d:SpacePointSolver 18.4056 30.197 46.1488 29.5024 9.38809 10
reco:hitpdune:DisambigFromSpacePoints 1.85883 2.59041 3.73209 2.46093 0.529292 10
reco:pandora:StandardPandora 35.7067 62.8649 91.6395 63.09 15.1882 10
reco:pandoraWriter:StandardPandora 0.559289 0.69226 0.826161 0.695726 0.0772796 10
reco:pandoraTrack:LArPandoraTrackCreation 5.23898 10.1354 13.1563 10.2845 2.76632 10
reco:pandoraShower:LArPandoraShowerCreation 6.15388 11.9646 18.1956 11.5177 3.84607 10
reco:pandoracalo:Calorimetry 3.03389 5.24162 6.91807 5.62823 1.34772 10
reco:pandoracalonosce:Calorimetry 2.97903 4.86936 6.51465 5.11098 1.34072 10
reco:pandorapid:Chi2ParticleID 0.00673148 0.00816871 0.00965439 0.00838944 0.000978161 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.071198 0.0855355 0.10431 0.081155 0.0108592 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00527809 0.00764789 0.00938163 0.00761949 0.0011779 10
reco:pandoraShowercalo:ShowerCalorimetry 5.48159 11.5435 17.7832 11.6924 3.98695 10
reco:pandoraShowercalonosce:ShowerCalorimetry 5.38552 11.0785 15.253 12.0482 3.1867 10
reco:emtrkmichelid:EmTrackMichelId 211.792 271.354 352.715 267.853 37.0767 10
reco:crttag:SingleCRTMatchingProducer 0.0162824 0.0300676 0.0495926 0.024606 0.0107324 10
reco:crtreco:TwoCRTMatchingProducer 0.0114598 0.018947 0.0240943 0.0208137 0.00472853 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.996625 1.24368 1.59055 1.25275 0.175572 10
reco:pandora2Track:LArPandoraTrackCreation 17.2613 30.6674 41.608 32.2177 7.44642 10
reco:pandora2calo:Calorimetry 8.72641 14.958 21.1097 14.8142 3.51835 10
reco:pandora2calonosce:Calorimetry 6.33771 14.2285 19.0358 15.6147 3.47962 10
reco:pandora2pid:Chi2ParticleID 0.0133592 0.020096 0.0273647 0.020541 0.00397312 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0705413 0.106987 0.130159 0.110543 0.0177594 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0126263 0.0190769 0.0229764 0.0194153 0.00312158 10
reco:pandora2Shower:LArPandoraShowerCreation 6.2419 9.88084 13.3752 9.86021 2.33008 10
reco:pandora2Showercalo:ShowerCalorimetry 7.44693 10.7941 13.2758 10.8723 1.81477 10
reco:pandora2Showercalonosce:ShowerCalorimetry 6.14975 9.35538 13.1509 9.4214 2.08164 10
[art]:TriggerResults:TriggerResultInserter 7.4894e-05 0.000106735 0.000220444 9.7102e-05 3.91112e-05 10
end_path:out1:RootOutput 1.5073e-05 1.75565e-05 2.3916e-05 1.6209e-05 2.92581e-06 10
end_path:out1:RootOutput(write) 3.11063 3.89039 4.86039 3.85597 0.538943 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5170.7 MB
Peak resident set size usage (VmHWM): 4341.89 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.34 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 3.97 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.05 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11125228
-rw-r--r-- 1 dune001 lbno 2579318802 Jan 15 14:39 detsim_stage2.root
-rw-r--r-- 1 dune001 lbno 2438695581 Jan 15 14:36 detsim_stage1.root
-rw-r--r-- 1 dune001 lbno 2330165840 Jan 15 16:17 reco_stage1.root
-rw-r--r-- 1 dune001 lbno 2010623423 Jan 15 12:19 g4_stage2.root
-rw-r--r-- 1 dune001 lbno 1942106343 Jan 15 12:04 g4_stage1.root
-rw-r--r-- 1 dune001 lbno 90707780 Jan 15 16:10 Pandora_Events.pndr
-rw-r--r-- 1 dune001 lbno 243636 Jan 15 16:17 jobscript.log
-rw-r--r-- 1 dune001 lbno 217088 Jan 15 16:17 mem.db
-rw-r--r-- 1 dune001 lbno 62376 Jan 15 16:17 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 lbno 36864 Jan 15 16:17 time.db
-rw-r--r-- 1 dune001 lbno 519 Jan 15 14:39 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dune001 lbno 519 Jan 15 12:19 g4_protoDUNE_hist.root
-rw-r--r-- 1 dune001 lbno 519 Jan 15 16:17 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dune001 lbno 52 Jan 15 11:56 all-input-dids.txt
-rw-r--r-- 1 dune001 lbno 7 Jan 15 16:17 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 lbno 0 Jan 15 14:48 ProtoDUNE.log
-rw-r--r-- 1 dune001 lbno 0 Jan 15 14:39 debugprod.log
