Jobsub ID 267428.0@dunegpschedd01.fnal.gov
| Jobsub ID | 267428.0@dunegpschedd01.fnal.gov |
| Workflow ID | 11190 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-12 18:07:41 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-12-13 00:01:02 |
| From worker node | Hostname | dunegli-8047108-0-fnpc23017.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-12 18:08:02 |
| Input files | monte-carlo-011190-000001
|
| Jobscript | Exit code | 0 |
| Real time | 5h (21128s) |
| CPU time | 5h (20711s = 98%) |
| Max RSS bytes | 4438732800 (4233 MiB) |
| Outputting started | 2025-12-13 00:00:11 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11190/1/001/reco_stage1.root
|
| Finished | 2025-12-13 00:01:02 |
| Saved logs | justin-logs:267428.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
dc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 94057 traces, 0 summary
Retagger: tagging trace set: gauss with 73700 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 73700 traces tagged "gauss"
FrameSaver: q=2.52678e+06 n=1316273 tag=gauss
wclsFrameSaver: saving 94057 traces tagged "wiener"
FrameSaver: q=2.67863e+06 n=1179319 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 25212 XUs and 24048 XVs -> 121 XUVs
C:0 T:1 36765 XUs and 33534 XVs -> 2110 XUVs
C:0 T:2 62263 XUs and 76401 XVs -> 3009 XUVs
C:0 T:4 9357 XUs and 5566 XVs -> 83 XUVs
C:0 T:5 58741 XUs and 17677 XVs -> 5354 XUVs
C:0 T:6 66319 XUs and 89794 XVs -> 4178 XUVs
C:0 T:7 26322 XUs and 38321 XVs -> 281 XUVs
C:0 T:8 3742 XUs and 3049 XVs -> 42 XUVs
C:0 T:9 52097 XUs and 31210 XVs -> 3271 XUVs
C:0 T:10 52602 XUs and 34036 XVs -> 11462 XUVs
C:0 T:11 140 XUs and 114 XVs -> 27 XUVs
29938 XUVs total
7626 collection wire objects
28645 potential space points
Neighbour search...
4228553 tests to find 1916042 neighbours
Iterating with no regularization...
Begin: 4.84526e+07
0 3.95902e+07
1 3.90103e+07
2 3.89302e+07
3 3.89057e+07
Now with regularization...
Begin: 3.25766e+07
0 3.25393e+07
1 3.25164e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411076761
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411076761
fLifetime: 30000 [us]
13-Dec-2025 00:00:06 UTC Closed output file "reco_stage1.root"
13-Dec-2025 00:00:06 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 444.168 894.532 1194.75 908.43 232.403 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00368504 0.0162208 0.0417952 0.0148403 0.0104956 10
reco:ophit:OpHitFinder 0.272811 0.39059 0.469864 0.39278 0.0549463 10
reco:opflash:OpFlashFinder 0.159778 0.324814 0.461323 0.293877 0.0860111 10
reco:opslicer:OpSlicer 0.487271 0.867572 1.14484 0.879778 0.161389 10
reco:caldata:DataPrepModule 7.42022 8.70387 9.45012 8.83372 0.555638 10
reco:wclsdatasp:WireCellToolkit 65.3169 82.7915 91.8932 84.3367 6.83083 10
reco:gaushit:GausHitFinder 1.08338 2.0977 3.20323 2.02629 0.625137 10
reco:nhitsfilter:NumberOfHitsFilter 0.00254459 0.00424784 0.00578631 0.00437867 0.00105531 10
reco:reco3d:SpacePointSolver 16.5766 32.8771 48.1435 33.7075 10.4255 10
reco:hitpdune:DisambigFromSpacePoints 1.24833 3.95005 5.88604 3.7519 1.61189 10
reco:pandora:StandardPandora 28.863 64.4155 101.381 71.4732 23.6763 10
reco:pandoraWriter:StandardPandora 1.02381 1.33702 2.03534 1.27622 0.292225 10
reco:pandoraTrack:LArPandoraTrackCreation 15.1944 29.4932 44.157 27.3979 9.12369 10
reco:pandoraShower:LArPandoraShowerCreation 7.03022 36.1676 67.57 37.6067 18.1167 10
reco:pandoracalo:Calorimetry 2.87777 17.3947 29.9461 17.1355 6.85565 10
reco:pandoracalonosce:Calorimetry 3.6585 15.9645 29.2127 15.165 6.56216 10
reco:pandorapid:Chi2ParticleID 0.00997963 0.0149579 0.0199249 0.0140684 0.00311312 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0685031 0.128647 0.242904 0.129034 0.0448112 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.0111233 0.0138104 0.0192325 0.0127997 0.00257649 10
reco:pandoraShowercalo:ShowerCalorimetry 5.94062 35.0195 61.7013 31.5684 17.7889 10
reco:pandoraShowercalonosce:ShowerCalorimetry 3.84389 30.6278 56.8518 29.4827 17.5359 10
reco:emtrkmichelid:EmTrackMichelId 197.76 284.305 345.929 289.938 55.2779 10
reco:crttag:SingleCRTMatchingProducer 0.0641854 0.0793869 0.0930538 0.0824956 0.00942351 10
reco:crtreco:TwoCRTMatchingProducer 0.0459373 0.0643781 0.0793704 0.0694571 0.0117303 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.819047 1.41042 2.58253 1.35235 0.47129 10
reco:pandora2Track:LArPandoraTrackCreation 33.1444 88.1252 132.191 73.7464 33.79 10
reco:pandora2calo:Calorimetry 5.86264 44.2261 73.2766 45.6956 20.242 10
reco:pandora2calonosce:Calorimetry 8.32609 36.4007 66.4356 37.7443 14.5286 10
reco:pandora2pid:Chi2ParticleID 0.0166565 0.027413 0.0469857 0.0280651 0.00830598 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.079373 0.144984 0.24043 0.129376 0.0502451 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0160182 0.0245683 0.0299755 0.025504 0.00408073 10
reco:pandora2Shower:LArPandoraShowerCreation 4.56394 20.1668 48.8368 15.9543 13.3608 10
reco:pandora2Showercalo:ShowerCalorimetry 3.94227 27.2175 58.2663 26.1015 15.554 10
reco:pandora2Showercalonosce:ShowerCalorimetry 4.11366 24.3408 57.8388 24.9575 14.8906 10
[art]:TriggerResults:TriggerResultInserter 0.000121874 0.00022253 0.000417599 0.000210192 8.25112e-05 10
end_path:out1:RootOutput 2.1381e-05 4.283e-05 6.5616e-05 4.42195e-05 1.10129e-05 10
end_path:out1:RootOutput(write) 3.26101 4.69618 6.18811 4.68059 0.97219 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5251.8 MB
Peak resident set size usage (VmHWM): 4438.73 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.28 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.51 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.19 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 4.66 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.19 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.20 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10816432
-rw-r--r-- 1 dunegli fnalgrid 2513930722 Dec 12 21:26 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2388911205 Dec 12 21:22 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2213146617 Dec 13 00:00 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1981446493 Dec 12 18:25 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1899990486 Dec 12 18:13 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 77986610 Dec 12 23:55 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243061 Dec 13 00:00 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 13 00:00 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 13 00:00 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 13 00:00 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 21:27 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 18:25 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 13 00:00 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 12 18:08 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 13 00:00 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 21:38 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 21:27 debugprod.log
