Jobsub ID 270504.1@dunegpschedd01.fnal.gov
| Jobsub ID | 270504.1@dunegpschedd01.fnal.gov |
| Workflow ID | 11380 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-28 15:22:07 |
| Site | US_FNAL-T1 |
| Entry | CMSHTPC_T1_US_FNAL_condce_opp1_whole |
| Last heartbeat | 2025-12-28 17:32:55 |
| From worker node | Hostname | dunegli-49579-0-cmswn6018.fnal.gov |
| cpuinfo | AMD EPYC 9354 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-28 15:22:36 |
| Input files | monte-carlo-011380-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7808s) |
| CPU time | 2h (7755s = 99%) |
| Max RSS bytes | 4455641088 (4249 MiB) |
| Outputting started | 2025-12-28 17:32:44 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11380/1/001/reco_stage1.root
|
| Finished | 2025-12-28 17:32:55 |
| Saved logs | justin-logs:270504.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ing tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 147894 traces, 0 summary
Retagger: tagging trace set: gauss with 109313 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 109313 traces tagged "gauss"
FrameSaver: q=3.97709e+06 n=1945609 tag=gauss
wclsFrameSaver: saving 147894 traces tagged "wiener"
FrameSaver: q=4.24044e+06 n=1718169 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 44571 XUs and 38264 XVs -> 700 XUVs
C:0 T:1 111908 XUs and 84977 XVs -> 10401 XUVs
C:0 T:2 87509 XUs and 206115 XVs -> 8205 XUVs
C:0 T:3 43443 XUs and 61456 XVs -> 361 XUVs
C:0 T:4 12606 XUs and 15208 XVs -> 158 XUVs
C:0 T:5 145669 XUs and 96332 XVs -> 17780 XUVs
C:0 T:6 102106 XUs and 111306 XVs -> 8133 XUVs
C:0 T:7 25918 XUs and 32606 XVs -> 530 XUVs
C:0 T:8 8110 XUs and 9594 XVs -> 109 XUVs
C:0 T:9 65021 XUs and 113957 XVs -> 6062 XUVs
C:0 T:10 55816 XUs and 37754 XVs -> 8161 XUVs
C:0 T:11 87 XUs and 60 XVs -> 10 XUVs
60610 XUVs total
13603 collection wire objects
55681 potential space points
Neighbour search...
8002601 tests to find 3673784 neighbours
Iterating with no regularization...
Begin: 1.13264e+08
0 8.29515e+07
1 8.1296e+07
2 8.10586e+07
3 8.09871e+07
Now with regularization...
Begin: 6.9063e+07
0 6.89784e+07
1 6.89284e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411396609
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411396609
fLifetime: 30000 [us]
28-Dec-2025 17:32:43 UTC Closed output file "reco_stage1.root"
28-Dec-2025 17:32:43 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 148.817 225.929 265.323 229.762 35.7939 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000687529 0.00286198 0.0044017 0.00319404 0.0011985 10
reco:ophit:OpHitFinder 0.191306 0.220277 0.248986 0.221974 0.0191968 10
reco:opflash:OpFlashFinder 0.125179 0.16678 0.197479 0.175173 0.0235066 10
reco:opslicer:OpSlicer 0.372662 0.433528 0.48706 0.421723 0.040105 10
reco:caldata:DataPrepModule 3.04299 3.14592 3.30898 3.13047 0.0764282 10
reco:wclsdatasp:WireCellToolkit 20.4322 21.0833 21.8687 21.0571 0.487711 10
reco:gaushit:GausHitFinder 0.493672 0.70122 0.845016 0.731879 0.118538 10
reco:nhitsfilter:NumberOfHitsFilter 0.000194858 0.000265599 0.000429766 0.000254919 6.27563e-05 10
reco:reco3d:SpacePointSolver 3.86494 12.8833 18.8094 12.9064 3.95853 10
reco:hitpdune:DisambigFromSpacePoints 0.522157 0.987528 1.35152 1.03597 0.273108 10
reco:pandora:StandardPandora 10.2231 26.0115 34.4768 29.2286 7.1375 10
reco:pandoraWriter:StandardPandora 0.188456 0.265614 0.313502 0.279923 0.0435913 10
reco:pandoraTrack:LArPandoraTrackCreation 1.24516 2.23229 2.96841 2.327 0.509932 10
reco:pandoraShower:LArPandoraShowerCreation 1.19958 2.61244 3.62103 2.78929 0.731622 10
reco:pandoracalo:Calorimetry 0.737313 1.34325 1.74591 1.39656 0.310043 10
reco:pandoracalonosce:Calorimetry 0.678549 1.25462 1.65567 1.30161 0.297664 10
reco:pandorapid:Chi2ParticleID 0.00231601 0.00328551 0.00437342 0.00337082 0.000510394 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.021241 0.0298648 0.0348677 0.0306634 0.00377409 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00228527 0.00297813 0.00331236 0.00309624 0.000323609 10
reco:pandoraShowercalo:ShowerCalorimetry 1.23796 2.92425 4.04266 3.20442 0.893724 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.20353 2.86524 3.99413 3.12814 0.884763 10
reco:emtrkmichelid:EmTrackMichelId 89.5978 119.338 143.047 121.074 16.9382 10
reco:crttag:SingleCRTMatchingProducer 0.00478477 0.00769651 0.0111905 0.00816283 0.00169466 10
reco:crtreco:TwoCRTMatchingProducer 0.00325967 0.00473691 0.00559018 0.0049624 0.0007237 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.365001 0.521203 0.684464 0.518181 0.0820393 10
reco:pandora2Track:LArPandoraTrackCreation 3.55757 7.43209 9.94638 7.82897 2.02145 10
reco:pandora2calo:Calorimetry 1.85191 4.0673 5.3599 4.37144 1.13847 10
reco:pandora2calonosce:Calorimetry 1.7663 3.8888 5.15083 4.16142 1.08825 10
reco:pandora2pid:Chi2ParticleID 0.00537253 0.00743705 0.00893456 0.00768643 0.00113143 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0241608 0.0371352 0.0447832 0.0376474 0.00592421 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00523606 0.00725748 0.00854795 0.0074881 0.00108885 10
reco:pandora2Shower:LArPandoraShowerCreation 1.35917 2.75347 3.54985 2.94629 0.683646 10
reco:pandora2Showercalo:ShowerCalorimetry 1.62888 3.53781 4.62849 3.82387 0.976833 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.46102 3.22941 4.21263 3.48472 0.88787 10
[art]:TriggerResults:TriggerResultInserter 2.7833e-05 3.9935e-05 0.00010483 3.37665e-05 2.17303e-05 10
end_path:out1:RootOutput 7.261e-06 9.6959e-06 1.5083e-05 8.248e-06 2.75369e-06 10
end_path:out1:RootOutput(write) 1.33742 1.86108 2.18866 1.9098 0.265846 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5274.15 MB
Peak resident set size usage (VmHWM): 4455.64 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 1.93 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10951548
-rw-r--r-- 1 dunegli fnalgrid 2545858646 Dec 28 16:54 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2408691547 Dec 28 16:52 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2267486747 Dec 28 17:32 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1993312445 Dec 28 15:33 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1914650033 Dec 28 15:25 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 83772280 Dec 28 17:29 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243237 Dec 28 17:32 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 28 17:32 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 28 17:32 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 28 17:32 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 28 16:54 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 28 15:33 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 28 17:32 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 28 15:22 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 28 17:32 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 28 16:57 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 28 16:54 debugprod.log