Jobsub ID 302522.0@dunegpschedd01.fnal.gov
| Jobsub ID | 302522.0@dunegpschedd01.fnal.gov |
| Workflow ID | 12603 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-01-30 21:51:34 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2026-01-30 23:47:16 |
| From worker node | Hostname | dunegli-8333655-0-fnpc23024.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-30 21:52:03 |
| Input files | monte-carlo-012603-000001
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6902s) |
| CPU time | 1h (6828s = 98%) |
| Max RSS bytes | 4239138816 (4042 MiB) |
| Outputting started | 2026-01-30 23:47:05 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/12603/1/001/reco_stage1.root
|
| Finished | 2026-01-30 23:47:16 |
| Saved logs | justin-logs:302522.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 118066 traces, 0 summary
Retagger: tagging trace set: gauss with 85408 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 85408 traces tagged "gauss"
FrameSaver: q=3.01683e+06 n=1452589 tag=gauss
wclsFrameSaver: saving 118066 traces tagged "wiener"
FrameSaver: q=3.2128e+06 n=1265050 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 22029 XUs and 27633 XVs -> 538 XUVs
C:0 T:1 62466 XUs and 61923 XVs -> 8862 XUVs
C:0 T:2 56389 XUs and 50118 XVs -> 2090 XUVs
C:0 T:3 30485 XUs and 22965 XVs -> 113 XUVs
C:0 T:4 12493 XUs and 13536 XVs -> 139 XUVs
C:0 T:5 49694 XUs and 43489 XVs -> 7755 XUVs
C:0 T:6 70747 XUs and 71845 XVs -> 2111 XUVs
C:0 T:7 34967 XUs and 31415 XVs -> 300 XUVs
C:0 T:8 7606 XUs and 7367 XVs -> 81 XUVs
C:0 T:9 82597 XUs and 67846 XVs -> 13813 XUVs
C:0 T:10 35957 XUs and 23811 XVs -> 3406 XUVs
C:0 T:11 270 XUs and 189 XVs -> 26 XUVs
39234 XUVs total
10224 collection wire objects
36583 potential space points
Neighbour search...
5824923 tests to find 2642956 neighbours
Iterating with no regularization...
Begin: 5.49418e+07
0 4.47687e+07
1 4.40161e+07
2 4.3909e+07
3 4.3876e+07
Now with regularization...
Begin: 3.49732e+07
0 3.49222e+07
1 3.48859e+07
2 3.48589e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 412065917
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 412065917
fLifetime: 30000 [us]
30-Jan-2026 23:47:04 UTC Closed output file "reco_stage1.root"
30-Jan-2026 23:47:04 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 124.317 198.981 281.056 188.97 45.743 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000725115 0.00273424 0.0043166 0.00271579 0.00116427 10
reco:ophit:OpHitFinder 0.167199 0.199415 0.223979 0.19734 0.0152285 10
reco:opflash:OpFlashFinder 0.0823908 0.12742 0.171158 0.126735 0.0252974 10
reco:opslicer:OpSlicer 0.336201 0.40687 0.509727 0.394505 0.0552174 10
reco:caldata:DataPrepModule 3.31169 3.44074 3.61348 3.42613 0.09887 10
reco:wclsdatasp:WireCellToolkit 22.0517 22.7779 24.0309 22.4326 0.647641 10
reco:gaushit:GausHitFinder 0.491503 0.709706 0.926876 0.685281 0.13557 10
reco:nhitsfilter:NumberOfHitsFilter 0.000195092 0.000307735 0.000431955 0.000293515 6.89927e-05 10
reco:reco3d:SpacePointSolver 3.49634 8.54304 13.93 8.26262 3.01764 10
reco:hitpdune:DisambigFromSpacePoints 0.447524 0.976581 1.53465 0.845918 0.356171 10
reco:pandora:StandardPandora 6.6953 19.3983 42.3363 16.6582 9.50484 10
reco:pandoraWriter:StandardPandora 0.153858 0.248806 0.352942 0.241845 0.0544188 10
reco:pandoraTrack:LArPandoraTrackCreation 0.994344 2.02726 3.43825 1.9579 0.655424 10
reco:pandoraShower:LArPandoraShowerCreation 0.890319 2.20556 3.77463 1.90589 0.890823 10
reco:pandoracalo:Calorimetry 0.590912 1.22851 2.01179 1.21104 0.385149 10
reco:pandoracalonosce:Calorimetry 0.537014 1.13603 1.88834 1.11877 0.365735 10
reco:pandorapid:Chi2ParticleID 0.00240038 0.00330592 0.00451864 0.00334594 0.000586743 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.021808 0.0308226 0.037034 0.0310085 0.00514314 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00228503 0.00305633 0.00418407 0.00303664 0.000497266 10
reco:pandoraShowercalo:ShowerCalorimetry 0.958274 2.51018 4.22832 2.20102 1.03989 10
reco:pandoraShowercalonosce:ShowerCalorimetry 0.925102 2.44909 4.10275 2.14695 1.02631 10
reco:emtrkmichelid:EmTrackMichelId 71.1751 106.277 137.754 101.197 20.6822 10
reco:crttag:SingleCRTMatchingProducer 0.00474084 0.00864898 0.0131977 0.00913413 0.00221424 10
reco:crtreco:TwoCRTMatchingProducer 0.00330657 0.0047282 0.0064753 0.00461845 0.000953267 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.406846 0.566758 0.816947 0.532589 0.132869 10
reco:pandora2Track:LArPandoraTrackCreation 2.77532 6.41912 10.6012 5.79503 2.39966 10
reco:pandora2calo:Calorimetry 1.51127 3.54835 5.83498 3.28826 1.31081 10
reco:pandora2calonosce:Calorimetry 1.41308 3.3952 5.58589 3.1789 1.26553 10
reco:pandora2pid:Chi2ParticleID 0.00516017 0.00776698 0.0112742 0.00732805 0.00168275 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0261284 0.0384723 0.0478598 0.0372179 0.00685237 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0050431 0.00743346 0.0110556 0.00700603 0.00162299 10
reco:pandora2Shower:LArPandoraShowerCreation 1.08555 2.40418 3.76104 2.26325 0.826208 10
reco:pandora2Showercalo:ShowerCalorimetry 1.30846 3.13629 4.98079 2.95528 1.13897 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.22101 2.90906 4.54233 2.77505 1.04714 10
[art]:TriggerResults:TriggerResultInserter 3.0749e-05 3.87991e-05 8.3299e-05 3.27225e-05 1.50722e-05 10
end_path:out1:RootOutput 5.24e-06 8.4463e-06 1.2304e-05 8.682e-06 1.73691e-06 10
end_path:out1:RootOutput(write) 1.18512 1.78383 2.33029 1.68996 0.362685 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5057.02 MB
Peak resident set size usage (VmHWM): 4239.14 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.17 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 9971280
-rw-r--r-- 1 dunegli fnalgrid 2362020932 Jan 30 23:12 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2246016744 Jan 30 23:11 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2042932462 Jan 30 23:47 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1781144830 Jan 30 22:02 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1704007153 Jan 30 21:55 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 73844560 Jan 30 23:45 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242989 Jan 30 23:47 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Jan 30 23:47 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Jan 30 23:47 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Jan 30 23:47 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 30 23:12 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 30 22:02 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Jan 30 23:47 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Jan 30 21:52 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Jan 30 23:47 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 30 23:16 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 30 23:12 debugprod.log
