Jobsub ID 266983.0@dunegpschedd01.fnal.gov
| Jobsub ID | 266983.0@dunegpschedd01.fnal.gov |
| Workflow ID | 11165 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-11 20:10:40 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-12-12 23:41:44 |
| From worker node | Hostname | dunegli-7890379-0-fnpc17119.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-12 11:33:54 |
| Input files | monte-carlo-011165-000001
|
| Jobscript | Exit code | 0 |
| Real time | 12h (43615s) |
| CPU time | 11h (43108s = 98%) |
| Max RSS bytes | 4507537408 (4298 MiB) |
| Outputting started | 2025-12-12 23:40:49 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11165/1/001/reco_stage1.root
|
| Finished | 2025-12-12 23:41:44 |
| Saved logs | justin-logs:266983.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
dRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 162205 traces, 0 summary
Retagger: tagging trace set: gauss with 126143 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 126143 traces tagged "gauss"
FrameSaver: q=4.32447e+06 n=2268301 tag=gauss
wclsFrameSaver: saving 162205 traces tagged "wiener"
FrameSaver: q=4.60013e+06 n=2026582 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 33938 XUs and 43012 XVs -> 534 XUVs
C:0 T:1 64811 XUs and 88464 XVs -> 6262 XUVs
C:0 T:2 75724 XUs and 122964 XVs -> 6745 XUVs
C:0 T:3 37600 XUs and 42311 XVs -> 335 XUVs
C:0 T:4 22581 XUs and 23840 XVs -> 298 XUVs
C:0 T:5 120037 XUs and 127491 XVs -> 12915 XUVs
C:0 T:6 102096 XUs and 109472 XVs -> 7612 XUVs
C:0 T:7 44370 XUs and 40068 XVs -> 340 XUVs
C:0 T:8 9449 XUs and 12731 XVs -> 156 XUVs
C:0 T:9 85230 XUs and 178033 XVs -> 13555 XUVs
C:0 T:10 60041 XUs and 29937 XVs -> 5125 XUVs
C:0 T:11 229 XUs and 178 XVs -> 32 XUVs
53909 XUVs total
15304 collection wire objects
49430 potential space points
Neighbour search...
6495614 tests to find 3097810 neighbours
Iterating with no regularization...
Begin: 7.33821e+07
0 5.76224e+07
1 5.65135e+07
2 5.63465e+07
3 5.62865e+07
4 5.62556e+07
Now with regularization...
Begin: 4.52548e+07
0 4.51916e+07
1 4.51438e+07
2 4.51074e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 411068698
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411068698
fLifetime: 30000 [us]
12-Dec-2025 23:40:42 UTC Closed output file "reco_stage1.root"
12-Dec-2025 23:40:42 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 1179.44 2184.04 2953.35 2245.23 549.643 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00449947 0.0286345 0.0573217 0.0270457 0.0155891 10
reco:ophit:OpHitFinder 0.528069 0.626126 0.744194 0.633581 0.0655689 10
reco:opflash:OpFlashFinder 0.668711 1.1766 1.5017 1.19749 0.224852 10
reco:opslicer:OpSlicer 1.27424 1.56715 1.85371 1.56071 0.189148 10
reco:caldata:DataPrepModule 12.8061 13.4576 14.8285 13.2389 0.544452 10
reco:wclsdatasp:WireCellToolkit 186.105 200.103 217.075 197.454 9.18531 10
reco:gaushit:GausHitFinder 2.55816 3.85394 4.87263 3.81546 0.745892 10
reco:nhitsfilter:NumberOfHitsFilter 0.0036754 0.00490818 0.00576165 0.00508167 0.000685573 10
reco:reco3d:SpacePointSolver 27.3389 67.0795 154.452 59.4985 33.5749 10
reco:hitpdune:DisambigFromSpacePoints 7.50022 19.6112 33.4611 16.4608 7.98087 10
reco:pandora:StandardPandora 94.5563 215.422 420.26 188.98 93.5849 10
reco:pandoraWriter:StandardPandora 1.3001 1.84335 2.31207 1.91166 0.304258 10
reco:pandoraTrack:LArPandoraTrackCreation 29.8291 62.0501 86.6898 66.0706 17.0988 10
reco:pandoraShower:LArPandoraShowerCreation 30.4036 76.7608 109.095 73.6814 25.4551 10
reco:pandoracalo:Calorimetry 14.9489 33.8114 45.8095 36.9291 9.30303 10
reco:pandoracalonosce:Calorimetry 14.4649 33.0797 45.2323 36.1044 9.15376 10
reco:pandorapid:Chi2ParticleID 0.0203316 0.0265148 0.0348986 0.026147 0.00463053 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.149808 0.202808 0.243945 0.20807 0.0325785 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.0162093 0.02205 0.0276587 0.0221728 0.00340385 10
reco:pandoraShowercalo:ShowerCalorimetry 31.6059 88.7697 132.169 86.8822 30.848 10
reco:pandoraShowercalonosce:ShowerCalorimetry 30.5556 87.0672 126.047 85.4625 30.0838 10
reco:emtrkmichelid:EmTrackMichelId 386.724 558.284 695.089 578.085 100.803 10
reco:crttag:SingleCRTMatchingProducer 0.0972698 0.152481 0.217971 0.143189 0.0337012 10
reco:crtreco:TwoCRTMatchingProducer 0.0906513 0.132163 0.161541 0.133186 0.0225451 10
reco:anodepiercerst0:T0RecoAnodePiercers 7.42904 9.35092 12.7351 8.56218 1.91051 10
reco:pandora2Track:LArPandoraTrackCreation 88.1022 212.155 305.569 224.436 64.5646 10
reco:pandora2calo:Calorimetry 43.5139 117.574 163.785 128.323 36.7216 10
reco:pandora2calonosce:Calorimetry 42.9892 113.846 159.502 122.142 35.2066 10
reco:pandora2pid:Chi2ParticleID 0.0350089 0.0578221 0.0743067 0.0592792 0.0116618 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.180727 0.26544 0.329978 0.267488 0.0482127 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0317459 0.0538205 0.0690155 0.0553001 0.0111931 10
reco:pandora2Shower:LArPandoraShowerCreation 30.0471 66.0405 91.7284 64.7157 18.1054 10
reco:pandora2Showercalo:ShowerCalorimetry 39.4565 98.6329 139.15 105.347 30.8623 10
reco:pandora2Showercalonosce:ShowerCalorimetry 37.7011 92.9292 128.497 94.8718 26.8097 10
[art]:TriggerResults:TriggerResultInserter 0.000322461 0.000405691 0.000711773 0.000375888 0.000107036 10
end_path:out1:RootOutput 5.1886e-05 6.498e-05 0.000105268 6.1251e-05 1.44289e-05 10
end_path:out1:RootOutput(write) 4.65336 7.08728 9.36699 7.05098 1.51544 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5332.33 MB
Peak resident set size usage (VmHWM): 4507.54 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.39 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.60 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.24 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 7.72 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.35 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.25 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11707664
-rw-r--r-- 1 dunegli fnalgrid 2683280754 Dec 12 17:30 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2548759991 Dec 12 17:24 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2420824585 Dec 12 23:40 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2170148909 Dec 12 12:03 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2078226566 Dec 12 11:40 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 86779130 Dec 12 23:08 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242894 Dec 12 23:40 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 12 23:40 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 12 23:40 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 12 23:40 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 17:30 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 12:03 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 12 23:40 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 12 11:33 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 12 23:40 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 17:59 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 12 17:31 debugprod.log
