Jobsub ID 257052.0@dunegpschedd01.fnal.gov
| Jobsub ID | 257052.0@dunegpschedd01.fnal.gov |
| Workflow ID | 10664 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-25 08:34:07 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-25 14:09:04 |
| From worker node | Hostname | dunegli-7726130-0-fnpc18009.fnal.gov |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-25 08:34:31 |
| Input files | monte-carlo-010664-000001
|
| Jobscript | Exit code | 0 |
| Real time | 5h (20038s) |
| CPU time | 5h (19662s = 98%) |
| Max RSS bytes | 4160827392 (3968 MiB) |
| Outputting started | 2025-11-25 14:08:29 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10664/1/001/reco_stage1.root
|
| Finished | 2025-11-25 14:09:04 |
| Saved logs | justin-logs:257052.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
nning tool adcScaleKeToAdc
ToolBasedRawDigitPrepService:prepare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 118515 traces, 0 summary
Retagger: tagging trace set: gauss with 88035 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 88035 traces tagged "gauss"
FrameSaver: q=2.86574e+06 n=1508294 tag=gauss
wclsFrameSaver: saving 118515 traces tagged "wiener"
FrameSaver: q=3.04707e+06 n=1318682 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 27067 XUs and 19437 XVs -> 310 XUVs
C:0 T:1 55274 XUs and 44816 XVs -> 5235 XUVs
C:0 T:2 121817 XUs and 101952 XVs -> 5634 XUVs
C:0 T:3 47687 XUs and 39060 XVs -> 403 XUVs
C:0 T:4 13355 XUs and 10843 XVs -> 221 XUVs
C:0 T:5 80143 XUs and 92822 XVs -> 15620 XUVs
C:0 T:6 93305 XUs and 62409 XVs -> 2877 XUVs
C:0 T:7 38674 XUs and 24115 XVs -> 178 XUVs
C:0 T:8 7071 XUs and 8803 XVs -> 120 XUVs
C:0 T:9 56130 XUs and 112931 XVs -> 9196 XUVs
C:0 T:10 16495 XUs and 16323 XVs -> 2683 XUVs
C:0 T:11 130 XUs and 112 XVs -> 14 XUVs
42491 XUVs total
11286 collection wire objects
39711 potential space points
Neighbour search...
6172711 tests to find 2717318 neighbours
Iterating with no regularization...
Begin: 5.30803e+07
0 4.23136e+07
1 4.17089e+07
2 4.16114e+07
3 4.15776e+07
Now with regularization...
Begin: 3.38168e+07
0 3.37796e+07
1 3.37543e+07
run: 1 ; subrun: 0 ; event: 10
evttime: 410727048
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410727048
fLifetime: 30000 [us]
25-Nov-2025 14:08:26 UTC Closed output file "reco_stage1.root"
25-Nov-2025 14:08:26 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 577.358 818.047 1171.37 780.066 200.77 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00260159 0.00619414 0.00904885 0.00648459 0.00204894 10
reco:ophit:OpHitFinder 0.299269 0.410962 0.526231 0.415102 0.0780322 10
reco:opflash:OpFlashFinder 0.169348 0.319881 0.606683 0.255789 0.148549 10
reco:opslicer:OpSlicer 0.659109 1.10533 1.45739 1.18095 0.316323 10
reco:caldata:DataPrepModule 6.34347 9.35564 12.0836 10.2905 2.23386 10
reco:wclsdatasp:WireCellToolkit 43.3285 60.2543 79.7807 59.5911 10.2145 10
reco:gaushit:GausHitFinder 1.3694 2.29258 3.45086 2.38367 0.660479 10
reco:nhitsfilter:NumberOfHitsFilter 0.00087371 0.00128782 0.0019799 0.00118751 0.000380187 10
reco:reco3d:SpacePointSolver 10.9571 26.3781 49.0385 25.3935 11.9212 10
reco:hitpdune:DisambigFromSpacePoints 1.58766 3.19035 5.47118 3.0994 1.28637 10
reco:pandora:StandardPandora 47.7151 81.6847 134.308 78.9097 27.6955 10
reco:pandoraWriter:StandardPandora 0.583662 0.882331 1.20493 0.858677 0.240714 10
reco:pandoraTrack:LArPandoraTrackCreation 6.97428 12.5922 19.4388 11.2215 5.03998 10
reco:pandoraShower:LArPandoraShowerCreation 7.98232 16.2071 27.7037 14.9531 6.88747 10
reco:pandoracalo:Calorimetry 3.62166 8.0094 13.0115 6.66804 3.72041 10
reco:pandoracalonosce:Calorimetry 3.3046 7.43609 11.9055 6.42573 3.26806 10
reco:pandorapid:Chi2ParticleID 0.00667977 0.0120437 0.0170512 0.0111115 0.0032978 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0626734 0.121534 0.178097 0.120791 0.0401234 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00632261 0.0112056 0.015176 0.0109476 0.00312919 10
reco:pandoraShowercalo:ShowerCalorimetry 9.89336 20.8327 39.9017 18.1395 10.7032 10
reco:pandoraShowercalonosce:ShowerCalorimetry 8.1833 20.0382 40.9269 15.5622 11.2329 10
reco:emtrkmichelid:EmTrackMichelId 305.932 384.821 506.655 368.656 66.6739 10
reco:crttag:SingleCRTMatchingProducer 0.0251526 0.0454275 0.0848754 0.044285 0.018959 10
reco:crtreco:TwoCRTMatchingProducer 0.0180517 0.0345006 0.0665 0.0311627 0.0134848 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.985618 1.74733 2.50785 1.7399 0.43977 10
reco:pandora2Track:LArPandoraTrackCreation 26.0705 44.1113 68.7838 38.214 14.5525 10
reco:pandora2calo:Calorimetry 12.8944 27.1107 49.1755 21.8885 12.2768 10
reco:pandora2calonosce:Calorimetry 14.2169 25.6158 44.7745 20.5386 11.3307 10
reco:pandora2pid:Chi2ParticleID 0.0225491 0.0318493 0.04087 0.030927 0.00639532 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.115641 0.161351 0.215432 0.155361 0.0333697 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0212073 0.0286138 0.0371744 0.0291723 0.00518571 10
reco:pandora2Shower:LArPandoraShowerCreation 9.7519 15.7237 23.857 15.0392 4.42885 10
reco:pandora2Showercalo:ShowerCalorimetry 12.4462 22.1967 38.288 18.1499 9.19754 10
reco:pandora2Showercalonosce:ShowerCalorimetry 6.18879 19.6119 32.5865 16.3136 8.75333 10
[art]:TriggerResults:TriggerResultInserter 7.3619e-05 0.000179956 0.000432326 0.000162181 9.31933e-05 10
end_path:out1:RootOutput 1.4728e-05 2.04416e-05 2.8353e-05 1.77985e-05 5.16188e-06 10
end_path:out1:RootOutput(write) 3.2925 5.38636 7.05153 5.27124 1.18509 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4976.15 MB
Peak resident set size usage (VmHWM): 4160.83 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.14 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.37 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 6.13 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.21 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.09 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.01 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10229292
-rw-r--r-- 1 dunegli fnalgrid 2394378968 Nov 25 11:48 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2274340889 Nov 25 11:43 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2105195973 Nov 25 14:08 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1859224109 Nov 25 08:57 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1760531560 Nov 25 08:40 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 80503080 Nov 25 14:00 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242804 Nov 25 14:08 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 25 14:08 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 25 14:08 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 25 14:08 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 25 11:48 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 25 08:57 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 25 14:08 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 25 08:34 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 25 14:08 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 25 11:58 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 25 11:48 debugprod.log
