Jobsub ID 249148.1@dunegpschedd02.fnal.gov
| Jobsub ID | 249148.1@dunegpschedd02.fnal.gov |
| Workflow ID | 10451 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-21 10:40:17 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-11-21 13:11:36 |
| From worker node | Hostname | dunegli-7833462-0-fnpc23014.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-21 10:40:36 |
| Input files | monte-carlo-010451-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (9034s) |
| CPU time | 2h (8952s = 99%) |
| Max RSS bytes | 4272074752 (4074 MiB) |
| Outputting started | 2025-11-21 13:11:11 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10451/1/001/reco_stage1.root
|
| Finished | 2025-11-21 13:11:36 |
| Saved logs | justin-logs:249148.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 127163 traces, 0 summary
Retagger: tagging trace set: gauss with 98793 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 98793 traces tagged "gauss"
FrameSaver: q=3.60584e+06 n=1850903 tag=gauss
wclsFrameSaver: saving 127163 traces tagged "wiener"
FrameSaver: q=3.80436e+06 n=1670380 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 44434 XUs and 49207 XVs -> 775 XUVs
C:0 T:1 87240 XUs and 130257 XVs -> 9570 XUVs
C:0 T:2 113121 XUs and 118483 XVs -> 5501 XUVs
C:0 T:3 58114 XUs and 50579 XVs -> 369 XUVs
C:0 T:4 10675 XUs and 12395 XVs -> 133 XUVs
C:0 T:5 47309 XUs and 40314 XVs -> 12179 XUVs
C:0 T:6 65999 XUs and 86847 XVs -> 2546 XUVs
C:0 T:7 28838 XUs and 35970 XVs -> 219 XUVs
C:0 T:8 10282 XUs and 10104 XVs -> 296 XUVs
C:0 T:9 70768 XUs and 86805 XVs -> 8666 XUVs
C:0 T:10 38333 XUs and 20157 XVs -> 6128 XUVs
C:0 T:11 126 XUs and 56 XVs -> 10 XUVs
46392 XUVs total
10487 collection wire objects
42551 potential space points
Neighbour search...
6741071 tests to find 3006040 neighbours
Iterating with no regularization...
Begin: 6.92978e+07
0 5.83231e+07
1 5.75449e+07
2 5.7434e+07
3 5.74002e+07
Now with regularization...
Begin: 4.79489e+07
0 4.78958e+07
1 4.78567e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 410648340
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410648340
fLifetime: 30000 [us]
21-Nov-2025 13:11:10 UTC Closed output file "reco_stage1.root"
21-Nov-2025 13:11:10 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 172.582 240.466 366.641 220.649 61.3913 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000922928 0.00278502 0.00420287 0.00305823 0.00114218 10
reco:ophit:OpHitFinder 0.191257 0.217451 0.250271 0.212819 0.0160133 10
reco:opflash:OpFlashFinder 0.114585 0.146892 0.186401 0.147364 0.0203575 10
reco:opslicer:OpSlicer 0.409783 0.484075 0.582927 0.476435 0.0604984 10
reco:caldata:DataPrepModule 3.37337 3.45996 3.56719 3.46882 0.0672462 10
reco:wclsdatasp:WireCellToolkit 21.1827 22.702 24.5713 22.3493 1.05502 10
reco:gaushit:GausHitFinder 0.689565 0.825388 1.09953 0.780793 0.127336 10
reco:nhitsfilter:NumberOfHitsFilter 0.000278644 0.000364289 0.000542819 0.000339119 8.58596e-05 10
reco:reco3d:SpacePointSolver 5.41416 13.1829 22.9201 12.1358 4.79655 10
reco:hitpdune:DisambigFromSpacePoints 0.792737 1.18977 1.99295 1.13388 0.35499 10
reco:pandora:StandardPandora 12.9867 23.6349 42.9005 22.6599 9.15054 10
reco:pandoraWriter:StandardPandora 0.207484 0.293255 0.481368 0.259304 0.0826996 10
reco:pandoraTrack:LArPandoraTrackCreation 1.41433 2.42131 4.35154 2.15891 0.845962 10
reco:pandoraShower:LArPandoraShowerCreation 1.70856 2.83987 4.68299 2.64329 1.06641 10
reco:pandoracalo:Calorimetry 0.899145 1.4822 2.50716 1.35183 0.462446 10
reco:pandoracalonosce:Calorimetry 0.815606 1.37466 2.3562 1.24707 0.44135 10
reco:pandorapid:Chi2ParticleID 0.00259772 0.00392307 0.00667696 0.00361346 0.00112167 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0276568 0.0367686 0.0604646 0.0327889 0.00945612 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00244086 0.00346887 0.0068647 0.00306938 0.00120887 10
reco:pandoraShowercalo:ShowerCalorimetry 1.96376 3.24044 5.12958 3.03631 1.15375 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.91488 3.2354 5.29166 2.99621 1.23447 10
reco:emtrkmichelid:EmTrackMichelId 95.4717 127.949 213.033 114.239 34.7674 10
reco:crttag:SingleCRTMatchingProducer 0.00850342 0.0123504 0.0193104 0.0121439 0.00302782 10
reco:crtreco:TwoCRTMatchingProducer 0.00387871 0.00583194 0.00881085 0.00542689 0.00129996 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.514242 0.688678 0.868019 0.705304 0.113769 10
reco:pandora2Track:LArPandoraTrackCreation 4.7606 8.7448 16.7305 7.69323 3.64172 10
reco:pandora2calo:Calorimetry 2.69114 4.68427 8.5966 4.21904 1.82639 10
reco:pandora2calonosce:Calorimetry 2.59632 4.4717 7.97846 4.05554 1.68946 10
reco:pandora2pid:Chi2ParticleID 0.00643223 0.00911896 0.0159075 0.0083413 0.00274401 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0341711 0.0460002 0.0822054 0.0402432 0.0141392 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00623221 0.0088736 0.015602 0.00805688 0.00259555 10
reco:pandora2Shower:LArPandoraShowerCreation 1.82052 3.13054 5.6762 2.8297 1.20834 10
reco:pandora2Showercalo:ShowerCalorimetry 2.405 4.04066 6.60374 3.75562 1.37864 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.2017 3.7178 5.93971 3.51645 1.24121 10
[art]:TriggerResults:TriggerResultInserter 3.163e-05 5.3189e-05 0.000179344 3.87795e-05 4.25844e-05 10
end_path:out1:RootOutput 7.244e-06 1.21393e-05 2.1231e-05 1.10105e-05 3.66141e-06 10
end_path:out1:RootOutput(write) 1.56108 2.11213 2.95908 1.88565 0.45592 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5078.6 MB
Peak resident set size usage (VmHWM): 4272.07 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.19 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.02 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10489148
-rw-r--r-- 1 dunegli fnalgrid 2445536458 Nov 21 12:30 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2316991573 Nov 21 12:28 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2160125389 Nov 21 13:11 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1903364837 Nov 21 10:56 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1832706678 Nov 21 10:44 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 81548960 Nov 21 13:06 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243042 Nov 21 13:11 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 21 13:11 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 21 13:11 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 21 13:11 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 21 12:30 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 21 10:56 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 21 13:11 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 21 10:40 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 21 13:11 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 21 12:32 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 21 12:30 debugprod.log
