Jobsub ID 242282.0@dunegpschedd01.fnal.gov
| Jobsub ID | 242282.0@dunegpschedd01.fnal.gov |
| Workflow ID | 9547 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-03 10:56:45 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-11-03 14:13:21 |
| From worker node | Hostname | dunegli-7469323-0-fnpc19113.fnal.gov |
| cpuinfo | AMD EPYC 7502 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-03 10:57:59 |
| Input files | monte-carlo-009547-000001
|
| Jobscript | Exit code | 0 |
| Real time | 3h (11709s) |
| CPU time | 3h (11163s = 95%) |
| Max RSS bytes | 4716253184 (4497 MiB) |
| Outputting started | 2025-11-03 14:13:08 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/09547/1/001/reco_stage1.root
|
| Finished | 2025-11-03 14:13:21 |
| Saved logs | justin-logs:242282.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 123880 traces, 0 summary
Retagger: tagging trace set: gauss with 95115 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 95115 traces tagged "gauss"
FrameSaver: q=3.31782e+06 n=1666561 tag=gauss
wclsFrameSaver: saving 123880 traces tagged "wiener"
FrameSaver: q=3.51578e+06 n=1482690 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 28703 XUs and 22415 XVs -> 305 XUVs
C:0 T:1 44576 XUs and 42927 XVs -> 8377 XUVs
C:0 T:2 75627 XUs and 115062 XVs -> 4236 XUVs
C:0 T:3 38529 XUs and 49780 XVs -> 235 XUVs
C:0 T:4 10584 XUs and 9603 XVs -> 277 XUVs
C:0 T:5 34331 XUs and 22721 XVs -> 2125 XUVs
C:0 T:6 93163 XUs and 124978 XVs -> 5698 XUVs
C:0 T:7 38209 XUs and 47360 XVs -> 359 XUVs
C:0 T:8 10098 XUs and 8847 XVs -> 553 XUVs
C:0 T:9 61171 XUs and 67943 XVs -> 10171 XUVs
C:0 T:10 30240 XUs and 21958 XVs -> 3161 XUVs
C:0 T:11 190 XUs and 172 XVs -> 22 XUVs
35519 XUVs total
10177 collection wire objects
32093 potential space points
Neighbour search...
3210489 tests to find 1620152 neighbours
Iterating with no regularization...
Begin: 6.06113e+07
0 5.21525e+07
1 5.14931e+07
2 5.13971e+07
3 5.13678e+07
Now with regularization...
Begin: 4.17893e+07
0 4.17502e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 410286403
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410286403
fLifetime: 30000 [us]
03-Nov-2025 14:13:06 UTC Closed output file "reco_stage1.root"
03-Nov-2025 14:13:06 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 281.514 359.777 433.142 353.235 60.1243 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000698057 0.00353892 0.00622049 0.00357888 0.00174225 10
reco:ophit:OpHitFinder 0.223051 0.290674 0.414862 0.283307 0.0472833 10
reco:opflash:OpFlashFinder 0.115638 0.201323 0.259849 0.205599 0.0401889 10
reco:opslicer:OpSlicer 0.514207 0.658231 0.79432 0.638519 0.0899954 10
reco:caldata:DataPrepModule 4.2518 4.40594 4.62247 4.39391 0.111955 10
reco:wclsdatasp:WireCellToolkit 27.3878 32.9153 35.6492 33.9592 2.52059 10
reco:gaushit:GausHitFinder 0.901851 1.12932 1.40513 1.16287 0.166288 10
reco:nhitsfilter:NumberOfHitsFilter 0.000463525 0.000627336 0.000888449 0.000662052 0.00012503 10
reco:reco3d:SpacePointSolver 9.89354 16.5114 28.6878 14.4984 5.44653 10
reco:hitpdune:DisambigFromSpacePoints 1.07504 1.65129 2.23149 1.67001 0.422034 10
reco:pandora:StandardPandora 22.8736 40.5204 55.7428 41.3143 12.0819 10
reco:pandoraWriter:StandardPandora 0.360559 0.457823 0.533146 0.462911 0.0657034 10
reco:pandoraTrack:LArPandoraTrackCreation 3.41203 5.31868 7.32666 5.34071 1.14751 10
reco:pandoraShower:LArPandoraShowerCreation 2.87422 5.31031 8.69326 4.93216 1.79076 10
reco:pandoracalo:Calorimetry 1.68289 2.52766 3.76705 2.53292 0.53675 10
reco:pandoracalonosce:Calorimetry 1.55889 2.28304 3.48354 2.19807 0.497769 10
reco:pandorapid:Chi2ParticleID 0.00528293 0.00643592 0.0100658 0.00616383 0.00126905 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0393102 0.0498664 0.0566456 0.0511082 0.0057798 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00510985 0.00587145 0.00662685 0.00595907 0.000474447 10
reco:pandoraShowercalo:ShowerCalorimetry 2.78243 4.81417 7.88356 4.31155 1.56941 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.76509 4.8232 7.69535 4.44677 1.64007 10
reco:emtrkmichelid:EmTrackMichelId 155.548 187.834 220.818 187.712 25.0925 10
reco:crttag:SingleCRTMatchingProducer 0.00824388 0.0129291 0.0172993 0.0128284 0.00268242 10
reco:crtreco:TwoCRTMatchingProducer 0.00579504 0.00899647 0.0128082 0.00919845 0.00201127 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.654978 0.820505 1.06111 0.763071 0.129347 10
reco:pandora2Track:LArPandoraTrackCreation 9.40152 15.3234 21.0584 14.8204 3.87309 10
reco:pandora2calo:Calorimetry 4.26339 6.43094 8.77926 6.29918 1.5398 10
reco:pandora2calonosce:Calorimetry 4.26592 6.14049 8.58121 5.87798 1.54456 10
reco:pandora2pid:Chi2ParticleID 0.0122598 0.0147923 0.0178728 0.0146163 0.00194791 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0539202 0.0633112 0.0739176 0.0631742 0.00804527 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.0122139 0.0145858 0.0174852 0.0142789 0.00180995 10
reco:pandora2Shower:LArPandoraShowerCreation 3.73958 5.29663 7.48276 5.11984 1.37413 10
reco:pandora2Showercalo:ShowerCalorimetry 3.91422 5.38405 7.135 5.32486 1.19564 10
reco:pandora2Showercalonosce:ShowerCalorimetry 3.6396 4.90475 6.57638 4.87281 1.10763 10
[art]:TriggerResults:TriggerResultInserter 3.877e-05 4.96867e-05 0.000114402 4.3036e-05 2.16393e-05 10
end_path:out1:RootOutput 7.061e-06 8.4222e-06 1.262e-05 7.98e-06 1.50641e-06 10
end_path:out1:RootOutput(write) 2.44904 3.51217 7.29152 3.3046 1.33087 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5529.92 MB
Peak resident set size usage (VmHWM): 4716.25 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.06 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.18 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.72 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.10 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 11714016
-rw-r--r-- 1 dunegli fnalgrid 2702698551 Nov 3 13:10 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2565970439 Nov 3 13:07 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2434513001 Nov 3 14:13 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2147802402 Nov 3 11:17 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2057391221 Nov 3 11:04 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 86156420 Nov 3 14:09 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242941 Nov 3 14:13 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 3 14:13 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 3 14:13 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 3 14:13 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 3 13:10 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 3 11:17 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 3 14:13 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 3 10:57 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 3 14:13 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 3 13:15 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 3 13:10 debugprod.log
