Jobsub ID 270215.1@dunegpschedd01.fnal.gov
| Jobsub ID | 270215.1@dunegpschedd01.fnal.gov |
| Workflow ID | 11337 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-12-26 09:03:18 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2025-12-26 11:24:02 |
| From worker node | Hostname | dunegli-8004228-0-fnpc22010.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-12-26 09:14:52 |
| Input files | monte-carlo-011337-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7732s) |
| CPU time | 2h (7631s = 98%) |
| Max RSS bytes | 4425256960 (4220 MiB) |
| Outputting started | 2025-12-26 11:23:44 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/11337/1/001/reco_stage1.root
|
| Finished | 2025-12-26 11:24:02 |
| Saved logs | justin-logs:270215.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 170456 traces, 0 summary
Retagger: tagging trace set: gauss with 134234 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 134234 traces tagged "gauss"
FrameSaver: q=4.73453e+06 n=2461841 tag=gauss
wclsFrameSaver: saving 170456 traces tagged "wiener"
FrameSaver: q=4.99999e+06 n=2210565 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 24062 XUs and 20925 XVs -> 517 XUVs
C:0 T:1 115994 XUs and 66822 XVs -> 18816 XUVs
C:0 T:2 147506 XUs and 123653 XVs -> 13575 XUVs
C:0 T:3 49113 XUs and 48012 XVs -> 608 XUVs
C:0 T:4 16978 XUs and 20440 XVs -> 160 XUVs
C:0 T:5 103112 XUs and 84321 XVs -> 8560 XUVs
C:0 T:6 131478 XUs and 161386 XVs -> 8774 XUVs
C:0 T:7 47456 XUs and 55749 XVs -> 492 XUVs
C:0 T:8 14050 XUs and 14106 XVs -> 169 XUVs
C:0 T:9 100488 XUs and 126255 XVs -> 8609 XUVs
C:0 T:10 65637 XUs and 53878 XVs -> 5396 XUVs
C:0 T:11 425 XUs and 326 XVs -> 31 XUVs
65707 XUVs total
15398 collection wire objects
59146 potential space points
Neighbour search...
11013764 tests to find 4714250 neighbours
Iterating with no regularization...
Begin: 8.37913e+07
0 7.11867e+07
1 7.02757e+07
2 7.01485e+07
3 7.01112e+07
Now with regularization...
Begin: 5.78717e+07
0 5.78407e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 411351098
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 411351098
fLifetime: 30000 [us]
26-Dec-2025 11:23:43 UTC Closed output file "reco_stage1.root"
26-Dec-2025 11:23:43 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 163.04 227.113 307.592 222.846 41.2168 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000781928 0.00294244 0.00448013 0.00339004 0.00129003 10
reco:ophit:OpHitFinder 0.205259 0.229422 0.253073 0.227958 0.0150037 10
reco:opflash:OpFlashFinder 0.138676 0.161542 0.195614 0.16034 0.0175222 10
reco:opslicer:OpSlicer 0.354157 0.472365 0.642992 0.462663 0.0762807 10
reco:caldata:DataPrepModule 3.44636 3.57099 3.73257 3.56743 0.0897212 10
reco:wclsdatasp:WireCellToolkit 22.5008 23.8624 25.0011 23.7374 0.72954 10
reco:gaushit:GausHitFinder 0.596064 0.812065 1.07771 0.786872 0.143574 10
reco:nhitsfilter:NumberOfHitsFilter 0.000334282 0.000407305 0.000555661 0.000374528 7.91893e-05 10
reco:reco3d:SpacePointSolver 5.65393 9.38959 14.3277 8.35161 2.84765 10
reco:hitpdune:DisambigFromSpacePoints 0.693473 1.16901 1.87537 1.1035 0.347933 10
reco:pandora:StandardPandora 12.9988 23.8503 38.3201 22.1932 8.33253 10
reco:pandoraWriter:StandardPandora 0.217245 0.29197 0.391235 0.282844 0.0562218 10
reco:pandoraTrack:LArPandoraTrackCreation 1.68761 2.43863 3.41531 2.41829 0.501307 10
reco:pandoraShower:LArPandoraShowerCreation 1.41119 2.7952 4.81486 2.66016 0.999581 10
reco:pandoracalo:Calorimetry 0.923264 1.46937 1.89775 1.48526 0.283252 10
reco:pandoracalonosce:Calorimetry 0.844558 1.3735 1.77626 1.3847 0.278681 10
reco:pandorapid:Chi2ParticleID 0.00301043 0.00378636 0.00497374 0.00372131 0.000495597 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0279462 0.0347492 0.0419011 0.034713 0.00449026 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00291233 0.00352811 0.00405044 0.00359294 0.000398102 10
reco:pandoraShowercalo:ShowerCalorimetry 1.49395 3.18796 5.42045 3.05482 1.08888 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.51032 3.1035 5.42851 2.98916 1.06098 10
reco:emtrkmichelid:EmTrackMichelId 90.1665 119.401 154.288 117.881 18.4438 10
reco:crttag:SingleCRTMatchingProducer 0.00628006 0.00886251 0.0119462 0.00886603 0.00148062 10
reco:crtreco:TwoCRTMatchingProducer 0.00419833 0.00545654 0.00660632 0.00554388 0.000700789 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.443682 0.614404 0.792522 0.595731 0.107026 10
reco:pandora2Track:LArPandoraTrackCreation 4.39073 8.03587 12.909 7.75314 2.35768 10
reco:pandora2calo:Calorimetry 2.22234 4.37524 6.80895 4.28832 1.22316 10
reco:pandora2calonosce:Calorimetry 2.09161 4.16305 6.43833 4.11747 1.15691 10
reco:pandora2pid:Chi2ParticleID 0.00691989 0.0086841 0.0110747 0.0085412 0.00125051 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0328817 0.0429347 0.0548214 0.0419012 0.00635135 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00686488 0.00850821 0.0107637 0.00837446 0.00121189 10
reco:pandora2Shower:LArPandoraShowerCreation 1.60771 2.8778 4.42615 2.82103 0.776979 10
reco:pandora2Showercalo:ShowerCalorimetry 1.92707 3.78216 5.77721 3.75621 1.02534 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.76109 3.466 5.39787 3.39821 0.973985 10
[art]:TriggerResults:TriggerResultInserter 3.2681e-05 4.78505e-05 0.000159021 3.57525e-05 3.71451e-05 10
end_path:out1:RootOutput 8.596e-06 1.24565e-05 1.9607e-05 1.18975e-05 2.76057e-06 10
end_path:out1:RootOutput(write) 1.49634 2.02722 2.75386 1.97547 0.355747 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5236.24 MB
Peak resident set size usage (VmHWM): 4425.26 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.23 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10809044
-rw-r--r-- 1 dunegli fnalgrid 2517118168 Dec 26 10:44 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2389428874 Dec 26 10:43 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2226347786 Dec 26 11:23 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1960644751 Dec 26 09:26 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1893843288 Dec 26 09:18 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 80393740 Dec 26 11:20 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 242975 Dec 26 11:23 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Dec 26 11:23 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Dec 26 11:23 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Dec 26 11:23 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 26 10:44 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 26 09:26 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Dec 26 11:23 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Dec 26 09:14 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Dec 26 11:23 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 26 10:47 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Dec 26 10:44 debugprod.log
