Jobsub ID 252067.1@dunegpschedd01.fnal.gov
| Jobsub ID | 252067.1@dunegpschedd01.fnal.gov |
| Workflow ID | 10222 |
| Stage ID | 1 |
| User name | pmelas@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 8388608000 (8000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2025-11-15 16:43:53 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2025-11-15 19:21:59 |
| From worker node | Hostname | dunegli-7767682-0-fnpc23031.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 10485760000 (10000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2025-11-15 16:46:03 |
| Input files | monte-carlo-010222-000001
|
| Jobscript | Exit code | 0 |
| Real time | 2h (9325s) |
| CPU time | 2h (9242s = 99%) |
| Max RSS bytes | 4812136448 (4589 MiB) |
| Outputting started | 2025-11-15 19:21:29 |
| Output files | https://fndcadoor.fnal.gov:2880/dune/scratch/users/pmelas/fnal/10222/1/001/reco_stage1.root
|
| Finished | 2025-11-15 19:21:59 |
| Saved logs | justin-logs:252067.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events (HTCondor job logs unavailable) |
Jobscript log (last 10,000 characters)
repare: Running tool pdsp_RemoveBadChannels
ToolBasedRawDigitPrepService:endEvent: End processing run 1 event 10 with 7 tools.
CookedFrameSource: got 15360 recob::Wire objects
input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 111363 traces, 0 summary
Retagger: tagging trace set: gauss with 81982 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 81982 traces tagged "gauss"
FrameSaver: q=3.01501e+06 n=1403914 tag=gauss
wclsFrameSaver: saving 111363 traces tagged "wiener"
FrameSaver: q=3.20594e+06 n=1232136 tag=wiener
72 X, 28 U, 34 V bad channels
Finding XUV coincidences...
C:0 T:0 27116 XUs and 19530 XVs -> 212 XUVs
C:0 T:1 40667 XUs and 27960 XVs -> 2011 XUVs
C:0 T:2 124646 XUs and 174869 XVs -> 6765 XUVs
C:0 T:3 54495 XUs and 65767 XVs -> 502 XUVs
C:0 T:4 3126 XUs and 3390 XVs -> 53 XUVs
C:0 T:5 11940 XUs and 21689 XVs -> 3709 XUVs
C:0 T:6 102637 XUs and 119395 XVs -> 6225 XUVs
C:0 T:7 39145 XUs and 44044 XVs -> 276 XUVs
C:0 T:8 4644 XUs and 6761 XVs -> 63 XUVs
C:0 T:9 28759 XUs and 51640 XVs -> 6267 XUVs
C:0 T:10 20523 XUs and 9921 XVs -> 2650 XUVs
C:0 T:11 147 XUs and 105 XVs -> 16 XUVs
28749 XUVs total
9373 collection wire objects
26590 potential space points
Neighbour search...
1871894 tests to find 994978 neighbours
Iterating with no regularization...
Begin: 7.71409e+07
0 6.37455e+07
1 6.2802e+07
2 6.26947e+07
3 6.26649e+07
Now with regularization...
Begin: 5.24249e+07
0 5.23927e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
run: 1 ; subrun: 0 ; event: 10
evttime: 410532720
fLifetime: 30000 [us]
run: 1 ; subrun: 0 ; event: 10
evttime: 410532720
fLifetime: 30000 [us]
15-Nov-2025 19:21:28 UTC Closed output file "reco_stage1.root"
15-Nov-2025 19:21:28 UTC Closed input file "detsim_stage2.root"
DataPrepModule::endJob: # events processed: 10
DataPrepModule::endJob: # events skipped: 0
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 127.071 352.46 1854.59 183.863 502.048 10
------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000770796 0.00285384 0.00505322 0.00284719 0.00127467 10
reco:ophit:OpHitFinder 0.170663 0.190515 0.219693 0.188661 0.0162958 10
reco:opflash:OpFlashFinder 0.0756304 0.114037 0.147249 0.111658 0.0219091 10
reco:opslicer:OpSlicer 0.323493 0.405016 0.537495 0.401458 0.0621174 10
reco:caldata:DataPrepModule 3.37133 3.4848 3.64784 3.46971 0.0802145 10
reco:wclsdatasp:WireCellToolkit 21.8165 23.2308 24.6412 23.1789 0.893409 10
reco:gaushit:GausHitFinder 0.454616 0.704492 1.10928 0.651516 0.187736 10
reco:nhitsfilter:NumberOfHitsFilter 0.000232686 0.00033263 0.000486922 0.000304262 7.37648e-05 10
reco:reco3d:SpacePointSolver 4.47795 20.8966 122.436 9.6376 34.0206 10
reco:hitpdune:DisambigFromSpacePoints 0.422819 0.96574 1.85588 0.82728 0.414122 10
reco:pandora:StandardPandora 7.50042 158.052 1449.95 13.396 430.662 10
reco:pandoraWriter:StandardPandora 0.162177 0.280798 0.751541 0.238928 0.162367 10
reco:pandoraTrack:LArPandoraTrackCreation 0.980847 2.35911 7.97985 1.86172 1.93371 10
reco:pandoraShower:LArPandoraShowerCreation 0.859708 2.20218 4.30256 2.04355 1.02633 10
reco:pandoracalo:Calorimetry 0.608735 1.33552 3.76484 1.15323 0.867317 10
reco:pandoracalonosce:Calorimetry 0.541936 1.23127 3.54827 1.06434 0.825156 10
reco:pandorapid:Chi2ParticleID 0.00260701 0.00358852 0.00714465 0.00315536 0.00123957 10
reco:pandoracalinoxyzt:CalibrationdEdXPDSP 0.0223966 0.03051 0.0392281 0.0301937 0.00531166 10
reco:pandoracalipidnoxyzt:Chi2ParticleID 0.00212619 0.00316345 0.00636216 0.00292531 0.00111875 10
reco:pandoraShowercalo:ShowerCalorimetry 0.934709 2.38134 4.3233 2.29474 1.03544 10
reco:pandoraShowercalonosce:ShowerCalorimetry 0.907857 2.31446 4.24341 2.20946 1.01813 10
reco:emtrkmichelid:EmTrackMichelId 71.2006 107.935 174.198 101.058 27.8318 10
reco:crttag:SingleCRTMatchingProducer 0.00594689 0.00752182 0.00853293 0.00796622 0.000936429 10
reco:crtreco:TwoCRTMatchingProducer 0.00367848 0.00467755 0.00630278 0.00458542 0.000887048 10
reco:anodepiercerst0:T0RecoAnodePiercers 0.427361 0.565664 0.662347 0.552442 0.0763815 10
reco:pandora2Track:LArPandoraTrackCreation 2.58414 6.55855 14.4404 5.89492 3.33141 10
reco:pandora2calo:Calorimetry 1.42753 3.5137 7.21599 3.26805 1.68413 10
reco:pandora2calonosce:Calorimetry 1.33131 3.34686 6.78517 3.1218 1.59199 10
reco:pandora2pid:Chi2ParticleID 0.0050673 0.00779407 0.0128923 0.00729505 0.00213211 10
reco:pandora2calinoxyzt:CalibrationdEdXPDSP 0.0271719 0.0381938 0.0586583 0.0354401 0.00894078 10
reco:pandora2calipidnoxyzt:Chi2ParticleID 0.00498879 0.00755804 0.0123059 0.0070473 0.00200919 10
reco:pandora2Shower:LArPandoraShowerCreation 1.00502 2.45784 5.19706 2.24422 1.16803 10
reco:pandora2Showercalo:ShowerCalorimetry 1.2232 3.06943 5.91694 2.88682 1.39722 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.14721 2.85358 5.31873 2.72359 1.25549 10
[art]:TriggerResults:TriggerResultInserter 3.2042e-05 4.62636e-05 0.000129589 3.80625e-05 2.79085e-05 10
end_path:out1:RootOutput 9.829e-06 1.17587e-05 1.9447e-05 1.11165e-05 2.63737e-06 10
end_path:out1:RootOutput(write) 1.15427 1.83699 2.80174 1.73709 0.462016 10
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5509.73 MB
Peak resident set size usage (VmHWM): 4699.44 MB
Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 10
ToolBasedRawDigitPrepService:dtor: Call count: 60
ToolBasedRawDigitPrepService:dtor: Time report for 7 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.04 sec/event
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.15 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 2.19 sec/event
ToolBasedRawDigitPrepService:dtor: adcKeepAllSignalFinder: 0.08 sec/event
ToolBasedRawDigitPrepService:dtor: adcScaleKeToAdc: 0.03 sec/event
ToolBasedRawDigitPrepService:dtor: pdsp_RemoveBadChannels: 0.00 sec/event
Art has completed and will exit with status 0.
lar exit code 0
.:
total 10307840
-rw-r--r-- 1 dunegli fnalgrid 2436175852 Nov 15 18:21 detsim_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 2326447653 Nov 15 18:20 detsim_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 2111004574 Nov 15 19:21 reco_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 1819711109 Nov 15 16:56 g4_stage2.root
-rw-r--r-- 1 dunegli fnalgrid 1788457000 Nov 15 16:49 g4_stage1.root
-rw-r--r-- 1 dunegli fnalgrid 72811550 Nov 15 19:19 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 243524 Nov 15 19:21 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 217088 Nov 15 19:21 mem.db
-rw-r--r-- 1 dunegli fnalgrid 62376 Nov 15 19:21 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 36864 Nov 15 19:21 time.db
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 15 18:21 detsim_single_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 15 16:56 g4_protoDUNE_hist.root
-rw-r--r-- 1 dunegli fnalgrid 519 Nov 15 19:21 protoDUNE_reco1_hist.root
-rw-r--r-- 1 dunegli fnalgrid 52 Nov 15 16:46 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 7 Nov 15 19:21 justin-processed-pfns.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 15 18:23 ProtoDUNE.log
-rw-r--r-- 1 dunegli fnalgrid 0 Nov 15 18:21 debugprod.log
