justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267789.0@dunegpschedd01.fnal.gov

Jobsub ID267789.0@dunegpschedd01.fnal.gov
Workflow ID11169
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-13 05:48:16
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-13 15:31:43
From worker nodeHostnamedunegli-7890557-0-fnpc19102.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-13 05:48:57
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T180355Z_gen_001353_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time9h (34929s)
CPU time9h (34248s = 98%)
Max RSS bytes2794541056 (2665 MiB)
Outputting started2025-12-13 15:31:06
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11169/1/001/analysisLowE_20251213T054858Z.root
Finished2025-12-13 15:31:43
Saved logsjustin-logs:267789.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

cedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 15:30:08 UTC run: 5026 subRun: 0 event: 13530
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 15:30:08 UTC run: 5026 subRun: 0 event: 13530
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6906, 6951, 6761
minwire 0: 32
minwire 1: 1
minwire 2: 5
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.106585, 
Output 1: 0.0714074, 0.0703871, 0.0801855, 0.77802, 
Output 2: 0.0389551, 0.211353, 0.729973, 0.0197182, 
Output 3: 0.978961, 0.0113985, 0.00160219, 0.00803854, 
Output 4: 0.4539, 0.482816, 0.0573102, 0.00597447, 
Output 5: 0.422483, 0.422686, 0.126334, 0.0284965, 
Output 6: 0.0241924, 0.0610262, 0.0774575, 0.837324, 

13-Dec-2025 15:30:11 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 15:30:11 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/d4/6b/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T180355Z_gen_001353_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2734.99       3464.99       4294.88       3514.53       467.707        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000857028   0.00473105     0.0217809     0.0017748    0.00657136       10     
reco:pandora:StandardPandora                            2732.99       3442.62       4219.49       3512.76       444.155        10     
reco:pandoraTrack:LArPandoraTrackCreation              0.0431239     0.0860672     0.176795      0.0739542     0.0404335       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00148849    0.00641544     0.0372914    0.00275534     0.0103885       10     
reco:pandoracalo:Calorimetry                          0.000388903   0.00288662     0.0218612    0.000686841   0.00633673       10     
reco:pandorapid:Chi2ParticleID                        0.000114521   0.000407253   0.00237781    0.000167076   0.000661062      10     
reco:cvnmap:CVNMapper                                  0.0641867     0.117717      0.322378      0.0936512     0.073659        10     
reco:cvneva:CVNEvaluator                               0.867812       1.73677       6.76746       1.21211       1.70214        10     
reco:energyrecnumu:EnergyReco                          0.0737674      19.973        67.326       0.149765       30.318         10     
reco:energyrecnue:EnergyReco                          0.00129322    0.00287799    0.00584878    0.00227241    0.00145922       10     
reco:energyrecnc:EnergyReco                           0.00683495     0.0121503     0.0247998     0.0113694    0.00478238       10     
[art]:TriggerResults:TriggerResultInserter             1.791e-05    4.25044e-05   0.000111381   2.65155e-05   3.1146e-05       10     
end_path:out1:RootOutput                               7.56e-06     1.6268e-05     3.582e-05      1.3e-05     8.82991e-06      10     
end_path:out1:RootOutput(write)                        0.272236      0.420044      0.697047      0.406457      0.118477        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21576.8 MB
  Peak resident set size usage (VmHWM): 2794.54 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 203.953 | hit correction : 1.43152
hit initial : 55.1406 | hit correction : 1.43145
hit initial : 152.229 | hit correction : 1.42375
hit initial : 460.896 | hit correction : 1.42388
hit initial : 127.981 | hit correction : 1.42257
hit initial : 321.836 | hit correction : 1.42262
hit initial : 232.728 | hit correction : 1.42263
hit initial : 320.414 | hit correction : 1.42247
hit initial : 545.102 | hit correction : 1.42242
hit initial : 333.146 | hit correction : 1.42216
hit initial : 431.004 | hit correction : 1.42174
hit initial : 495.173 | hit correction : 1.42154
hit initial : 278.643 | hit correction : 1.42138
 *** Total Charge : 7137.8
 Looking at view: 2 | Number of hits in view: 20
Begin processing the 10th record. run: 5026 subRun: 0 event: 13530 at 13-Dec-2025 15:31:01 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  6
This pfp has size:  49
Added hit list length: 49 | Max was set to: -3.40282e+38
This pfp has size:  10
This pfp has size:  7
True Neutron Energy: 939.573
True Electron Energy: 31.0022
Completed MCParticle Loop
True Neutrino Energy: 50.4815
 Size of all hits: 49
hit initial : 30.3291 | hit correction : 1.31045
hit initial : 182.339 | hit correction : 1.30426
hit initial : 104.936 | hit correction : 1.30427
hit initial : 53.7606 | hit correction : 1.30427
hit initial : 133.866 | hit correction : 1.30356
hit initial : 309.123 | hit correction : 1.30355
hit initial : 196.064 | hit correction : 1.30351
hit initial : 31.3841 | hit correction : 1.30346
hit initial : 91.8401 | hit correction : 1.30098
hit initial : 770.78 | hit correction : 1.30046
hit initial : 278.703 | hit correction : 1.30026
hit initial : 148.677 | hit correction : 1.30108
hit initial : 67.0023 | hit correction : 1.30113
hit initial : 532.758 | hit correction : 1.30087
 *** Total Charge : 3816.39
 Looking at view: 0 | Number of hits in view: 14
hit initial : 23.1436 | hit correction : 1.31039
hit initial : 97.8256 | hit correction : 1.30427
hit initial : 215.314 | hit correction : 1.30417
hit initial : 229.161 | hit correction : 1.30376
hit initial : 226.289 | hit correction : 1.30353
hit initial : 167.666 | hit correction : 1.30346
hit initial : 48.7911 | hit correction : 1.30341
hit initial : 19.8556 | hit correction : 1.30056
hit initial : 167.294 | hit correction : 1.3006
hit initial : 277.073 | hit correction : 1.30099
hit initial : 113.776 | hit correction : 1.30036
hit initial : 435.313 | hit correction : 1.30103
hit initial : 299.95 | hit correction : 1.30086
hit initial : 209.508 | hit correction : 1.30034
hit initial : 210.64 | hit correction : 1.3
hit initial : 195.994 | hit correction : 1.29963
 *** Total Charge : 3823.97
 Looking at view: 1 | Number of hits in view: 16
hit initial : 24.6215 | hit correction : 1.31037
hit initial : 31.7889 | hit correction : 1.31038
hit initial : 64.8106 | hit correction : 1.30431
hit initial : 167.477 | hit correction : 1.3043
hit initial : 215.529 | hit correction : 1.30396
hit initial : 134.19 | hit correction : 1.3036
hit initial : 100.61 | hit correction : 1.30353
hit initial : 113.053 | hit correction : 1.30353
hit initial : 129.458 | hit correction : 1.30343
hit initial : 52.3593 | hit correction : 1.30332
hit initial : 185.292 | hit correction : 1.30084
hit initial : 29.2349 | hit correction : 1.3004
hit initial : 261.414 | hit correction : 1.30043
hit initial : 291.009 | hit correction : 1.3011
hit initial : 271.175 | hit correction : 1.30107
hit initial : 235.354 | hit correction : 1.30084
hit initial : 217.171 | hit correction : 1.30039
hit initial : 221.801 | hit correction : 1.30004
hit initial : 205.731 | hit correction : 1.29965
 *** Total Charge : 3843.1
 Looking at view: 2 | Number of hits in view: 19
13-Dec-2025 15:31:05 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0871303     0.110206      0.129658      0.116206      0.0151476       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000426894   0.000820888   0.00175642    0.000583285   0.000453535      10     
end_path:ana:AnalyzeEvents         0.0865251     0.109165      0.128425      0.115471      0.0148625       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19475.5 MB
  Peak resident set size usage (VmHWM): 1534.13 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 12:07:44 UTC       justIN version: 01.06.00