justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 262084.0@dunegpschedd02.fnal.gov

Jobsub ID262084.0@dunegpschedd02.fnal.gov
Workflow ID11172
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-13 08:42:25
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-13 18:25:28
From worker nodeHostnamedunegli-8047006-0-fnpc19108.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-13 08:44:24
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T030122Z_gen_004601_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time9h (34848s)
CPU time9h (34090s = 97%)
Max RSS bytes2827841536 (2696 MiB)
Outputting started2025-12-13 18:25:14
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11172/1/001/analysisLowE_20251213T084426Z.root
Finished2025-12-13 18:25:28
Saved logsjustin-logs:262084.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

rying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 18:24:05 UTC run: 5027 subRun: 0 event: 46010
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 18:24:05 UTC run: 5027 subRun: 0 event: 46010
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6586, 6575, 6580
minwire 0: 13
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.122614, 
Output 1: 0.0652069, 0.0925033, 0.167796, 0.674494, 
Output 2: 0.0745225, 0.176699, 0.719539, 0.0292395, 
Output 3: 0.971201, 0.0168079, 0.00264059, 0.00935075, 
Output 4: 0.438723, 0.520349, 0.0370012, 0.00392666, 
Output 5: 0.356202, 0.519886, 0.102285, 0.021628, 
Output 6: 0.0292294, 0.0731741, 0.0780653, 0.819531, 

13-Dec-2025 18:24:08 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 18:24:08 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/88/02/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T030122Z_gen_004601_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1820.94       3456.01       4625.05       3798.91       1076.96        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000843197   0.00335156     0.0128509     0.001197     0.00398496       10     
reco:pandora:StandardPandora                            1818.9        3420.26       4550.91       3762.39       1047.8         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000426913    0.0618702     0.130467      0.0646349     0.0405378       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000581344    0.0052791     0.0285538    0.00216398     0.0079436       10     
reco:pandoracalo:Calorimetry                          0.000228022   0.00127325    0.00729787    0.000547259   0.00203883       10     
reco:pandorapid:Chi2ParticleID                         7.836e-05    0.000446759   0.00313161    0.000151776   0.000895782      10     
reco:cvnmap:CVNMapper                                  0.051268      0.0801221      0.12423      0.0714927     0.0259175       10     
reco:cvneva:CVNEvaluator                                1.19011       1.69454       3.67066       1.37689      0.706126        10     
reco:energyrecnumu:EnergyReco                          0.097675       33.4046       74.2437       30.1932       33.5524        10     
reco:energyrecnue:EnergyReco                          0.00148484    0.00671896     0.0182472    0.00325281    0.00633438       10     
reco:energyrecnc:EnergyReco                           0.00766888     0.0127132     0.0228393     0.0121972    0.00405802       10     
[art]:TriggerResults:TriggerResultInserter             1.538e-05    3.92084e-05   0.000203732    2.147e-05    5.49927e-05      10     
end_path:out1:RootOutput                               8.09e-06     1.57892e-05    5.634e-05    1.13005e-05   1.3733e-05       10     
end_path:out1:RootOutput(write)                        0.345511      0.475025      0.595436      0.481196      0.0604039       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21565.8 MB
  Peak resident set size usage (VmHWM): 2827.84 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 265.988 | hit correction : 1.10871
hit initial : 339.554 | hit correction : 1.10907
hit initial : 19.5755 | hit correction : 1.10837
hit initial : 164.241 | hit correction : 1.10856
hit initial : 358.005 | hit correction : 1.10924
hit initial : 234.715 | hit correction : 1.10928
hit initial : 112.251 | hit correction : 1.10888
hit initial : 179.713 | hit correction : 1.10922
hit initial : 33.3069 | hit correction : 1.10987
hit initial : 14.1565 | hit correction : 1.10989
 *** Total Charge : 2968.65
 Looking at view: 1 | Number of hits in view: 18
hit initial : 27.5401 | hit correction : 1.09847
hit initial : 52.2885 | hit correction : 1.09848
hit initial : 145.723 | hit correction : 1.10804
hit initial : 269.136 | hit correction : 1.10809
hit initial : 211.481 | hit correction : 1.10826
hit initial : 176.281 | hit correction : 1.10845
hit initial : 132.601 | hit correction : 1.10857
hit initial : 134.785 | hit correction : 1.10865
hit initial : 166.108 | hit correction : 1.10902
hit initial : 148.769 | hit correction : 1.10883
hit initial : 251.943 | hit correction : 1.10849
hit initial : 350.679 | hit correction : 1.10924
hit initial : 158.734 | hit correction : 1.1093
hit initial : 212.12 | hit correction : 1.10928
hit initial : 229.642 | hit correction : 1.10915
hit initial : 65.0543 | hit correction : 1.10902
hit initial : 20.3378 | hit correction : 1.10986
hit initial : 39.4774 | hit correction : 1.10989
 *** Total Charge : 3095.65
 Looking at view: 2 | Number of hits in view: 18
Begin processing the 9th record. run: 5027 subRun: 0 event: 46009 at 13-Dec-2025 18:25:03 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  5
This pfp has size:  13
Added hit list length: 13 | Max was set to: -3.40282e+38
True Electron Energy: 3.77248
Completed MCParticle Loop
True Neutrino Energy: 7.05717
 Size of all hits: 13
hit initial : 80.5825 | hit correction : 1.37129
hit initial : 92.5771 | hit correction : 1.37195
hit initial : 101.21 | hit correction : 1.37131
hit initial : 85.9124 | hit correction : 1.37197
 *** Total Charge : 494.173
 Looking at view: 0 | Number of hits in view: 4
hit initial : 48.7667 | hit correction : 1.37128
hit initial : 111.531 | hit correction : 1.37129
hit initial : 103.769 | hit correction : 1.37197
hit initial : 82.0271 | hit correction : 1.37131
hit initial : 74.3882 | hit correction : 1.37195
 *** Total Charge : 576.723
 Looking at view: 1 | Number of hits in view: 5
hit initial : 66.901 | hit correction : 1.37128
hit initial : 86.959 | hit correction : 1.37198
hit initial : 138.468 | hit correction : 1.3713
hit initial : 126.146 | hit correction : 1.37192
 *** Total Charge : 573.989
 Looking at view: 2 | Number of hits in view: 4
Begin processing the 10th record. run: 5027 subRun: 0 event: 46010 at 13-Dec-2025 18:25:08 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  5
This pfp has size:  4
Added hit list length: 4 | Max was set to: -3.40282e+38
This pfp has size:  4
This pfp has size:  3
True Neutron Energy: 939.569
True Electron Energy: 3.57032
Completed MCParticle Loop
True Neutrino Energy: 7.29473
 Size of all hits: 4
hit initial : 224.353 | hit correction : 1.00837
 *** Total Charge : 226.23
 Looking at view: 0 | Number of hits in view: 1
hit initial : 195.678 | hit correction : 1.00838
hit initial : 163.754 | hit correction : 1.00837
 *** Total Charge : 362.442
 Looking at view: 1 | Number of hits in view: 2
hit initial : 424.816 | hit correction : 1.00838
 *** Total Charge : 428.376
 Looking at view: 2 | Number of hits in view: 1
13-Dec-2025 18:25:12 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.113866      0.137006      0.153804      0.139987      0.014002        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000454984   0.000682222   0.00181923    0.000552029   0.000384881      10     
end_path:ana:AnalyzeEvents         0.113126      0.136085      0.151274      0.139225      0.0137859       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19469 MB
  Peak resident set size usage (VmHWM): 1526.8 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 12:05:51 UTC       justIN version: 01.06.00