justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 262116.0@dunegpschedd02.fnal.gov

Jobsub ID262116.0@dunegpschedd02.fnal.gov
Workflow ID11176
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-13 09:30:28
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-13 18:46:52
From worker nodeHostnamedunegli-8047072-0-fnpc9021.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-13 09:31:45
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T213253Z_gen_004174_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time9h (33293s)
CPU time9h (33034s = 99%)
Max RSS bytes2801229824 (2671 MiB)
Outputting started2025-12-13 18:46:38
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11176/1/001/analysisLowE_20251213T093146Z.root
Finished2025-12-13 18:46:52
Saved logsjustin-logs:262116.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 18:45:30 UTC run: 5026 subRun: 0 event: 41740
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 18:45:30 UTC run: 5026 subRun: 0 event: 41740
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6795, 6701, 6706
minwire 0: 17
minwire 1: 1
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.104699, 
Output 1: 0.0660869, 0.0598077, 0.132859, 0.741246, 
Output 2: 0.0348477, 0.154296, 0.798462, 0.0123942, 
Output 3: 0.958808, 0.0331151, 0.0034087, 0.00466811, 
Output 4: 0.33235, 0.525343, 0.124335, 0.0179715, 
Output 5: 0.38423, 0.485925, 0.111954, 0.0178918, 
Output 6: 0.0319697, 0.101061, 0.103889, 0.763081, 

13-Dec-2025 18:45:33 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 18:45:33 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/63/10/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T213253Z_gen_004174_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2318.01       3294.03       3773.47       3366.92       447.241        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00141459    0.00387404     0.0183323    0.00190611    0.00493434       10     
reco:pandora:StandardPandora                            2315.71       3290.5        3769.93       3361.25       446.81         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000798412     0.11565      0.177754      0.122974      0.0473139       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00166998     0.0112443     0.0501868    0.00839111     0.0135027       10     
reco:pandoracalo:Calorimetry                          0.000296557   0.00210415     0.0135793    0.000863028   0.00383903       10     
reco:pandorapid:Chi2ParticleID                        0.00011612    0.000698709   0.00520187    0.000197862   0.00150251       10     
reco:cvnmap:CVNMapper                                  0.0904868     0.140439      0.184066      0.137781      0.0280063       10     
reco:cvneva:CVNEvaluator                                1.66178       2.60728       7.22375       2.03536       1.57119        10     
reco:energyrecnumu:EnergyReco                          0.0871252     0.120018      0.175038      0.106119      0.0273583       10     
reco:energyrecnue:EnergyReco                          0.00173727     0.0034356    0.00537732    0.00347971    0.00106587       10     
reco:energyrecnc:EnergyReco                           0.00888846     0.0130112     0.0201319     0.0118259     0.0033439       10     
[art]:TriggerResults:TriggerResultInserter            2.0845e-05    5.42383e-05   0.00020402     4.144e-05    5.0978e-05       10     
end_path:out1:RootOutput                               8.48e-06     2.15869e-05   8.7231e-05    1.5696e-05    2.20646e-05      10     
end_path:out1:RootOutput(write)                        0.372003      0.502855      0.684979      0.476016      0.0995785       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11908.5 MB
  Peak resident set size usage (VmHWM): 2801.23 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 92.3142 | hit correction : 1.46257
hit initial : 51.3869 | hit correction : 1.40621
hit initial : 44.3963 | hit correction : 1.40407
hit initial : 448.126 | hit correction : 1.40612
hit initial : 231.05 | hit correction : 1.40608
hit initial : 41.0953 | hit correction : 1.38395
hit initial : 163.222 | hit correction : 1.38379
hit initial : 346.412 | hit correction : 1.38301
hit initial : 449.021 | hit correction : 1.38212
hit initial : 171.865 | hit correction : 1.38037
hit initial : 39.9565 | hit correction : 1.379
hit initial : 181.358 | hit correction : 1.37952
hit initial : 830.758 | hit correction : 1.37948
hit initial : 25.9454 | hit correction : 1.37964
hit initial : 78.1785 | hit correction : 1.37838
 *** Total Charge : 6071.12
 Looking at view: 2 | Number of hits in view: 20
Begin processing the 9th record. run: 5026 subRun: 0 event: 41739 at 13-Dec-2025 18:46:29 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
This pfp has size:  21
Added hit list length: 21 | Max was set to: -3.40282e+38
True Neutron Energy: 939.702
True Electron Energy: 16.441
Completed MCParticle Loop
True Neutrino Energy: 25.4065
 Size of all hits: 21
hit initial : 66.996 | hit correction : 1.20103
hit initial : 220.782 | hit correction : 1.20105
hit initial : 260.055 | hit correction : 1.20109
hit initial : 246.815 | hit correction : 1.20089
hit initial : 258.043 | hit correction : 1.20102
hit initial : 262.513 | hit correction : 1.20083
hit initial : 291.408 | hit correction : 1.20098
hit initial : 144.257 | hit correction : 1.20127
 *** Total Charge : 2102.8
 Looking at view: 0 | Number of hits in view: 8
hit initial : 158.083 | hit correction : 1.20106
hit initial : 466.742 | hit correction : 1.20103
hit initial : 407.949 | hit correction : 1.20095
hit initial : 275.603 | hit correction : 1.20104
hit initial : 319.609 | hit correction : 1.20085
hit initial : 86.4452 | hit correction : 1.20127
 *** Total Charge : 2059.02
 Looking at view: 1 | Number of hits in view: 6
hit initial : 25.6037 | hit correction : 1.18622
hit initial : 161.75 | hit correction : 1.20112
hit initial : 296.478 | hit correction : 1.20106
hit initial : 231.605 | hit correction : 1.20101
hit initial : 293.723 | hit correction : 1.20105
hit initial : 706.238 | hit correction : 1.20088
hit initial : 36.9748 | hit correction : 1.20101
 *** Total Charge : 2104.19
 Looking at view: 2 | Number of hits in view: 7
Begin processing the 10th record. run: 5026 subRun: 0 event: 41740 at 13-Dec-2025 18:46:34 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  5
This pfp has size:  10
Added hit list length: 10 | Max was set to: -3.40282e+38
This pfp has size:  6
This pfp has size:  3
True Neutron Energy: 939.573
True Electron Energy: 1.7679
Completed MCParticle Loop
True Neutrino Energy: 5.49233
 Size of all hits: 10
hit initial : 56.0256 | hit correction : 1.42534
hit initial : 125.225 | hit correction : 1.42538
hit initial : 48.146 | hit correction : 1.4254
 *** Total Charge : 326.976
 Looking at view: 0 | Number of hits in view: 3
hit initial : 40.9256 | hit correction : 1.4254
hit initial : 82.2916 | hit correction : 1.42541
hit initial : 86.1512 | hit correction : 1.42538
 *** Total Charge : 298.432
 Looking at view: 1 | Number of hits in view: 3
hit initial : 19.5198 | hit correction : 1.42464
hit initial : 20.1155 | hit correction : 1.42543
hit initial : 77.8355 | hit correction : 1.42545
hit initial : 27.4364 | hit correction : 1.42544
 *** Total Charge : 206.541
 Looking at view: 2 | Number of hits in view: 4
13-Dec-2025 18:46:38 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0789882     0.117792      0.188553       0.10613      0.0288919       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000504552   0.00337933     0.0199127    0.00068521     0.0059881       10     
end_path:ana:AnalyzeEvents         0.0780864     0.114157      0.168006      0.105187      0.023672        10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9807.41 MB
  Peak resident set size usage (VmHWM): 1533.99 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 12:22:29 UTC       justIN version: 01.06.00