justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267774.3@dunegpschedd01.fnal.gov

Jobsub ID267774.3@dunegpschedd01.fnal.gov
Workflow ID11171
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-13 05:32:16
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-13 17:00:58
From worker nodeHostnamedunegli-8047006-0-fnpc19108.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-13 05:33:28
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T023413Z_gen_004071_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time11h (41234s)
CPU time11h (40064s = 97%)
Max RSS bytes2840289280 (2708 MiB)
Outputting started2025-12-13 17:00:43
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11171/1/001/analysisLowE_20251213T053329Z.root
Finished2025-12-13 17:00:58
Saved logsjustin-logs:267774.3-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

n: 5027 subRun: 0 event: 40710
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 16:59:25 UTC run: 5027 subRun: 0 event: 40710
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6403, 6351, 6473
minwire 0: 74
minwire 1: 1
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2259, 2758
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0503012, 
Output 1: 0.0328498, 0.0608977, 0.0634852, 0.842767, 
Output 2: 0.0653285, 0.226021, 0.676767, 0.0318845, 
Output 3: 0.961531, 0.0277471, 0.00371915, 0.00700242, 
Output 4: 0.89403, 0.0842962, 0.0163166, 0.00535721, 
Output 5: 0.846342, 0.125355, 0.021474, 0.00682977, 
Output 6: 0.00832893, 0.0290421, 0.0414981, 0.921131, 

13-Dec-2025 16:59:29 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 16:59:29 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/8e/77/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T023413Z_gen_004071_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3319.19       4095.6        4505.75       4175.33       333.658        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00130316    0.00741476     0.0379376     0.003223      0.0104301       10     
reco:pandora:StandardPandora                            3316.88       4031.31       4429.44       4107.46       319.474        10     
reco:pandoraTrack:LArPandoraTrackCreation              0.0495113     0.104805      0.215452      0.0852324     0.0478804       10     
reco:pandoraShower:LArPandoraModularShowerCreation     0.0025731     0.0151414     0.0987251    0.00575202     0.0279798       10     
reco:pandoracalo:Calorimetry                          0.000497484   0.00378113     0.0285489    0.000988019   0.00826962       10     
reco:pandorapid:Chi2ParticleID                        0.000113851   0.000884674   0.00697663    0.000240242   0.00203183       10     
reco:cvnmap:CVNMapper                                  0.0653592      0.12356      0.247329      0.103855      0.0500337       10     
reco:cvneva:CVNEvaluator                               0.943531       2.11869       8.31299       1.41861       2.08581        10     
reco:energyrecnumu:EnergyReco                          0.184053       61.3357       74.3585       66.9114       20.7229        10     
reco:energyrecnue:EnergyReco                          0.00160413    0.00380097     0.0064904    0.00349033    0.00132019       10     
reco:energyrecnc:EnergyReco                           0.00810171     0.0129488     0.016856      0.0127046    0.00223567       10     
[art]:TriggerResults:TriggerResultInserter             1.674e-05    5.37103e-05   0.000146501   3.8235e-05    3.76281e-05      10     
end_path:out1:RootOutput                                 9e-06      2.0593e-05     4.735e-05     1.488e-05    1.18967e-05      10     
end_path:out1:RootOutput(write)                        0.472923      0.558048      0.744169      0.522001      0.0849829       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21576.6 MB
  Peak resident set size usage (VmHWM): 2840.29 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 42.7758 | hit correction : 1.16236
 *** Total Charge : 5328.43
 Looking at view: 1 | Number of hits in view: 26
hit initial : 28.3914 | hit correction : 1.16772
hit initial : 23.1527 | hit correction : 1.15968
hit initial : 458.651 | hit correction : 1.14673
hit initial : 18.7315 | hit correction : 1.14674
hit initial : 69.4569 | hit correction : 1.14675
hit initial : 69.4089 | hit correction : 1.15414
hit initial : 117.567 | hit correction : 1.1542
hit initial : 160.087 | hit correction : 1.161
hit initial : 230.128 | hit correction : 1.1611
hit initial : 391.564 | hit correction : 1.1608
hit initial : 70.6194 | hit correction : 1.16071
hit initial : 1226.24 | hit correction : 1.1614
hit initial : 39.9206 | hit correction : 1.16061
hit initial : 1160.2 | hit correction : 1.16137
hit initial : 145.11 | hit correction : 1.16134
hit initial : 234.717 | hit correction : 1.16134
hit initial : 526.221 | hit correction : 1.16196
hit initial : 295.568 | hit correction : 1.16227
 *** Total Charge : 6106.43
 Looking at view: 2 | Number of hits in view: 18
Begin processing the 10th record. run: 5027 subRun: 0 event: 40710 at 13-Dec-2025 17:00:38 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  5
This pfp has size:  42
Added hit list length: 42 | Max was set to: -3.40282e+38
This pfp has size:  12
True Neutron Energy: 939.566
True Electron Energy: 24.2603
Completed MCParticle Loop
True Neutrino Energy: 28.0171
 Size of all hits: 42
hit initial : 53.6669 | hit correction : 1.14869
hit initial : 222.18 | hit correction : 1.14867
hit initial : 293.931 | hit correction : 1.1486
hit initial : 91.2871 | hit correction : 1.14853
hit initial : 81.2398 | hit correction : 1.14669
hit initial : 174.342 | hit correction : 1.14668
hit initial : 54.0658 | hit correction : 1.14666
hit initial : 189.826 | hit correction : 1.14004
hit initial : 177.368 | hit correction : 1.14019
hit initial : 540.203 | hit correction : 1.14003
hit initial : 51.3188 | hit correction : 1.14022
hit initial : 60.4924 | hit correction : 1.13903
hit initial : 129.32 | hit correction : 1.13867
hit initial : 67.1528 | hit correction : 1.13835
hit initial : 206.478 | hit correction : 1.13839
 *** Total Charge : 2735.04
 Looking at view: 0 | Number of hits in view: 15
hit initial : 66.8306 | hit correction : 1.14867
hit initial : 235.083 | hit correction : 1.14866
hit initial : 242.642 | hit correction : 1.14862
hit initial : 109.851 | hit correction : 1.14848
hit initial : 83.9774 | hit correction : 1.14667
hit initial : 151.773 | hit correction : 1.14669
hit initial : 55.0092 | hit correction : 1.1467
hit initial : 93.1928 | hit correction : 1.14021
hit initial : 398.769 | hit correction : 1.14017
hit initial : 445.55 | hit correction : 1.14007
hit initial : 313.138 | hit correction : 1.13956
hit initial : 281.16 | hit correction : 1.13897
hit initial : 235.207 | hit correction : 1.1384
hit initial : 113.352 | hit correction : 1.13811
 *** Total Charge : 3227.79
 Looking at view: 1 | Number of hits in view: 14
hit initial : 367.346 | hit correction : 1.14866
hit initial : 153.19 | hit correction : 1.14861
hit initial : 150.89 | hit correction : 1.14852
hit initial : 25.3396 | hit correction : 1.1466
hit initial : 252.186 | hit correction : 1.14669
hit initial : 29.2074 | hit correction : 1.14675
hit initial : 225.709 | hit correction : 1.14022
hit initial : 280.899 | hit correction : 1.14009
hit initial : 304.816 | hit correction : 1.14018
hit initial : 306.212 | hit correction : 1.13969
hit initial : 406.33 | hit correction : 1.13903
hit initial : 274.405 | hit correction : 1.1383
hit initial : 65.1764 | hit correction : 1.13795
 *** Total Charge : 3246.42
 Looking at view: 2 | Number of hits in view: 13
13-Dec-2025 17:00:42 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.124424      0.138555       0.1585       0.137109      0.0102474       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000498164   0.000961081    0.002505     0.000740881   0.000604968      10     
end_path:ana:AnalyzeEvents          0.12337       0.13729      0.155912      0.136275     0.00985688       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19474.4 MB
  Peak resident set size usage (VmHWM): 1533.62 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 12:04:38 UTC       justIN version: 01.06.00