justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 259853.0@dunegpschedd02.fnal.gov

Jobsub ID259853.0@dunegpschedd02.fnal.gov
Workflow ID11088
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-09 19:58:06
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-11 00:59:06
From worker nodeHostnamedunegli-8024607-0-fnpc9032.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-10 13:53:53
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T020832Z_gen_003631_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time11h (39866s)
CPU time10h (39359s = 98%)
Max RSS bytes3082575872 (2939 MiB)
Outputting started2025-12-11 00:58:20
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11088/1/001/analysisLowE_20251210T135354Z.root
Finished2025-12-11 00:59:06
Saved logsjustin-logs:259853.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

770341, 0.0262444, 
Output 3: 0.959332, 0.0315763, 0.00409577, 0.0049957, 
Output 4: 0.340076, 0.598307, 0.0565093, 0.00510674, 
Output 5: 0.511046, 0.373851, 0.0915221, 0.0235808, 
Output 6: 0.044981, 0.110991, 0.091846, 0.752182, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 36310 at 10-Dec-2025 23:43:25 UTC
Boundary wire vector sizes: 7182, 7112, 6912
minwire 0: 11
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 748, 1247
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.120594, 
Output 1: 0.0604077, 0.119543, 0.160525, 0.659524, 
Output 2: 0.0470055, 0.260755, 0.667651, 0.0245882, 
Output 3: 0.954207, 0.037085, 0.00399946, 0.00470856, 
Output 4: 0.248152, 0.651461, 0.0947169, 0.0056703, 
Output 5: 0.635491, 0.296701, 0.0567585, 0.0110497, 
Output 6: 0.0239467, 0.0709931, 0.0846513, 0.820409, 

11-Dec-2025 00:56:36 UTC  Closed output file "matt_reco2.root"
11-Dec-2025 00:56:36 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/82/31/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T020832Z_gen_003631_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3411.53       3951.34       4740.88       3870.6        411.008        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00900253     0.0221111     0.0387634     0.0216734    0.00936959       10     
reco:pandora:StandardPandora                            3408.97        3948         4737.25       3867.71       411.42         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00421679     0.0998268     0.352792      0.0996555     0.0969023       10     
reco:pandoraShower:LArPandoraModularShowerCreation     0.0020324     0.0193131     0.0611125     0.0155224     0.0167029       10     
reco:pandoracalo:Calorimetry                          0.000597132   0.00488246     0.0267741     0.001247     0.00772255       10     
reco:pandorapid:Chi2ParticleID                        0.000151884   0.000782452    0.0036211    0.000242335   0.00113272       10     
reco:cvnmap:CVNMapper                                  0.102086      0.135922      0.178788      0.136374      0.0206799       10     
reco:cvneva:CVNEvaluator                                1.44433       2.32745       7.25901       1.68835       1.66763        10     
reco:energyrecnumu:EnergyReco                          0.0118948     0.0620393     0.176952      0.030064      0.0581463       10     
reco:energyrecnue:EnergyReco                          0.00275336    0.00533941     0.0123555    0.00387664    0.00338162       10     
reco:energyrecnc:EnergyReco                            0.0123556     0.0814676     0.155618      0.100348      0.0472837       10     
[art]:TriggerResults:TriggerResultInserter            3.4001e-05    5.46147e-05   0.000163497   4.1996e-05    3.68921e-05      10     
end_path:out1:RootOutput                              1.1023e-05    2.02751e-05   4.8878e-05    1.45015e-05   1.27035e-05      10     
end_path:out1:RootOutput(write)                         0.4369       0.571995      0.871985      0.538711      0.117431        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12095.4 MB
  Peak resident set size usage (VmHWM): 3082.58 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 123.092 | hit correction : 1.26667
hit initial : 124.317 | hit correction : 1.26674
hit initial : 118.425 | hit correction : 1.26678
hit initial : 156.335 | hit correction : 1.26684
hit initial : 101.845 | hit correction : 1.26685
hit initial : 119.738 | hit correction : 1.26695
 *** Total Charge : 6201.46
 Looking at view: 2 | Number of hits in view: 31
Begin processing the 10th record. run: 5027 subRun: 0 event: 36310 at 11-Dec-2025 00:58:13 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  58
Added hit list length: 58 | Max was set to: -3.40282e+38
True Neutron Energy: 939.566
True Electron Energy: 47.9257
Completed MCParticle Loop
True Neutrino Energy: 69.9862
 Size of all hits: 58
hit initial : 45.2806 | hit correction : 1.40176
hit initial : 95.6113 | hit correction : 1.38829
hit initial : 51.626 | hit correction : 1.40181
hit initial : 144.53 | hit correction : 1.38843
hit initial : 181.897 | hit correction : 1.39117
hit initial : 866.434 | hit correction : 1.39234
hit initial : 1024.47 | hit correction : 1.39458
hit initial : 858.287 | hit correction : 1.39502
hit initial : 33.8457 | hit correction : 1.39508
hit initial : 197.953 | hit correction : 1.39673
 *** Total Charge : 4878.41
 Looking at view: 0 | Number of hits in view: 10
hit initial : 127.373 | hit correction : 1.39786
hit initial : 167.19 | hit correction : 1.39792
hit initial : 44.3547 | hit correction : 1.39798
hit initial : 33.8375 | hit correction : 1.38983
hit initial : 145.276 | hit correction : 1.38858
hit initial : 10.4521 | hit correction : 1.38943
hit initial : 253.424 | hit correction : 1.38854
hit initial : 107.097 | hit correction : 1.3886
hit initial : 40.9213 | hit correction : 1.40119
hit initial : 74.9157 | hit correction : 1.4012
hit initial : 38.6007 | hit correction : 1.4012
hit initial : 44.2969 | hit correction : 1.39406
hit initial : 138.111 | hit correction : 1.39406
hit initial : 69.3058 | hit correction : 1.39495
hit initial : 99.0931 | hit correction : 1.39412
hit initial : 185.802 | hit correction : 1.39013
hit initial : 270.088 | hit correction : 1.3907
hit initial : 273.852 | hit correction : 1.39143
hit initial : 289.865 | hit correction : 1.39224
hit initial : 272.318 | hit correction : 1.39308
hit initial : 274.615 | hit correction : 1.39375
hit initial : 388.389 | hit correction : 1.39486
hit initial : 340.91 | hit correction : 1.39512
hit initial : 138.047 | hit correction : 1.39635
hit initial : 306.02 | hit correction : 1.39672
hit initial : 268.426 | hit correction : 1.3977
hit initial : 216.953 | hit correction : 1.39851
hit initial : 79.0532 | hit correction : 1.3989
 *** Total Charge : 6550.51
 Looking at view: 1 | Number of hits in view: 28
hit initial : 154.915 | hit correction : 1.38821
hit initial : 210.869 | hit correction : 1.38857
hit initial : 259.856 | hit correction : 1.38935
hit initial : 243.447 | hit correction : 1.39028
hit initial : 262.257 | hit correction : 1.39099
hit initial : 196.799 | hit correction : 1.39159
hit initial : 174.54 | hit correction : 1.39211
hit initial : 176.883 | hit correction : 1.39267
hit initial : 249.805 | hit correction : 1.39319
hit initial : 266.055 | hit correction : 1.3939
hit initial : 116.032 | hit correction : 1.394
hit initial : 147.329 | hit correction : 1.39412
hit initial : 311.156 | hit correction : 1.39464
hit initial : 101.691 | hit correction : 1.39529
hit initial : 456.784 | hit correction : 1.39532
hit initial : 273.899 | hit correction : 1.39644
hit initial : 226.619 | hit correction : 1.39717
hit initial : 232.154 | hit correction : 1.39801
hit initial : 219.228 | hit correction : 1.39874
hit initial : 49.2655 | hit correction : 1.39905
 *** Total Charge : 6033.78
 Looking at view: 2 | Number of hits in view: 20
11-Dec-2025 00:58:18 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.116806      0.179646      0.230859       0.17132      0.031593        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00106962    0.00328103     0.0123328    0.00148523    0.00384957       10     
end_path:ana:AnalyzeEvents         0.115454      0.175896      0.228962      0.169623      0.030546        10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9813.77 MB
  Peak resident set size usage (VmHWM): 1538.01 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:29:01 UTC       justIN version: 01.06.00