justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266231.0@dunegpschedd01.fnal.gov

Jobsub ID266231.0@dunegpschedd01.fnal.gov
Workflow ID11089
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-10 18:41:14
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-11 17:05:45
From worker nodeHostnamedunegli-7867877-0-fnpc9022.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 09:00:50
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T202013Z_gen_002737_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time8h (29080s)
CPU time7h (28787s = 98%)
Max RSS bytes3033567232 (2893 MiB)
Outputting started2025-12-11 17:05:31
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11089/1/001/analysisLowE_20251211T090052Z.root
Finished2025-12-11 17:05:45
Saved logsjustin-logs:266231.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0.283494, 0.569155, 0.0268943, 
Output 3: 0.963841, 0.0257508, 0.00257054, 0.00783788, 
Output 4: 0.340954, 0.605531, 0.0494283, 0.00408602, 
Output 5: 0.705946, 0.282519, 0.0101365, 0.00139799, 
Output 6: 0.0170255, 0.0516481, 0.0646108, 0.866716, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 27370 at 11-Dec-2025 16:28:58 UTC
Boundary wire vector sizes: 7010, 6939, 6791
minwire 0: 71
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 490, 989
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0625625, 
Output 1: 0.0225182, 0.109076, 0.127924, 0.740482, 
Output 2: 0.083679, 0.223773, 0.662126, 0.0304221, 
Output 3: 0.922995, 0.0600516, 0.00764425, 0.00930904, 
Output 4: 0.519129, 0.421264, 0.0529927, 0.00661375, 
Output 5: 0.736786, 0.233095, 0.0248687, 0.0052502, 
Output 6: 0.0158034, 0.0483244, 0.0585262, 0.877346, 

11-Dec-2025 17:04:42 UTC  Closed output file "matt_reco2.root"
11-Dec-2025 17:04:42 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/fd/7f/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T202013Z_gen_002737_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2138.66       2869.14       3422.27       2904.99       301.025        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00309186     0.0155109     0.0253314     0.0155535    0.00573248       10     
reco:pandora:StandardPandora                             2137         2866.18       3414.4        2902.4        299.787        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000640531    0.0534496     0.266382      0.0249068     0.0757585       10     
reco:pandoraShower:LArPandoraModularShowerCreation     0.0016925     0.0172019     0.104573     0.00699014     0.0300271       10     
reco:pandoracalo:Calorimetry                          0.000298981   0.00864684     0.0737817    0.000628402    0.0217764       10     
reco:pandorapid:Chi2ParticleID                        8.7808e-05    0.000542256   0.00208616    0.000149264   0.000710254      10     
reco:cvnmap:CVNMapper                                  0.0626319     0.0925815     0.141877      0.0901558     0.0199912       10     
reco:cvneva:CVNEvaluator                                1.11262       2.1181        6.7905        1.4845        1.59675        10     
reco:energyrecnumu:EnergyReco                         0.00757067     0.0637091     0.133038      0.0541179     0.0502652       10     
reco:energyrecnue:EnergyReco                          0.00117947    0.00453121     0.0134828    0.00293964    0.00403268       10     
reco:energyrecnc:EnergyReco                            0.0102663     0.0644239     0.149329      0.0469377     0.0560846       10     
[art]:TriggerResults:TriggerResultInserter             1.733e-05    4.78579e-05   0.000180824   3.21435e-05   4.53716e-05      10     
end_path:out1:RootOutput                               6.785e-06    1.56072e-05   5.4625e-05    1.1696e-05    1.32571e-05      10     
end_path:out1:RootOutput(write)                        0.373335      0.519638      0.715633      0.465053      0.120778        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12084.8 MB
  Peak resident set size usage (VmHWM): 3033.57 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 110.751 | hit correction : 1.08919
hit initial : 194.067 | hit correction : 1.08917
hit initial : 68.9058 | hit correction : 1.08913
 *** Total Charge : 5030.23
 Looking at view: 0 | Number of hits in view: 25
hit initial : 141.321 | hit correction : 1.09264
hit initial : 690.904 | hit correction : 1.09239
hit initial : 166.586 | hit correction : 1.09257
hit initial : 307.936 | hit correction : 1.0917
hit initial : 740.319 | hit correction : 1.09164
hit initial : 302.912 | hit correction : 1.09159
hit initial : 808.31 | hit correction : 1.0916
hit initial : 246.108 | hit correction : 1.0911
hit initial : 110.507 | hit correction : 1.09112
hit initial : 786.725 | hit correction : 1.09088
hit initial : 351.792 | hit correction : 1.09035
hit initial : 131.688 | hit correction : 1.08954
hit initial : 126.468 | hit correction : 1.08949
hit initial : 66.8357 | hit correction : 1.0892
hit initial : 203.45 | hit correction : 1.08918
hit initial : 106.047 | hit correction : 1.08915
 *** Total Charge : 5770.56
 Looking at view: 1 | Number of hits in view: 16
hit initial : 397.554 | hit correction : 1.09264
hit initial : 228.477 | hit correction : 1.09264
hit initial : 304.588 | hit correction : 1.09234
hit initial : 674.582 | hit correction : 1.09185
hit initial : 269.998 | hit correction : 1.09177
hit initial : 138.608 | hit correction : 1.0918
hit initial : 550.333 | hit correction : 1.09151
hit initial : 215.092 | hit correction : 1.09151
hit initial : 61.4812 | hit correction : 1.09125
hit initial : 150.678 | hit correction : 1.09117
hit initial : 253.241 | hit correction : 1.09116
hit initial : 897.346 | hit correction : 1.09097
hit initial : 515.778 | hit correction : 1.09031
hit initial : 330.857 | hit correction : 1.08948
hit initial : 389.839 | hit correction : 1.08917
 *** Total Charge : 5869.09
 Looking at view: 2 | Number of hits in view: 15
Begin processing the 10th record. run: 5026 subRun: 0 event: 27370 at 11-Dec-2025 17:05:27 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  28
Added hit list length: 28 | Max was set to: -3.40282e+38
True Neutron Energy: 939.57
True Electron Energy: 39.8254
Completed MCParticle Loop
True Neutrino Energy: 46.0725
 Size of all hits: 28
hit initial : 34.8429 | hit correction : 1.10844
hit initial : 53.7328 | hit correction : 1.10847
hit initial : 265.575 | hit correction : 1.10488
hit initial : 144.94 | hit correction : 1.10547
hit initial : 99.0417 | hit correction : 1.10504
hit initial : 105.71 | hit correction : 1.10546
hit initial : 358.707 | hit correction : 1.10108
hit initial : 105.682 | hit correction : 1.10086
hit initial : 327.003 | hit correction : 1.1043
hit initial : 208.515 | hit correction : 1.10356
hit initial : 236.638 | hit correction : 1.10316
hit initial : 240.224 | hit correction : 1.10279
hit initial : 285.042 | hit correction : 1.10246
hit initial : 327.899 | hit correction : 1.10214
hit initial : 435.798 | hit correction : 1.10159
 *** Total Charge : 3562.33
 Looking at view: 0 | Number of hits in view: 15
hit initial : 65.4636 | hit correction : 1.10079
hit initial : 47.0842 | hit correction : 1.10547
hit initial : 118.274 | hit correction : 1.10534
hit initial : 369.641 | hit correction : 1.10525
hit initial : 342.462 | hit correction : 1.10453
hit initial : 355.151 | hit correction : 1.10381
hit initial : 300.513 | hit correction : 1.10324
hit initial : 305.038 | hit correction : 1.10282
hit initial : 295.244 | hit correction : 1.10246
hit initial : 314.803 | hit correction : 1.10215
hit initial : 328.307 | hit correction : 1.10176
hit initial : 326.131 | hit correction : 1.10125
hit initial : 235.618 | hit correction : 1.10092
 *** Total Charge : 3754.33
 Looking at view: 1 | Number of hits in view: 13
11-Dec-2025 17:05:30 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.072495      0.0888146     0.110977      0.0906496     0.0107364       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000428348   0.00054756    0.000992235   0.000499681   0.000157509      10     
end_path:ana:AnalyzeEvents         0.0718418     0.0881009     0.110392      0.0900118     0.0106992       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9811.1 MB
  Peak resident set size usage (VmHWM): 1533.22 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 16:27:49 UTC       justIN version: 01.06.00