justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 257918.75@dunegpschedd02.fnal.gov

Jobsub ID257918.75@dunegpschedd02.fnal.gov
Workflow ID11027
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-05 11:33:40
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-06 12:37:19
From worker nodeHostnamedunegli-7988749-0-fnpc18001.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 01:27:25
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T002841Z_gen_002361_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time11h (40169s)
CPU time10h (39472s = 98%)
Max RSS bytes3049754624 (2908 MiB)
Outputting started2025-12-06 12:36:55
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11027/1/001/analysisLowE_20251206T012728Z.root
Finished2025-12-06 12:37:19
Saved logsjustin-logs:257918.75-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

, 0.0857943, 0.094444, 0.71026, 
Output 2: 0.0441971, 0.210109, 0.725459, 0.0202354, 
Output 3: 0.986623, 0.00837045, 0.000818138, 0.00418896, 
Output 4: 0.47537, 0.461604, 0.0566757, 0.00634953, 
Output 5: 0.394108, 0.427098, 0.142407, 0.0363872, 
Output 6: 0.0354834, 0.076797, 0.0890139, 0.798706, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 23610 at 06-Dec-2025 11:43:20 UTC
Boundary wire vector sizes: 6944, 6877, 6834
minwire 0: 43
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1, 500
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0922587, 
Output 1: 0.0766362, 0.103369, 0.142168, 0.677826, 
Output 2: 0.0408119, 0.203793, 0.719209, 0.0361867, 
Output 3: 0.949565, 0.0230825, 0.00790491, 0.0194472, 
Output 4: 0.7935, 0.181811, 0.021032, 0.0036569, 
Output 5: 0.536561, 0.316455, 0.116507, 0.0304772, 
Output 6: 0.0169323, 0.03989, 0.0511241, 0.892054, 

06-Dec-2025 12:35:15 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 12:35:15 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/8b/46/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T002841Z_gen_002361_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2849.92       3965.39       5738.14       3803.7        858.105        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00573456     0.0160715     0.0494521     0.0122433     0.0122082       10     
reco:pandora:StandardPandora                            2847.04        3961         5725.79       3800.63       856.022        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00111369     0.0795228     0.331343      0.0588616     0.0924184       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000688338    0.0110472     0.0535533     0.0061544     0.0147751       10     
reco:pandoracalo:Calorimetry                          0.000454999    0.0123371     0.0984561    0.00128852     0.0290848       10     
reco:pandorapid:Chi2ParticleID                        0.000105048   0.000814377   0.00605763    0.000200789   0.00175106       10     
reco:cvnmap:CVNMapper                                  0.0618105     0.0918311     0.130161       0.09197      0.021059        10     
reco:cvneva:CVNEvaluator                                1.99229       3.37582       10.7981       2.35203       2.54033        10     
reco:energyrecnumu:EnergyReco                          0.0103287     0.068171      0.161253      0.0257339     0.0602912       10     
reco:energyrecnue:EnergyReco                          0.00252473    0.00611396     0.0165278    0.00373457    0.00458701       10     
reco:energyrecnc:EnergyReco                            0.0115058     0.143874      0.367362       0.14506       0.10692        10     
[art]:TriggerResults:TriggerResultInserter             2.672e-05    6.65875e-05   0.000309523   3.5016e-05    8.18914e-05      10     
end_path:out1:RootOutput                              1.1552e-05    2.54841e-05   0.000116039   1.4457e-05    3.03308e-05      10     
end_path:out1:RootOutput(write)                        0.403356      0.575627      0.715084      0.603051      0.0991267       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21788.6 MB
  Peak resident set size usage (VmHWM): 3049.75 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 322.444 | hit correction : 1.03773
hit initial : 57.1523 | hit correction : 1.03779
 *** Total Charge : 1107.88
 Looking at view: 0 | Number of hits in view: 7
hit initial : 40.7183 | hit correction : 1.03784
hit initial : 165.051 | hit correction : 1.03776
hit initial : 224.702 | hit correction : 1.0377
hit initial : 143.835 | hit correction : 1.03769
hit initial : 49.5823 | hit correction : 1.03771
hit initial : 27.3563 | hit correction : 1.03725
hit initial : 36.6938 | hit correction : 1.03713
hit initial : 156.657 | hit correction : 1.03709
hit initial : 106.932 | hit correction : 1.03709
 *** Total Charge : 987.222
 Looking at view: 1 | Number of hits in view: 9
hit initial : 26.0741 | hit correction : 1.03712
hit initial : 194.205 | hit correction : 1.03709
hit initial : 172.701 | hit correction : 1.03703
hit initial : 79.1142 | hit correction : 1.03781
hit initial : 129.118 | hit correction : 1.03711
hit initial : 790.446 | hit correction : 1.03779
hit initial : 235.651 | hit correction : 1.03706
 *** Total Charge : 1688.26
 Looking at view: 2 | Number of hits in view: 7
Begin processing the 10th record. run: 5027 subRun: 0 event: 23610 at 06-Dec-2025 12:36:46 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  41
Added hit list length: 41 | Max was set to: -3.40282e+38
True Neutron Energy: 939.572
True Neutron Energy: 940.49
True Electron Energy: 18.2418
Completed MCParticle Loop
True Neutrino Energy: 33.7374
 Size of all hits: 41
hit initial : 42.2842 | hit correction : 1.16365
hit initial : 190.615 | hit correction : 1.16373
hit initial : 41.0595 | hit correction : 1.16162
hit initial : 207.842 | hit correction : 1.16159
hit initial : 539.267 | hit correction : 1.16159
hit initial : 433.406 | hit correction : 1.16173
hit initial : 195.909 | hit correction : 1.16254
hit initial : 204.588 | hit correction : 1.16278
hit initial : 188.705 | hit correction : 1.16299
hit initial : 195.02 | hit correction : 1.16327
hit initial : 260.722 | hit correction : 1.16363
hit initial : 307.18 | hit correction : 1.16377
 *** Total Charge : 3262.89
 Looking at view: 0 | Number of hits in view: 12
hit initial : 77.5228 | hit correction : 1.16184
hit initial : 38.7045 | hit correction : 1.16147
hit initial : 170.065 | hit correction : 1.1615
hit initial : 254.129 | hit correction : 1.16157
hit initial : 157.274 | hit correction : 1.16164
hit initial : 39.2948 | hit correction : 1.16169
hit initial : 105.605 | hit correction : 1.16162
hit initial : 174.779 | hit correction : 1.16162
hit initial : 47.367 | hit correction : 1.16169
hit initial : 201.174 | hit correction : 1.16244
hit initial : 199.768 | hit correction : 1.16267
hit initial : 699.453 | hit correction : 1.16352
hit initial : 320.505 | hit correction : 1.1636
hit initial : 66.0403 | hit correction : 1.16376
 *** Total Charge : 2966.55
 Looking at view: 1 | Number of hits in view: 14
hit initial : 38.432 | hit correction : 1.15529
hit initial : 55.061 | hit correction : 1.15528
hit initial : 120.266 | hit correction : 1.16149
hit initial : 380.815 | hit correction : 1.16155
hit initial : 123.786 | hit correction : 1.16168
hit initial : 216.682 | hit correction : 1.16152
hit initial : 251.85 | hit correction : 1.16191
hit initial : 220.433 | hit correction : 1.1624
hit initial : 213.223 | hit correction : 1.16272
hit initial : 247.502 | hit correction : 1.16296
hit initial : 209.452 | hit correction : 1.16328
hit initial : 158.259 | hit correction : 1.16357
hit initial : 147.388 | hit correction : 1.16378
hit initial : 265.159 | hit correction : 1.16382
hit initial : 203.391 | hit correction : 1.16367
 *** Total Charge : 3314.73
 Looking at view: 2 | Number of hits in view: 15
06-Dec-2025 12:36:54 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.130342      0.188472      0.354298      0.155811      0.0631049       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000682056   0.000946463   0.00197799    0.000867957   0.000356173      10     
end_path:ana:AnalyzeEvents         0.129085      0.187169      0.353301      0.154697      0.0629875       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19477.4 MB
  Peak resident set size usage (VmHWM): 1542.47 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:10:27 UTC       justIN version: 01.06.00