justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 257901.38@dunegpschedd02.fnal.gov

Jobsub ID257901.38@dunegpschedd02.fnal.gov
Workflow ID11024
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-05 10:59:38
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-06 08:39:49
From worker nodeHostnamedunegli-7988599-0-fnpc18005.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-05 20:21:46
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T021759Z_gen_003882_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time12h (44270s)
CPU time11h (42994s = 97%)
Max RSS bytes3062583296 (2920 MiB)
Outputting started2025-12-06 08:39:36
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11024/1/001/analysisLowE_20251205T202148Z.root
Finished2025-12-06 08:39:49
Saved logsjustin-logs:257901.38-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

158795, 0.290936, 0.501413, 0.0488558, 
Output 3: 0.96675, 0.023383, 0.00273542, 0.00713151, 
Output 4: 0.304815, 0.642835, 0.0489247, 0.00342545, 
Output 5: 0.71089, 0.270483, 0.0157609, 0.00286607, 
Output 6: 0.0177461, 0.0517387, 0.0660157, 0.8645, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 38820 at 06-Dec-2025 08:05:55 UTC
Boundary wire vector sizes: 6833, 6790, 6703
minwire 0: 10
minwire 1: 1
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 335, 834
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0994516, 
Output 1: 0.128112, 0.0571963, 0.18752, 0.627171, 
Output 2: 0.071311, 0.154476, 0.74515, 0.0290635, 
Output 3: 0.953685, 0.0335562, 0.00451105, 0.00824765, 
Output 4: 0.624177, 0.345039, 0.0268234, 0.00396025, 
Output 5: 0.416849, 0.445749, 0.11022, 0.0271831, 
Output 6: 0.0394658, 0.0856497, 0.0790951, 0.795789, 

06-Dec-2025 08:38:35 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 08:38:35 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/db/45/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T021759Z_gen_003882_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1939.55       4379.45       6355.28       5400.28       1838.7         10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00365275     0.0125471     0.0307739    0.00957648    0.00768812       10     
reco:pandora:StandardPandora                            1937.17       4333.88       6271.94       5329.14       1803.98        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000570955    0.0739414     0.422218      0.0388826     0.120934        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000434929     0.01308      0.0542584     0.0067024     0.0181539       10     
reco:pandoracalo:Calorimetry                          0.000316756   0.00470157     0.0153341    0.00186268    0.00499219       10     
reco:pandorapid:Chi2ParticleID                        0.000106991    0.0011494    0.00553897    0.000161549   0.00184111       10     
reco:cvnmap:CVNMapper                                  0.0396036     0.102427      0.253134      0.0653655     0.0728487       10     
reco:cvneva:CVNEvaluator                                1.82124       3.83674       13.9489       2.2565        3.49754        10     
reco:energyrecnumu:EnergyReco                         0.00390893      13.125         67.54       0.0623137      26.1726        10     
reco:energyrecnue:EnergyReco                          0.00134637    0.00802542     0.0267316    0.00462953    0.00836711       10     
reco:energyrecnc:EnergyReco                           0.00932786      27.7501       73.2472      0.0549472      34.0309        10     
[art]:TriggerResults:TriggerResultInserter            2.4687e-05    0.000110488   0.000720135   3.48305e-05   0.000204133      10     
end_path:out1:RootOutput                               8.476e-06    3.92608e-05   0.000234101   1.45325e-05   6.55957e-05      10     
end_path:out1:RootOutput(write)                        0.380145      0.635413       1.04377      0.599237       0.24948        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21746.7 MB
  Peak resident set size usage (VmHWM): 3062.58 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 154.583 | hit correction : 1.29015
hit initial : 397.124 | hit correction : 1.28994
hit initial : 424.957 | hit correction : 1.28949
hit initial : 360.182 | hit correction : 1.28893
hit initial : 291.234 | hit correction : 1.28873
 *** Total Charge : 3970.45
 Looking at view: 1 | Number of hits in view: 11
hit initial : 22.4404 | hit correction : 1.28933
hit initial : 59.7269 | hit correction : 1.29089
hit initial : 166.092 | hit correction : 1.2909
hit initial : 143.446 | hit correction : 1.29089
hit initial : 173.809 | hit correction : 1.29082
hit initial : 122.82 | hit correction : 1.29072
hit initial : 112.894 | hit correction : 1.29057
hit initial : 100.043 | hit correction : 1.29043
hit initial : 31.6414 | hit correction : 1.29029
hit initial : 121.727 | hit correction : 1.29114
hit initial : 219.009 | hit correction : 1.29077
hit initial : 295.987 | hit correction : 1.29099
hit initial : 318.018 | hit correction : 1.2901
hit initial : 290.298 | hit correction : 1.2898
hit initial : 214.588 | hit correction : 1.28945
hit initial : 136.081 | hit correction : 1.28926
hit initial : 137.032 | hit correction : 1.28906
hit initial : 154.158 | hit correction : 1.2889
hit initial : 139.54 | hit correction : 1.28871
hit initial : 120.464 | hit correction : 1.2885
hit initial : 82.9324 | hit correction : 1.28836
 *** Total Charge : 4080.17
 Looking at view: 2 | Number of hits in view: 21
Begin processing the 10th record. run: 5027 subRun: 0 event: 38820 at 06-Dec-2025 08:39:32 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  36
Added hit list length: 36 | Max was set to: -3.40282e+38
True Neutron Energy: 939.571
True Electron Energy: 11.6243
Completed MCParticle Loop
True Neutrino Energy: 17.0058
 Size of all hits: 36
hit initial : 29.8688 | hit correction : 1.13956
hit initial : 41.4414 | hit correction : 1.13955
hit initial : 57.2338 | hit correction : 1.14334
hit initial : 54.9884 | hit correction : 1.14317
hit initial : 98.1235 | hit correction : 1.14156
hit initial : 136.451 | hit correction : 1.14155
hit initial : 56.138 | hit correction : 1.14149
hit initial : 170.091 | hit correction : 1.14105
hit initial : 476.591 | hit correction : 1.14104
hit initial : 205.702 | hit correction : 1.14114
hit initial : 112.024 | hit correction : 1.1406
 *** Total Charge : 1641.82
 Looking at view: 0 | Number of hits in view: 11
hit initial : 79.346 | hit correction : 1.1432
hit initial : 106.651 | hit correction : 1.14326
hit initial : 38.7336 | hit correction : 1.14332
hit initial : 37.6263 | hit correction : 1.13957
hit initial : 90.1857 | hit correction : 1.13982
hit initial : 220.645 | hit correction : 1.14072
hit initial : 41.0745 | hit correction : 1.14059
hit initial : 63.0233 | hit correction : 1.14157
hit initial : 130.626 | hit correction : 1.14156
hit initial : 103.353 | hit correction : 1.14118
hit initial : 257.622 | hit correction : 1.14116
hit initial : 333.991 | hit correction : 1.14102
 *** Total Charge : 1715.23
 Looking at view: 1 | Number of hits in view: 12
hit initial : 128.639 | hit correction : 1.14059
hit initial : 31.5575 | hit correction : 1.14312
hit initial : 78.9657 | hit correction : 1.14313
hit initial : 90.7623 | hit correction : 1.14332
hit initial : 29.6617 | hit correction : 1.14332
hit initial : 151.948 | hit correction : 1.14157
hit initial : 138.877 | hit correction : 1.14123
hit initial : 120.942 | hit correction : 1.14123
hit initial : 207.732 | hit correction : 1.14106
hit initial : 146.383 | hit correction : 1.14113
hit initial : 24.1842 | hit correction : 1.14107
hit initial : 249.952 | hit correction : 1.14072
hit initial : 187.358 | hit correction : 1.14078
 *** Total Charge : 1811.26
 Looking at view: 2 | Number of hits in view: 13
06-Dec-2025 08:39:35 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0999861     0.126519      0.234764      0.113701      0.0377168       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000491145   0.00071351    0.00161235    0.000616823   0.000309536      10     
end_path:ana:AnalyzeEvents         0.0992536     0.125552      0.233883      0.112789      0.0377154       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19474.6 MB
  Peak resident set size usage (VmHWM): 1535.12 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:09:46 UTC       justIN version: 01.06.00