justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267030.0@dunegpschedd01.fnal.gov

Jobsub ID267030.0@dunegpschedd01.fnal.gov
Workflow ID11112
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 21:42:37
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-12 01:33:57
From worker nodeHostnamedunegli-7878050-0-fnpc19117.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 21:43:37
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T014605Z_gen_003209_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time3h (13805s)
CPU time3h (13691s = 99%)
Max RSS bytes2918535168 (2783 MiB)
Outputting started2025-12-12 01:33:42
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11112/1/001/analysisLowE_20251211T214337Z.root
Finished2025-12-12 01:33:57
Saved logsjustin-logs:267030.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

7 subRun: 0 event: 32090
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  12-Dec-2025 01:33:01 UTC run: 5027 subRun: 0 event: 32090
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6830, 6746, 6720
minwire 0: 27
minwire 1: 1
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1222, 1721
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0803838, 
Output 1: 0.0477302, 0.199878, 0.191091, 0.5613, 
Output 2: 0.0557351, 0.187602, 0.723248, 0.0334152, 
Output 3: 0.941259, 0.0407411, 0.0087278, 0.0092717, 
Output 4: 0.851792, 0.127187, 0.0170073, 0.00401328, 
Output 5: 0.582238, 0.324431, 0.0758619, 0.017469, 
Output 6: 0.02767, 0.0663471, 0.0641157, 0.841867, 

12-Dec-2025 01:33:03 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 01:33:03 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/91/cc/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T014605Z_gen_003209_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1312.16       1368.6        1420.71       1369.38       33.8241        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00118977    0.00542435     0.0202086    0.00333486    0.00560768       10     
reco:pandora:StandardPandora                            1310.99       1367.29       1419.49       1368.21       34.0154        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00220245     0.0151117     0.0570643    0.00764637     0.0167315       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000915067   0.00344927     0.0110228    0.00253143    0.00293611       10     
reco:pandoracalo:Calorimetry                          0.000232562   0.00576893     0.0266663    0.000762351   0.00906333       10     
reco:pandorapid:Chi2ParticleID                        5.1761e-05    0.000145615   0.000832557   6.7321e-05    0.000229282      10     
reco:cvnmap:CVNMapper                                  0.0211085     0.0270825     0.0358658     0.0265517    0.00421961       10     
reco:cvneva:CVNEvaluator                               0.771044      0.905218       1.99044      0.788376      0.361831        10     
reco:energyrecnumu:EnergyReco                         0.00508938     0.0289004     0.0734257     0.0118116     0.0274226       10     
reco:energyrecnue:EnergyReco                          0.000821786   0.00262569    0.00677061    0.000903542   0.00265453       10     
reco:energyrecnc:EnergyReco                           0.00643337     0.0523987     0.0904944     0.0647822     0.0307609       10     
[art]:TriggerResults:TriggerResultInserter             1.223e-05    2.17641e-05   7.7841e-05     1.549e-05    1.89102e-05      10     
end_path:out1:RootOutput                               6.95e-06     1.12561e-05    2.538e-05     8.03e-06     5.90193e-06      10     
end_path:out1:RootOutput(write)                        0.257717      0.267455       0.28917      0.264472      0.0105816       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21683.9 MB
  Peak resident set size usage (VmHWM): 2918.54 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 50.2243 | hit correction : 1.07857
hit initial : 153.047 | hit correction : 1.07778
hit initial : 694.413 | hit correction : 1.07792
hit initial : 738.564 | hit correction : 1.07808
hit initial : 177.181 | hit correction : 1.07813
 *** Total Charge : 2217.33
 Looking at view: 1 | Number of hits in view: 9
hit initial : 36.6672 | hit correction : 1.0778
hit initial : 87.0628 | hit correction : 1.07525
hit initial : 60.3131 | hit correction : 1.07523
hit initial : 204.957 | hit correction : 1.07835
hit initial : 167.088 | hit correction : 1.07862
hit initial : 265.241 | hit correction : 1.07846
hit initial : 206.493 | hit correction : 1.07704
hit initial : 438.05 | hit correction : 1.07785
hit initial : 428.726 | hit correction : 1.0778
hit initial : 269.645 | hit correction : 1.07814
 *** Total Charge : 2332.63
 Looking at view: 2 | Number of hits in view: 10
Begin processing the 9th record. run: 5027 subRun: 0 event: 32089 at 12-Dec-2025 01:33:36 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 2.52853
Completed MCParticle Loop
True Neutrino Energy: 5.81266
 Size of all hits: 0
Begin processing the 10th record. run: 5027 subRun: 0 event: 32090 at 12-Dec-2025 01:33:39 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  4
This pfp has size:  41
Added hit list length: 41 | Max was set to: -3.40282e+38
This pfp has size:  29
True Neutron Energy: 939.567
True Electron Energy: 52.4165
Completed MCParticle Loop
True Neutrino Energy: 59.694
 Size of all hits: 41
hit initial : 61.4675 | hit correction : 1.04429
hit initial : 56.6822 | hit correction : 1.04702
hit initial : 212.125 | hit correction : 1.04696
hit initial : 292.413 | hit correction : 1.04677
hit initial : 262.116 | hit correction : 1.0465
hit initial : 226.17 | hit correction : 1.04623
hit initial : 230.372 | hit correction : 1.04602
hit initial : 223.986 | hit correction : 1.04585
hit initial : 326.733 | hit correction : 1.04564
hit initial : 508.606 | hit correction : 1.04555
hit initial : 396.719 | hit correction : 1.0455
hit initial : 254.016 | hit correction : 1.04541
hit initial : 262.138 | hit correction : 1.04533
hit initial : 279.402 | hit correction : 1.04519
hit initial : 343.016 | hit correction : 1.04482
hit initial : 383.197 | hit correction : 1.04424
hit initial : 86.5084 | hit correction : 1.04364
hit initial : 187.838 | hit correction : 1.04353
 *** Total Charge : 4802.5
 Looking at view: 0 | Number of hits in view: 18
hit initial : 477.892 | hit correction : 1.04332
hit initial : 17.2065 | hit correction : 1.04462
hit initial : 90.3527 | hit correction : 1.04297
hit initial : 43.7122 | hit correction : 1.04295
hit initial : 152.325 | hit correction : 1.04706
hit initial : 167.272 | hit correction : 1.04693
hit initial : 170.942 | hit correction : 1.04676
hit initial : 172.654 | hit correction : 1.04658
hit initial : 164.169 | hit correction : 1.04641
hit initial : 183.176 | hit correction : 1.04622
hit initial : 195.831 | hit correction : 1.04604
hit initial : 221.577 | hit correction : 1.04587
hit initial : 413.57 | hit correction : 1.04566
hit initial : 425.785 | hit correction : 1.04557
hit initial : 393.678 | hit correction : 1.04544
hit initial : 378.818 | hit correction : 1.04544
hit initial : 326.195 | hit correction : 1.04529
hit initial : 200.637 | hit correction : 1.04515
hit initial : 138.05 | hit correction : 1.04496
hit initial : 158.095 | hit correction : 1.04477
hit initial : 237.646 | hit correction : 1.04445
hit initial : 203.62 | hit correction : 1.04406
hit initial : 217.771 | hit correction : 1.04372
 *** Total Charge : 5384.08
 Looking at view: 2 | Number of hits in view: 23
12-Dec-2025 01:33:42 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0642988     0.0794116     0.0964048     0.0799309    0.00947503       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000365743   0.000595953   0.00118972    0.000442624   0.000270958      10     
end_path:ana:AnalyzeEvents         0.063708      0.0786392     0.0950427     0.0793674     0.0094262       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19470.6 MB
  Peak resident set size usage (VmHWM): 1532.45 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 14:59:41 UTC       justIN version: 01.06.00