justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267088.0@dunegpschedd01.fnal.gov

Jobsub ID267088.0@dunegpschedd01.fnal.gov
Workflow ID11117
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 22:52:41
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-12 03:22:18
From worker nodeHostnamedunegli-8035313-0-fnpc19117.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 22:53:25
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T031823Z_gen_004912_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time4h (16099s)
CPU time4h (15952s = 99%)
Max RSS bytes2919067648 (2783 MiB)
Outputting started2025-12-12 03:21:45
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11117/1/001/analysisLowE_20251211T225326Z.root
Finished2025-12-12 03:22:18
Saved logsjustin-logs:267088.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Classifier summary: 
Output 0: 0.0954442, 
Output 1: 0.0900125, 0.078089, 0.108191, 0.723708, 
Output 2: 0.0683696, 0.195184, 0.719469, 0.0169771, 
Output 3: 0.970996, 0.022474, 0.0016743, 0.00485524, 
Output 4: 0.520597, 0.403177, 0.0643651, 0.0118611, 
Output 5: 0.550955, 0.390358, 0.048584, 0.0101036, 
Output 6: 0.0289513, 0.0757746, 0.0851231, 0.810151, 

Begin processing the 10th record. run: 5027 subRun: 0 event: 49120 at 12-Dec-2025 02:49:13 UTC
Boundary wire vector sizes: 6710, 6610, 6549
minwire 0: 41
minwire 1: 1
minwire 2: 4
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.09448, 
Output 1: 0.123648, 0.245553, 0.22804, 0.402759, 
Output 2: 0.033845, 0.141248, 0.813823, 0.0110837, 
Output 3: 0.940992, 0.050189, 0.0039384, 0.00488043, 
Output 4: 0.530671, 0.415025, 0.0476999, 0.00660385, 
Output 5: 0.371904, 0.48651, 0.116888, 0.0246973, 
Output 6: 0.0641357, 0.130342, 0.10472, 0.700803, 

12-Dec-2025 03:20:37 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 03:20:37 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/c0/45/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T031823Z_gen_004912_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1482.37       1591.4        1879.3        1545.28       124.059        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00136121    0.00618958     0.0189143    0.00402621    0.00561226       10     
reco:pandora:StandardPandora                            1481.02       1589.66       1877.28       1543.81       124.049        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000459703    0.0162276     0.0837539    0.00409031     0.024815        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000270962    0.0053012     0.0165342    0.00343694    0.00492626       10     
reco:pandoracalo:Calorimetry                          0.000198331   0.00569961     0.0245729    0.00120116    0.00848878       10     
reco:pandorapid:Chi2ParticleID                        5.6341e-05    0.000260421   0.000861057   0.000122146   0.00026161       10     
reco:cvnmap:CVNMapper                                  0.0350307     0.0430747     0.0712789     0.0366703     0.0108122       10     
reco:cvneva:CVNEvaluator                               0.868956       1.17492       3.11512      0.901214      0.663274        10     
reco:energyrecnumu:EnergyReco                         0.00355533     0.0584744     0.136354      0.073421      0.0433816       10     
reco:energyrecnue:EnergyReco                          0.00100878     0.0053789     0.0126431    0.00427552    0.00436348       10     
reco:energyrecnc:EnergyReco                           0.00699023     0.0397852     0.0942401     0.0122403     0.0378766       10     
[art]:TriggerResults:TriggerResultInserter             1.321e-05    2.63414e-05   9.1031e-05    1.99455e-05   2.20932e-05      10     
end_path:out1:RootOutput                                6.2e-06     1.05191e-05    3.104e-05     7.905e-06    7.10427e-06      10     
end_path:out1:RootOutput(write)                        0.311799      0.386432      0.562203      0.324645      0.0880992       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21683.6 MB
  Peak resident set size usage (VmHWM): 2919.07 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 170.817 | hit correction : 1.12443
hit initial : 440.878 | hit correction : 1.12432
hit initial : 335.414 | hit correction : 1.12418
hit initial : 235.574 | hit correction : 1.12417
hit initial : 114.959 | hit correction : 1.12416
 *** Total Charge : 1952.06
 Looking at view: 1 | Number of hits in view: 8
hit initial : 327.921 | hit correction : 1.12416
hit initial : 689.007 | hit correction : 1.12418
hit initial : 282.311 | hit correction : 1.12454
 *** Total Charge : 1460.67
 Looking at view: 2 | Number of hits in view: 3
Begin processing the 8th record. run: 5027 subRun: 0 event: 49118 at 12-Dec-2025 03:21:32 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 34.7871
Completed MCParticle Loop
True Neutrino Energy: 40.5812
 Size of all hits: 0
Begin processing the 9th record. run: 5027 subRun: 0 event: 49119 at 12-Dec-2025 03:21:36 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 6.29017
Completed MCParticle Loop
True Neutrino Energy: 13.4061
 Size of all hits: 0
Begin processing the 10th record. run: 5027 subRun: 0 event: 49120 at 12-Dec-2025 03:21:40 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  42
Added hit list length: 42 | Max was set to: -3.40282e+38
True Neutron Energy: 939.567
True Electron Energy: 39.8103
Completed MCParticle Loop
True Neutrino Energy: 45.213
 Size of all hits: 42
hit initial : 39.4777 | hit correction : 1.21733
hit initial : 38.681 | hit correction : 1.21616
hit initial : 25.1341 | hit correction : 1.21616
hit initial : 80.9213 | hit correction : 1.21738
hit initial : 425.682 | hit correction : 1.21739
hit initial : 372.416 | hit correction : 1.21707
hit initial : 212.545 | hit correction : 1.21655
hit initial : 216.616 | hit correction : 1.21633
hit initial : 185.612 | hit correction : 1.21621
hit initial : 93.8169 | hit correction : 1.21615
hit initial : 149.477 | hit correction : 1.21618
hit initial : 46.0549 | hit correction : 1.21838
hit initial : 255.205 | hit correction : 1.21631
hit initial : 140.68 | hit correction : 1.21832
hit initial : 322.867 | hit correction : 1.2165
hit initial : 310.679 | hit correction : 1.21669
hit initial : 253.68 | hit correction : 1.21712
hit initial : 235.768 | hit correction : 1.21736
hit initial : 150.435 | hit correction : 1.21737
 *** Total Charge : 4326.93
 Looking at view: 1 | Number of hits in view: 19
hit initial : 66.5053 | hit correction : 1.21951
hit initial : 23.4911 | hit correction : 1.21951
hit initial : 42.9072 | hit correction : 1.22019
hit initial : 97.7448 | hit correction : 1.21756
hit initial : 211.315 | hit correction : 1.21736
hit initial : 230.34 | hit correction : 1.21724
hit initial : 146.282 | hit correction : 1.217
hit initial : 174.13 | hit correction : 1.21674
hit initial : 335.161 | hit correction : 1.21653
hit initial : 172.767 | hit correction : 1.21639
hit initial : 156.537 | hit correction : 1.21622
hit initial : 171.808 | hit correction : 1.21615
hit initial : 144.827 | hit correction : 1.21612
hit initial : 142.631 | hit correction : 1.21839
hit initial : 142.013 | hit correction : 1.2162
hit initial : 137.045 | hit correction : 1.21827
hit initial : 153.481 | hit correction : 1.21629
hit initial : 135.74 | hit correction : 1.21642
hit initial : 134.242 | hit correction : 1.21658
hit initial : 182.731 | hit correction : 1.21678
hit initial : 232.185 | hit correction : 1.21708
hit initial : 351.448 | hit correction : 1.2174
hit initial : 226.846 | hit correction : 1.21782
 *** Total Charge : 4639.58
 Looking at view: 2 | Number of hits in view: 23
12-Dec-2025 03:21:44 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0991986     0.116157       0.1478       0.111807      0.0160716       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000409944   0.000658964   0.00156822    0.000495109   0.000348865      10     
end_path:ana:AnalyzeEvents         0.0984307     0.115314       0.1467       0.110466      0.016028        10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19473.9 MB
  Peak resident set size usage (VmHWM): 1534.13 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 15:00:11 UTC       justIN version: 01.06.00