justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258505.6@dunegpschedd02.fnal.gov

Jobsub ID258505.6@dunegpschedd02.fnal.gov
Workflow ID11030
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-06 11:33:57
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-06 19:04:49
From worker nodeHostnamedunegli-7832320-0-fnpc18010.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 11:34:39
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T160516Z_gen_000208_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time7h (26993s)
CPU time7h (26586s = 98%)
Max RSS bytes3055013888 (2913 MiB)
Outputting started2025-12-06 19:04:32
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11030/1/001/analysisLowE_20251206T113440Z.root
Finished2025-12-06 19:04:49
Saved logsjustin-logs:258505.6-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ubRun: 0 event: 2080
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  06-Dec-2025 19:03:11 UTC run: 5026 subRun: 0 event: 2080
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6606, 6579, 6719
minwire 0: 24
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1606, 2105
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.123649, 
Output 1: 0.0805288, 0.0779771, 0.0868828, 0.754611, 
Output 2: 0.0565092, 0.206134, 0.707113, 0.0302434, 
Output 3: 0.979674, 0.0109459, 0.00172832, 0.00765235, 
Output 4: 0.751635, 0.220243, 0.0236926, 0.00442942, 
Output 5: 0.268783, 0.492199, 0.194766, 0.0442522, 
Output 6: 0.0334708, 0.0774813, 0.0860023, 0.803046, 

06-Dec-2025 19:03:16 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 19:03:16 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/bf/3e/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T160516Z_gen_000208_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2373.43       2673.9        2931.08       2730.93       186.872        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00348319    0.00899981     0.024576     0.00618049    0.00693204       10     
reco:pandora:StandardPandora                            2369.76       2669.59       2923.57       2727.66       186.245        10     
reco:pandoraTrack:LArPandoraTrackCreation              0.002254      0.0277585       0.154      0.00464623     0.0448793       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00141621     0.010935      0.0392725    0.00992599     0.0102668       10     
reco:pandoracalo:Calorimetry                          0.000385497   0.00596895     0.0366394    0.000996771    0.0107024       10     
reco:pandorapid:Chi2ParticleID                        8.9619e-05    0.000518157   0.00342102    0.000181362   0.000971656      10     
reco:cvnmap:CVNMapper                                  0.0410528     0.0577756     0.0739315     0.0552378    0.00898916       10     
reco:cvneva:CVNEvaluator                                2.06732       3.4487        6.31391       3.2274        1.06911        10     
reco:energyrecnumu:EnergyReco                         0.00246145     0.0903316     0.145116      0.116049      0.0491951       10     
reco:energyrecnue:EnergyReco                          0.00217497    0.00505659     0.0152069    0.00261203     0.0048747       10     
reco:energyrecnc:EnergyReco                            0.014078      0.0621675     0.150387      0.0161883     0.0581497       10     
[art]:TriggerResults:TriggerResultInserter            2.3404e-05    3.89424e-05   0.00012688    3.00915e-05   2.95968e-05      10     
end_path:out1:RootOutput                               9.198e-06    1.39414e-05   4.0486e-05    1.08205e-05   8.99107e-06      10     
end_path:out1:RootOutput(write)                        0.520721      0.585494      0.665316      0.589151      0.0395175       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21773.8 MB
  Peak resident set size usage (VmHWM): 3055.01 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 139.356 | hit correction : 1.35705
hit initial : 79.2311 | hit correction : 1.35747
hit initial : 131.722 | hit correction : 1.35756
hit initial : 14.4689 | hit correction : 1.35825
hit initial : 41.212 | hit correction : 1.35843
hit initial : 36.7851 | hit correction : 1.35882
hit initial : 75.9489 | hit correction : 1.35899
hit initial : 32.4809 | hit correction : 1.35897
 *** Total Charge : 2577.9
 Looking at view: 1 | Number of hits in view: 20
hit initial : 45.3575 | hit correction : 1.36176
hit initial : 54.2936 | hit correction : 1.3618
hit initial : 40.1399 | hit correction : 1.35622
hit initial : 100.412 | hit correction : 1.35678
hit initial : 26.7118 | hit correction : 1.35681
hit initial : 125.987 | hit correction : 1.35303
hit initial : 175.762 | hit correction : 1.35293
hit initial : 208.796 | hit correction : 1.35372
hit initial : 221.954 | hit correction : 1.3537
hit initial : 175.992 | hit correction : 1.35331
hit initial : 347.654 | hit correction : 1.35427
hit initial : 465.883 | hit correction : 1.35493
hit initial : 247.924 | hit correction : 1.35543
hit initial : 195.284 | hit correction : 1.35604
hit initial : 167.053 | hit correction : 1.35655
hit initial : 177.305 | hit correction : 1.35705
hit initial : 203.757 | hit correction : 1.35748
hit initial : 177.506 | hit correction : 1.35796
hit initial : 173.63 | hit correction : 1.3585
hit initial : 139.092 | hit correction : 1.35896
hit initial : 31.6368 | hit correction : 1.35919
 *** Total Charge : 4747.84
 Looking at view: 2 | Number of hits in view: 21
Begin processing the 7th record. run: 5026 subRun: 0 event: 2077 at 06-Dec-2025 19:04:10 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  14
Added hit list length: 14 | Max was set to: -3.40282e+38
True Electron Energy: 16.6414
Completed MCParticle Loop
True Neutrino Energy: 19.9352
 Size of all hits: 14
hit initial : 72.3501 | hit correction : 1.40588
hit initial : 209.581 | hit correction : 1.40588
hit initial : 321.715 | hit correction : 1.40581
hit initial : 178.813 | hit correction : 1.40579
hit initial : 135.987 | hit correction : 1.40477
hit initial : 302.627 | hit correction : 1.40478
hit initial : 145.711 | hit correction : 1.4048
 *** Total Charge : 1920.85
 Looking at view: 0 | Number of hits in view: 7
hit initial : 117.75 | hit correction : 1.40591
hit initial : 342.283 | hit correction : 1.40588
hit initial : 321.739 | hit correction : 1.40576
hit initial : 225.409 | hit correction : 1.40532
hit initial : 190.821 | hit correction : 1.40486
hit initial : 153.853 | hit correction : 1.40454
hit initial : 64.5481 | hit correction : 1.40442
 *** Total Charge : 1990.64
 Looking at view: 1 | Number of hits in view: 7
Begin processing the 8th record. run: 5026 subRun: 0 event: 2078 at 06-Dec-2025 19:04:15 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 12.4396
Completed MCParticle Loop
True Neutrino Energy: 31.8647
 Size of all hits: 0
Begin processing the 9th record. run: 5026 subRun: 0 event: 2079 at 06-Dec-2025 19:04:21 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 2.42976
Completed MCParticle Loop
True Neutrino Energy: 7.93239
 Size of all hits: 0
Begin processing the 10th record. run: 5026 subRun: 0 event: 2080 at 06-Dec-2025 19:04:26 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
True Neutron Energy: 939.578
True Electron Energy: 5.83046
Completed MCParticle Loop
True Neutrino Energy: 11.2082
 Size of all hits: 0
06-Dec-2025 19:04:31 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          0.12696      0.157349       0.19124      0.159076      0.0173805       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000505344   0.000750943   0.00137644    0.000664399   0.000237258      10     
end_path:ana:AnalyzeEvents         0.126193      0.156293      0.189028      0.158113      0.0171042       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19467.1 MB
  Peak resident set size usage (VmHWM): 1525.96 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:09:13 UTC       justIN version: 01.06.00