justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267852.4@dunegpschedd01.fnal.gov

Jobsub ID267852.4@dunegpschedd01.fnal.gov
Workflow ID11177
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-13 06:56:20
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-13 20:44:03
From worker nodeHostnamedunegli-7890498-0-fnpc18005.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-13 06:57:31
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T181721Z_gen_001492_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time13h (49574s)
CPU time12h (46622s = 94%)
Max RSS bytes2785710080 (2656 MiB)
Outputting started2025-12-13 20:43:46
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11177/1/001/analysisLowE_20251213T065734Z.root
Finished2025-12-13 20:44:03
Saved logsjustin-logs:267852.4-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

PtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 20:42:31 UTC run: 5026 subRun: 0 event: 14920
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 20:42:31 UTC run: 5026 subRun: 0 event: 14920
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6718, 6651, 6632
minwire 0: 39
minwire 1: 1
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1086, 1585
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0940651, 
Output 1: 0.0758472, 0.04954, 0.11836, 0.756253, 
Output 2: 0.0716297, 0.260093, 0.629023, 0.0392538, 
Output 3: 0.930207, 0.0487025, 0.00914545, 0.011945, 
Output 4: 0.55738, 0.372835, 0.0614046, 0.00838025, 
Output 5: 0.664082, 0.277542, 0.0485097, 0.00986594, 
Output 6: 0.0225154, 0.0603251, 0.0729799, 0.844179, 

13-Dec-2025 20:42:35 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 20:42:35 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/0c/94/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T181721Z_gen_001492_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2727.2        4878.73       8158.79       4469.63       1810.33        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.001383     0.00902754     0.0448109    0.00275164     0.0136046       10     
reco:pandora:StandardPandora                            2724.6        4833.88       8074.23       4399.88       1782.86        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000819845    0.131905      0.334699      0.120376      0.0849055       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00166119     0.0201725     0.149193     0.00587838     0.043117        10     
reco:pandoracalo:Calorimetry                          0.000455077   0.00460461     0.0366715    0.000954277    0.0107003       10     
reco:pandorapid:Chi2ParticleID                        0.000146436   0.00204838     0.016301     0.00019393    0.00480432       10     
reco:cvnmap:CVNMapper                                  0.0791685     0.158753      0.338651      0.130103      0.0774174       10     
reco:cvneva:CVNEvaluator                                1.9456        4.04855       17.6552       2.33022       4.58015        10     
reco:energyrecnumu:EnergyReco                          0.0936573      39.7908       73.2675       61.951        32.5708        10     
reco:energyrecnue:EnergyReco                          0.00181203    0.00510595     0.0177179    0.00323117    0.00460398       10     
reco:energyrecnc:EnergyReco                            0.0102926     0.016915      0.029087      0.012037     0.00707671       10     
[art]:TriggerResults:TriggerResultInserter            2.2472e-05    7.15786e-05   0.000289394   4.10575e-05   7.81059e-05      10     
end_path:out1:RootOutput                              1.2103e-05    2.47166e-05   7.8628e-05    1.7613e-05    1.92439e-05      10     
end_path:out1:RootOutput(write)                        0.385048      0.667407       1.38333       0.54006      0.315313        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21572.8 MB
  Peak resident set size usage (VmHWM): 2785.71 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 59.8935 | hit correction : 1.18923
hit initial : 16.7992 | hit correction : 1.18373
hit initial : 131.594 | hit correction : 1.18419
hit initial : 33.768 | hit correction : 1.18424
hit initial : 294.164 | hit correction : 1.18367
hit initial : 207.799 | hit correction : 1.18394
hit initial : 173.461 | hit correction : 1.18369
 *** Total Charge : 1110.53
 Looking at view: 2 | Number of hits in view: 8
Begin processing the 10th record. run: 5026 subRun: 0 event: 14920 at 13-Dec-2025 20:43:41 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  6
This pfp has size:  51
Added hit list length: 51 | Max was set to: -3.40282e+38
This pfp has size:  8
This pfp has size:  7
This pfp has size:  6
True Neutron Energy: 939.571
True Neutron Energy: 944.974
True Neutron Energy: 941.581
True Neutron Energy: 939.739
True Electron Energy: 41.8362
Completed MCParticle Loop
True Neutrino Energy: 56.4177
 Size of all hits: 51
hit initial : 54.278 | hit correction : 1.37685
hit initial : 94.288 | hit correction : 1.37687
hit initial : 29.35 | hit correction : 1.37681
hit initial : 33.0989 | hit correction : 1.38384
hit initial : 34.6616 | hit correction : 1.37946
hit initial : 41.5533 | hit correction : 1.38474
hit initial : 228.621 | hit correction : 1.38479
hit initial : 660.62 | hit correction : 1.38502
hit initial : 1069.54 | hit correction : 1.3852
hit initial : 989.349 | hit correction : 1.3855
hit initial : 461.378 | hit correction : 1.38611
hit initial : 116.832 | hit correction : 1.38676
 *** Total Charge : 5281.5
 Looking at view: 0 | Number of hits in view: 12
hit initial : 58.7188 | hit correction : 1.37684
hit initial : 82.055 | hit correction : 1.37682
hit initial : 31.9631 | hit correction : 1.37684
hit initial : 16.2365 | hit correction : 1.3838
hit initial : 33.5056 | hit correction : 1.38384
hit initial : 25.7992 | hit correction : 1.37937
hit initial : 30.4355 | hit correction : 1.37941
hit initial : 469.859 | hit correction : 1.38519
hit initial : 134.217 | hit correction : 1.3852
hit initial : 732.637 | hit correction : 1.3851
hit initial : 339.277 | hit correction : 1.38519
hit initial : 746.851 | hit correction : 1.3851
hit initial : 470.588 | hit correction : 1.38538
hit initial : 368.695 | hit correction : 1.38604
hit initial : 271.867 | hit correction : 1.38653
hit initial : 85.0898 | hit correction : 1.38683
 *** Total Charge : 5398.12
 Looking at view: 1 | Number of hits in view: 16
hit initial : 34.2216 | hit correction : 1.3767
hit initial : 63.7123 | hit correction : 1.37686
hit initial : 92.8272 | hit correction : 1.37682
hit initial : 38.9702 | hit correction : 1.38389
hit initial : 32.0366 | hit correction : 1.38387
hit initial : 31.5279 | hit correction : 1.38528
hit initial : 280.159 | hit correction : 1.3848
hit initial : 201.776 | hit correction : 1.38527
hit initial : 219.666 | hit correction : 1.38496
hit initial : 263.647 | hit correction : 1.38479
hit initial : 224.704 | hit correction : 1.38516
hit initial : 512.49 | hit correction : 1.38529
hit initial : 421.51 | hit correction : 1.38516
hit initial : 296.611 | hit correction : 1.38527
hit initial : 178.846 | hit correction : 1.38542
hit initial : 133.878 | hit correction : 1.38595
hit initial : 118.427 | hit correction : 1.38563
hit initial : 126.32 | hit correction : 1.38585
hit initial : 148.963 | hit correction : 1.38608
hit initial : 138.377 | hit correction : 1.38629
hit initial : 114.277 | hit correction : 1.38658
hit initial : 115.645 | hit correction : 1.38683
hit initial : 69.5281 | hit correction : 1.38702
 *** Total Charge : 5343.39
 Looking at view: 2 | Number of hits in view: 23
13-Dec-2025 20:43:45 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.112987      0.124644       0.1574       0.117402      0.014706        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000584902   0.000847045   0.00222358    0.000680863   0.000467338      10     
end_path:ana:AnalyzeEvents         0.112097      0.123459      0.154213      0.116431      0.0141874       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19475 MB
  Peak resident set size usage (VmHWM): 1533.59 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 12:12:33 UTC       justIN version: 01.06.00