Jobsub ID 266299.1@dunegpschedd01.fnal.gov

Jobsub ID	266299.1@dunegpschedd01.fnal.gov
Workflow ID	11118
Stage ID	1
User name	osbiston@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-12-10 21:01:21
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2025-12-11 11:11:59
From worker node	Hostname	dunegli-7872211-0-fnpc19112.fnal.gov
	cpuinfo	AMD EPYC 7502 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-12-11 09:06:48
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T233827Z_gen_004808_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	2h (7488s)
	CPU time	2h (7400s = 98%)
	Max RSS bytes	2822041600 (2691 MiB)
Outputting started	2025-12-11 11:11:36
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11118/1/001/analysisLowE_20251211T090649Z.root
Finished	2025-12-11 11:11:59
Saved logs	justin-logs:266299.1-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 10:08:21 UTC run: 5026 subRun: 0 event: 48071
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6322, 6269, 6573
minwire 0: 46
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2227, 2726
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0949008, 
Output 1: 0.180131, 0.0772079, 0.117304, 0.625357, 
Output 2: 0.125277, 0.221117, 0.628034, 0.0255721, 
Output 3: 0.967101, 0.0260044, 0.00160544, 0.00528959, 
Output 4: 0.590277, 0.370833, 0.0331659, 0.00572454, 
Output 5: 0.607311, 0.353324, 0.0312897, 0.00807454, 
Output 6: 0.0469554, 0.108785, 0.10228, 0.741979, 

11-Dec-2025 10:08:55 UTC  Opened output file with pattern "matt_reco2.root"
Begin processing the 2nd record. run: 5026 subRun: 0 event: 48072 at 11-Dec-2025 10:09:17 UTC
PandoraMonitoring::InitializeEve(): DISPLAY environment not set
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
The following module label is either not assigned to any path,
or it has been assigned to ignored path(s):
  out1
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v09_91_03d00/gdml/dunevd10kt_3view_30deg_v5_refactored_1x8x14ref.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Error: Unsupported GDML Tag Used :gdml_simple_extension. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :extension. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :color. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :color. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :color. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :color. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :color. Please Check Geometry/Schema.
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 462
Info in <TGeoManager::CloseGeometry>: 98051 nodes/ 598 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
%MSG-s ArtException:  AnalyzeEvents:ana@Construction 11-Dec-2025 11:11:36 UTC  ModuleConstruction
cet::exception caught in art
---- CatalogServiceError BEGIN
  Input file not found: matt_reco2.root.
---- CatalogServiceError END
%MSG
Art has completed and will exit with status 24.
=== End last 100 lines of lar log file ===
lar exit code 0