Jobsub ID 266280.0@dunegpschedd01.fnal.gov

Jobsub ID	266280.0@dunegpschedd01.fnal.gov
Workflow ID	11118
Stage ID	1
User name	osbiston@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-12-10 20:15:19
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2025-12-11 10:11:13
From worker node	Hostname	dunegli-7867978-0-fnpc22001.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-12-11 09:05:15
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T171739Z_gen_001019_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	1h (3934s)
	CPU time	1h (3835s = 97%)
	Max RSS bytes	2853806080 (2721 MiB)
Outputting started	2025-12-11 10:10:50
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11118/1/001/analysisLowE_20251211T090516Z.root
Finished	2025-12-11 10:11:13
Saved logs	justin-logs:266280.0-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

xPreload.so
=== Start last 100 lines of lar log file ===
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:39:00 UTC run: 5026 subRun: 0 event: 10181
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6638, 6471, 6526
minwire 0: 29
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.132616, 
Output 1: 0.108463, 0.0753486, 0.115161, 0.701028, 
Output 2: 0.108528, 0.250214, 0.607205, 0.0340536, 
Output 3: 0.976644, 0.0153119, 0.00150586, 0.00653815, 
Output 4: 0.536672, 0.427012, 0.0324471, 0.00386941, 
Output 5: 0.456812, 0.470477, 0.060384, 0.0123268, 
Output 6: 0.0238301, 0.0630446, 0.0780961, 0.835029, 

11-Dec-2025 09:39:30 UTC  Opened output file with pattern "matt_reco2.root"
Begin processing the 2nd record. run: 5026 subRun: 0 event: 10182 at 11-Dec-2025 09:40:02 UTC
PandoraMonitoring::InitializeEve(): DISPLAY environment not set
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
The following module label is either not assigned to any path,
or it has been assigned to ignored path(s):
  out1
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v09_91_03d00/gdml/dunevd10kt_3view_30deg_v5_refactored_1x8x14ref.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Error: Unsupported GDML Tag Used :gdml_simple_extension. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :extension. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :color. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :color. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :color. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :color. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :color. Please Check Geometry/Schema.
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 462
Info in <TGeoManager::CloseGeometry>: 98051 nodes/ 598 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
%MSG-s ArtException:  AnalyzeEvents:ana@Construction 11-Dec-2025 10:10:49 UTC  ModuleConstruction
cet::exception caught in art
---- CatalogServiceError BEGIN
  Input file not found: matt_reco2.root.
---- CatalogServiceError END
%MSG
Art has completed and will exit with status 24.
=== End last 100 lines of lar log file ===
lar exit code 0