justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 260497.0@dunegpschedd02.fnal.gov

Jobsub ID260497.0@dunegpschedd02.fnal.gov
Workflow ID11118
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-10 20:07:19
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-11 10:25:02
From worker nodeHostnamedunegli-7872681-0-fnpc9002.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 09:06:24
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T202609Z_gen_002834_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time1h (4682s)
CPU time1h (4388s = 93%)
Max RSS bytes2832613376 (2701 MiB)
Outputting started2025-12-11 10:24:27
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11118/1/001/analysisLowE_20251211T090625Z.root
Finished2025-12-11 10:25:02
Saved logsjustin-logs:260497.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  11-Dec-2025 09:49:22 UTC run: 5026 subRun: 0 event: 28331
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6713, 6693, 6732
minwire 0: 102
minwire 1: 1
minwire 2: 3
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1356, 1855
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.144783, 
Output 1: 0.125021, 0.102945, 0.175566, 0.596468, 
Output 2: 0.0556274, 0.213175, 0.687541, 0.0436565, 
Output 3: 0.965301, 0.0141307, 0.00458688, 0.0159818, 
Output 4: 0.663361, 0.305052, 0.0278208, 0.00376632, 
Output 5: 0.436537, 0.398891, 0.130514, 0.0340573, 
Output 6: 0.0281789, 0.0626575, 0.0709851, 0.838179, 

11-Dec-2025 09:50:21 UTC  Opened output file with pattern "matt_reco2.root"
Begin processing the 2nd record. run: 5026 subRun: 0 event: 28332 at 11-Dec-2025 09:51:16 UTC
PandoraMonitoring::InitializeEve(): DISPLAY environment not set
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
The following module label is either not assigned to any path,
or it has been assigned to ignored path(s):
  out1
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v09_91_03d00/gdml/dunevd10kt_3view_30deg_v5_refactored_1x8x14ref.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Error: Unsupported GDML Tag Used :gdml_simple_extension. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :extension. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :color. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :color. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :color. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :color. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :color. Please Check Geometry/Schema.
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 462
Info in <TGeoManager::CloseGeometry>: 98051 nodes/ 598 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
%MSG-s ArtException:  AnalyzeEvents:ana@Construction 11-Dec-2025 10:24:26 UTC  ModuleConstruction
cet::exception caught in art
---- CatalogServiceError BEGIN
  Input file not found: matt_reco2.root.
---- CatalogServiceError END
%MSG
Art has completed and will exit with status 24.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 14:59:41 UTC       justIN version: 01.06.00