Jobsub ID 292990.0@dunegpschedd02.fnal.gov
Jobscript log (last 10,000 characters)
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
File: '/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/f3fb0c7c73c8990d5e18519129d26414d5ae346f'
Size: 4096 Blocks: 9 IO Block: 4096 directory
Device: ffh/255d Inode: 22530233 Links: 5
Access: (0755/drwxr-xr-x) Uid: (65534/ UNKNOWN) Gid: (65534/ UNKNOWN)
Context: system_u:object_r:fusefs_t:s0
Access: 2026-01-12 07:10:47.000000000 -0800
Modify: 2026-01-12 07:10:47.000000000 -0800
Change: 2026-01-12 07:10:47.000000000 -0800
Birth: -
Set dunesw to /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/f3fb0c7c73c8990d5e18519129d26414d5ae346f
Will use justin-get-file
pfn: root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/hd-protodune-det-reco/be/97/np04hd_raw_run027306_0003_dataflow3_datawriter_0_20240619T175630_reco_stage1_reco_stage2_20240926T175235_keepup.root
did: hd-protodune-det-reco:np04hd_raw_run027306_0003_dataflow3_datawriter_0_20240619T175630_reco_stage1_reco_stage2_20240926T175235_keepup.root
%MSG-i MF_INIT_OK: Early 21-Jan-2026 11:23:00 PST JobSetup
Messagelogger initialization complete.
%MSG
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_10_02d00/gdml/dune10kt_v6_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Error: Unsupported GDML Tag Used :gdml_simple_extension. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :extension. Please Check Geometry/Schema.
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 9704
Info in <TGeoManager::CloseGeometry>: 844009 nodes/ 12339 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
%MSG-i AuxDetGeometryCore: Early 21-Jan-2026 11:23:04 PST JobSetup
New detector geometry loaded from
/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_10_02d00/gdml/dune10kt_v6_refactored.gdml
%MSG
%MSG-i GeometryCore: Early 21-Jan-2026 11:23:04 PST JobSetup
Sorting volumes...
%MSG
%MSG-i GeometryCore: Early 21-Jan-2026 11:23:04 PST JobSetup
New detector geometry loaded from
/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_10_02d00/gdml/protodunehd_v6_refactored.gdml
%MSG
%MSG-i DuneApaWireReadoutGeom: Early 21-Jan-2026 11:23:05 PST JobSetup
Initializing wire readout...
%MSG
Cryostat 0:
384000 total channels
150 APAs
For all identical APA:
Number of channels per APA = 2560
U channels per APA = 800
V channels per APA = 800
Z channels per APA = 960
Pitch in U Plane = 0.4667
Pitch in V Plane = 0.4667
Pitch in Z Plane = 0.479
%MSG-i SimpleChannelStatusService: Early 21-Jan-2026 11:23:05 PST JobSetup
Loaded from configuration:
- 0 bad channels
- 0 noisy channels
- largest channel ID: 383999, largest present: 383999
%MSG
%MSG-i setupProvider<DetectorPropertiesStandard>: Early 21-Jan-2026 11:23:05 PST JobSetup
Asked to ignore 1 keys: 'InheritNumberTimeSamples'
%MSG
%MSG-i LArG4DetectorService::Ctr: Early 21-Jan-2026 11:23:05 PST JobSetup
Reading stepLimit(s) from the configuration file, for volume(s):
%MSG
%MSG-i LArG4DetectorService::Ctr: Early 21-Jan-2026 11:23:05 PST JobSetup
Volume: volTPCActiveInner0, stepLimit: 0.4
%MSG
%MSG-i LArG4DetectorService::Ctr: Early 21-Jan-2026 11:23:05 PST JobSetup
Volume: volTPCActiveInner1, stepLimit: 0.4
%MSG
%MSG-i LArG4DetectorService::Ctr: Early 21-Jan-2026 11:23:05 PST JobSetup
Volume: volTPCActiveOuter, stepLimit: 0.4
%MSG
registering to primaryGeneratorActionsMap_
registering to eventActionsMap_
registering to trackingActionsMap_
registering to steppingActionsMap_
%MSG-i ParticleListActionService: Early 21-Jan-2026 11:23:05 PST JobSetup
The full tracking information will not be stored for particles resulting from the following processes:
{ "conv" "LowEnConversion" "Pair" "compt" "Compt" "Brem" "phot" "Photo" "Ion" "annihil" }
%MSG
%MSG-i ParticleListActionService: Early 21-Jan-2026 11:23:05 PST JobSetup
Trajectory sparsification enabled with SparsifyMargin : 0.015
%MSG
%MSG-i SignalShapingServiceDUNE: Early 21-Jan-2026 11:23:05 PST JobSetup
Getting Filter from .fcl file
%MSG
%MSG-i SignalShapingServiceDUNE: Early 21-Jan-2026 11:23:05 PST JobSetup
using the field response provided from a .root file
%MSG
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
21-Jan-2026 11:23:07 PST Initiating request to open input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/hd-protodune-det-reco/be/97/np04hd_raw_run027306_0003_dataflow3_datawriter_0_20240619T175630_reco_stage1_reco_stage2_20240926T175235_keepup.root"
21-Jan-2026 11:23:12 PST Opened input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/hd-protodune-det-reco/be/97/np04hd_raw_run027306_0003_dataflow3_datawriter_0_20240619T175630_reco_stage1_reco_stage2_20240926T175235_keepup.root"
Begin processing the 1st record. run: 27306 subRun: 1 event: 431 at 21-Jan-2026 11:23:13 PST
21-Jan-2026 11:23:14 PST Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/hd-protodune-det-reco/be/97/np04hd_raw_run027306_0003_dataflow3_datawriter_0_20240619T175630_reco_stage1_reco_stage2_20240926T175235_keepup.root"
%MSG-i NuRandomService: CalibAnaTree:calibana@EndJob 21-Jan-2026 11:23:14 PST ModuleEndJob
Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
algorithm version: EventTimestamp_v1
%MSG
TrigReport ---------- Event summary -------------
TrigReport Events total = 1 passed = 1 failed = 0
TrigReport ---------- Modules in End-path ----------
TrigReport Run Success Error Name
TrigReport 1 0 1 calibana
TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 0.043463 Real = 0.849913
MemReport ---------- Memory summary [base-10 MB] ------
MemReport VmPeak = 1664.29 VmHWM = 831.877
%MSG-s ArtException: PostEndJob 21-Jan-2026 11:23:14 PST ModuleEndJob
---- EventProcessorFailure BEGIN
EventProcessor: an exception occurred during current event processing
---- EventProcessorFailure BEGIN
EndPathExecutor: an exception occurred during current event processing
---- ScheduleExecutionFailure BEGIN
Path: ProcessingStopped.
---- ProductNotFound BEGIN
Found zero products matching all selection criteria
C++ type: std::vector<recob::Hit>
Module label: 'hitpdune'
Product instance name: ''
Process name: (empty)
The above exception was thrown while processing module CalibAnaTree/calibana run: 27306 subRun: 1 event: 431
---- ProductNotFound END
Exception going through path end_path
---- ScheduleExecutionFailure END
---- EventProcessorFailure END
---- EventProcessorFailure END
%MSG
Art has completed and will exit with status 1.
Error running. Exiting with 1 