justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 302126.0@dunegpschedd01.fnal.gov

Jobsub ID302126.0@dunegpschedd01.fnal.gov
Workflow ID12524
Stage ID1
User nameskar@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-29 14:20:01
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2026-01-29 14:32:54
From worker nodeHostnamedunegli-8320103-0-fnpc23018.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-29 14:32:18
Input fileshd-protodune-det-reco:np04hd_raw_run032672_0679_dataflow1_datawriter_0_20241106T043927_reco_stage1_reco_stage2_20241106T071024_keepup.root
JobscriptExit code0
Real time0m (29s)
CPU time0m (21s = 72%)
Max RSS bytes737402880 (703 MiB)
Outputting started2026-01-29 14:32:48
Output files
Finished2026-01-29 14:32:54
Saved logsjustin-logs:302126.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

FCL_FILE:/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393/test_larsoft/srcs/protoduneana/protoduneana/work/run_analyseEvents.fcl
INPUT_TAR_DIR_LOCAL:/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/e1bcd7f8f04d39aeb3b21a517a2e360e253f1393
total 5
drwxr-xr-x 6 65534 65534 4096 Oct 21 15:51 test_larsoft
/home/workspace
jobscript.log
Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/hd-protodune-det-reco/e8/6d/np04hd_raw_run032672_0679_dataflow1_datawriter_0_20241106T043927_reco_stage1_reco_stage2_20241106T071024_keepup.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/

ERROR: MRB_INSTALL is not defined - please source localProducts_XXX/setup

Current working directory:
/home/workspace
List files in working directory:
total 8
-rw-r--r-- 1 dunegli fnalgrid 278 Jan 29 14:32 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 889 Jan 29 14:32 jobscript.log
Output file will be: np04hd_raw_run032672_0679_dataflow1_datawriter_0_20241106T043927_reco_stage1_reco_stage2_20241106T071024_keepup_reco2_2026-01-29T_143230Z.root
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
%MSG-i MF_INIT_OK:  Early 29-Jan-2026 14:32:45 UTC JobSetup
Messagelogger initialization complete.
%MSG
%MSG-i PathConfiguration:  Early 29-Jan-2026 14:32:47 UTC JobSetup
Multiple end paths have been combined into one end path,
"end_path" since order is irrelevant.
%MSG
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v09_91_02d01/gdml/protodunehd_v6_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25608 nodes/ 5535 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
%MSG-i GeometryCore:  Early 29-Jan-2026 14:32:48 UTC JobSetup
New detector geometry loaded from 
	/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v09_91_02d01/gdml/protodunehd_v6_refactored.gdml
	/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v09_91_02d01/gdml/protodunehd_v6_refactored_nowires.gdml

%MSG
%MSG-i GeometryCore:  Early 29-Jan-2026 14:32:48 UTC JobSetup
Sorting volumes...
%MSG
%MSG-i DuneApaChannelMapAlg:  Early 29-Jan-2026 14:32:48 UTC JobSetup
Initializing channel map...
%MSG
Cryostat 0:
  10240 total channels
  4 APAs
  For all identical APA:
    Number of channels per APA = 2560
    U channels per APA = 800
    V channels per APA = 800
    Z channels per APA = 960
    Pitch in U Plane = 0.4669
    Pitch in V Plane = 0.4669
    Pitch in Z Plane = 0.4792
GeoApaChannelGroupService::ctor: Group 0 (apa0) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 1 (apa1) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 2 (apa2) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 3 (apa3) has 2560 channels from 4/4 readout planes.
%MSG-i SimpleChannelStatusService:  Early 29-Jan-2026 14:32:48 UTC JobSetup
Loaded from configuration:
  - 0 bad channels
  - 0 noisy channels
  - largest channel ID: 10239, largest present: 10239
%MSG
%MSG-i setupProvider<DetectorPropertiesStandard>:  Early  29-Jan-2026 14:32:48 UTC JobSetup
Asked to ignore 1 keys: 'InheritNumberTimeSamples'
%MSG
%MSG-i SignalShapingServiceDUNE:  Early 29-Jan-2026 14:32:48 UTC JobSetup
Getting Filter from .fcl file
%MSG
%MSG-i SignalShapingServiceDUNE:  Early 29-Jan-2026 14:32:48 UTC JobSetup
 using the field response provided from a .root file 
%MSG
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
%MSG-s ArtException:  RootOutput:out@Construction 29-Jan-2026 14:32:48 UTC  ModuleConstruction
cet::exception caught in art
---- Configuration BEGIN
  
  
  Module label: source
  module_type : RootInput
  
  Any parameters prefaced with '#' are optional.
  Missing parameters:
  
   -    fileNames: [
   -       <string>,
   -       ...
   -    ]
  
---- Configuration END
%MSG
Art has completed and will exit with status 9.
=== Start last 100 lines of lar log file ===
tail: cannot open 'np04hd_raw_run032672_0679_dataflow1_datawriter_0_20241106T043927_reco_stage1_reco_stage2_20241106T071024_keepup_ana_2026-01-29T_143230Z.log' for reading: No such file or directory
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-04 15:18:27 UTC       justIN version: 01.06.00