justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 40444.39@dunegpschedd02.fnal.gov

Jobsub ID40444.39@dunegpschedd02.fnal.gov
Workflow ID2662
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-09-16 16:17:09
SiteNL_SURFsara
EntryDUNE_SurfSARA_arc01
Last heartbeat2025-09-16 16:38:29
From worker nodeHostnamewn-lb-15.gina.surf.nl
cpuinfoAMD EPYC 9754 128-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2025-09-16 16:37:12
Input filesehn1-beam-np04:H4_v34b_-1GeV_-27.7_004916_418831_27_20250620T143940.root
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-09-16 16:38:29
Saved logsjustin-logs:40444.39-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

seRadioGen" with seed 0.
%MSG
%MSG-i NuRandomService:  Decay0Gen:u238beam@Construction  16-Sep-2025 18:37:58 CEST ModuleConstruction
Seeding HepJamesRandom engine "u238beam:BaseRadioGen" with seed 444983000.
%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238beam@Construction 16-Sep-2025 18:37:58 CEST  ModuleConstruction BaseRadioGen.h:311
Calculating the volume of FR4 and the volume volEWBeam in the geometry.

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238beam@Construction 16-Sep-2025 18:37:58 CEST  ModuleConstruction BaseRadioGen.h:324
  Volume volEWBeam is an accepted volume of 4133.64cm^3.

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238beam@Construction 16-Sep-2025 18:37:58 CEST  ModuleConstruction BaseRadioGen.h:330
  It is a box of size 340.42 x 10.16 x 5.08 cm^3

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238beam@Construction 16-Sep-2025 18:37:58 CEST  ModuleConstruction BaseRadioGen.h:347
1 volumes correspond to the regex "volEWBeam".

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238beam@Construction 16-Sep-2025 18:37:58 CEST  ModuleConstruction BaseRadioGen.h:349
1 materials correspond to the regex "FR4".

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238beam@Construction 16-Sep-2025 18:37:58 CEST  ModuleConstruction BaseRadioGen.h:415
6 nodes (i.e. instance of the volumes) satisfy both the regexes.

%MSG
%MSG-i RANDOM:  Decay0Gen:u238cpa@Construction 16-Sep-2025 18:37:58 CEST  ModuleConstruction
Instantiated HepJamesRandom engine "u238cpa:0:BaseRadioGen" with seed 0.
%MSG
%MSG-i NuRandomService:  Decay0Gen:u238cpa@Construction  16-Sep-2025 18:37:58 CEST ModuleConstruction
Seeding HepJamesRandom engine "u238cpa:BaseRadioGen" with seed 217471919.
%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238cpa@Construction 16-Sep-2025 18:37:58 CEST  ModuleConstruction BaseRadioGen.h:311
Calculating the volume of .* and the volume .*Cathode.* in the geometry.

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238cpa@Construction 16-Sep-2025 18:37:58 CEST  ModuleConstruction BaseRadioGen.h:324
  Volume volCathode is an accepted volume of 46114.3cm^3.

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238cpa@Construction 16-Sep-2025 18:37:58 CEST  ModuleConstruction BaseRadioGen.h:330
  It is a box of size 0.3302 x 603.275 x 231.496 cm^3

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238cpa@Construction 16-Sep-2025 18:37:58 CEST  ModuleConstruction BaseRadioGen.h:347
1 volumes correspond to the regex ".*Cathode.*".

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238cpa@Construction 16-Sep-2025 18:37:58 CEST  ModuleConstruction BaseRadioGen.h:349
46 materials correspond to the regex ".*".

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238cpa@Construction 16-Sep-2025 18:37:58 CEST  ModuleConstruction BaseRadioGen.h:415
2 nodes (i.e. instance of the volumes) satisfy both the regexes.

%MSG
Number of overlays = 1249
%MSG-i H4Beam:  OpenFile 16-Sep-2025 18:37:58 CEST BeforeEvents H4BeamInput_source.cc:15
Opening Beam Input File root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/ehn1-beam-np04/ab/10/H4_v34b_-1GeV_-27.7_004916_418831_27_20250620T143940.root
%MSG
Opening root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/ehn1-beam-np04/ab/10/H4_v34b_-1GeV_-27.7_004916_418831_27_20250620T143940.root

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
[ No processed events ]
====================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 16-Sep-2025 18:38:00 CEST  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'random'
  master seed: 389578614
  seed within: [ 1 ; 900000000 ]
   Configured value          Last value   ModuleLabel.InstanceName
          207704982              (same)   ar39.BaseRadioGen
          162955872              (same)   ar42.BaseRadioGen
          757690779              (same)   co60apa.BaseRadioGen
          356767028              (same)   cosmicgenerator.gen
          409097172              (same)   cosmicgenerator.pois
          527273934              (same)   generator.protoDUNEBeam
          301730989              (same)   k40apaboards.BaseRadioGen
          874691616              (same)   k40beam.BaseRadioGen
          342676170              (same)   k40cpa.BaseRadioGen
          880989760              (same)   k42fromar42.BaseRadioGen
          733172348              (same)   kr85.BaseRadioGen
          166477947              (same)   th232apa.BaseRadioGen
          897396608              (same)   th232apaboards.BaseRadioGen
          767137775              (same)   th232beam.BaseRadioGen
          866509661              (same)   th232cpa.BaseRadioGen
          267511893              (same)   u238apa.BaseRadioGen
          315370657              (same)   u238apaboards.BaseRadioGen
          444983000              (same)   u238beam.BaseRadioGen
          217471919              (same)   u238cpa.BaseRadioGen

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1386.2 MB
  Peak resident set size usage (VmHWM): 773.775 MB
  Details saved in: 'mem.db'
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 0 passed = 0 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport          0          0          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1.282228 Real = 1.595629

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1386.2 VmHWM = 773.775

%MSG-s ArtException:  PostEndJob 16-Sep-2025 18:38:00 CEST ModuleEndJob
---- FatalRootError BEGIN
  Fatal Root Error: TNetXNGFile::Open
  [FATAL] Auth failed: No protocols left to try
  ROOT severity: 3000
---- FatalRootError END
%MSG
Art has completed and will exit with status 1.

Stderr:
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/6862534214c2d14e6efd2b5670af25f8bf3eae46/dunecore/v10_10_02d00/gdml/protodunehd_v6_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
registering to  primaryGeneratorActionsMap_
registering to   eventActionsMap_
registering to   trackingActionsMap_
registering to  steppingActionsMap_
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
59+1 records in
59+1 records out
31199232 bytes (31 MB) copied, 0.192238 s, 162 MB/s
3+1 records in
3+1 records out
1669120 bytes (1.7 MB) copied, 0.00432818 s, 386 MB/s
0+1 records in
0+1 records out
149504 bytes (150 kB) copied, 0.00112192 s, 133 MB/s
0+1 records in
0+1 records out
136192 bytes (136 kB) copied, 0.000879845 s, 155 MB/s
0+1 records in
0+1 records out
43008 bytes (43 kB) copied, 0.000441851 s, 97.3 MB/s

Error in processing gen
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/6862534214c2d14e6efd2b5670af25f8bf3eae46/dunecore/v10_10_02d00/gdml/protodunehd_v6_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
registering to  primaryGeneratorActionsMap_
registering to   eventActionsMap_
registering to   trackingActionsMap_
registering to  steppingActionsMap_
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
59+1 records in
59+1 records out
31199232 bytes (31 MB) copied, 0.192238 s, 162 MB/s
3+1 records in
3+1 records out
1669120 bytes (1.7 MB) copied, 0.00432818 s, 386 MB/s
0+1 records in
0+1 records out
149504 bytes (150 kB) copied, 0.00112192 s, 133 MB/s
0+1 records in
0+1 records out
136192 bytes (136 kB) copied, 0.000879845 s, 155 MB/s
0+1 records in
0+1 records out
43008 bytes (43 kB) copied, 0.000441851 s, 97.3 MB/s

Error running. Exiting with 1
justIN time: 2025-09-18 19:20:56 UTC       justIN version: 01.05.00