justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 40456.173@dunegpschedd02.fnal.gov

Jobsub ID40456.173@dunegpschedd02.fnal.gov
Workflow ID2663
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-09-16 16:25:13
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce15-multicore
Last heartbeat2025-09-16 16:47:54
From worker nodeHostnamehnode63.pic.es
cpuinfoAMD EPYC 7402P 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2025-09-16 16:46:15
Input filesehn1-beam-np04:H4_v34b_-1GeV_-27.7_005180_230344_58_20250626T174200.root
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-09-16 16:47:54
Saved logsjustin-logs:40456.173-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

adioGen" with seed 0.
%MSG
%MSG-i NuRandomService:  Decay0Gen:u238beam@Construction  16-Sep-2025 18:47:06 CEST ModuleConstruction
Seeding HepJamesRandom engine "u238beam:BaseRadioGen" with seed 495254499.
%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238beam@Construction 16-Sep-2025 18:47:06 CEST  ModuleConstruction BaseRadioGen.h:311
Calculating the volume of FR4 and the volume volEWBeam in the geometry.

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238beam@Construction 16-Sep-2025 18:47:06 CEST  ModuleConstruction BaseRadioGen.h:324
  Volume volEWBeam is an accepted volume of 4133.64cm^3.

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238beam@Construction 16-Sep-2025 18:47:06 CEST  ModuleConstruction BaseRadioGen.h:330
  It is a box of size 340.42 x 10.16 x 5.08 cm^3

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238beam@Construction 16-Sep-2025 18:47:06 CEST  ModuleConstruction BaseRadioGen.h:347
1 volumes correspond to the regex "volEWBeam".

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238beam@Construction 16-Sep-2025 18:47:06 CEST  ModuleConstruction BaseRadioGen.h:349
1 materials correspond to the regex "FR4".

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238beam@Construction 16-Sep-2025 18:47:06 CEST  ModuleConstruction BaseRadioGen.h:415
6 nodes (i.e. instance of the volumes) satisfy both the regexes.

%MSG
%MSG-i RANDOM:  Decay0Gen:u238cpa@Construction 16-Sep-2025 18:47:06 CEST  ModuleConstruction
Instantiated HepJamesRandom engine "u238cpa:0:BaseRadioGen" with seed 0.
%MSG
%MSG-i NuRandomService:  Decay0Gen:u238cpa@Construction  16-Sep-2025 18:47:06 CEST ModuleConstruction
Seeding HepJamesRandom engine "u238cpa:BaseRadioGen" with seed 95740518.
%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238cpa@Construction 16-Sep-2025 18:47:06 CEST  ModuleConstruction BaseRadioGen.h:311
Calculating the volume of .* and the volume .*Cathode.* in the geometry.

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238cpa@Construction 16-Sep-2025 18:47:06 CEST  ModuleConstruction BaseRadioGen.h:324
  Volume volCathode is an accepted volume of 46114.3cm^3.

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238cpa@Construction 16-Sep-2025 18:47:06 CEST  ModuleConstruction BaseRadioGen.h:330
  It is a box of size 0.3302 x 603.275 x 231.496 cm^3

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238cpa@Construction 16-Sep-2025 18:47:06 CEST  ModuleConstruction BaseRadioGen.h:347
1 volumes correspond to the regex ".*Cathode.*".

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238cpa@Construction 16-Sep-2025 18:47:06 CEST  ModuleConstruction BaseRadioGen.h:349
46 materials correspond to the regex ".*".

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238cpa@Construction 16-Sep-2025 18:47:06 CEST  ModuleConstruction BaseRadioGen.h:415
2 nodes (i.e. instance of the volumes) satisfy both the regexes.

%MSG
Number of overlays = 1249
%MSG-i H4Beam:  OpenFile 16-Sep-2025 18:47:06 CEST BeforeEvents H4BeamInput_source.cc:15
Opening Beam Input File root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/ehn1-beam-np04/ce/b9/H4_v34b_-1GeV_-27.7_005180_230344_58_20250626T174200.root
%MSG
Opening root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/ehn1-beam-np04/ce/b9/H4_v34b_-1GeV_-27.7_005180_230344_58_20250626T174200.root

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
[ No processed events ]
====================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 16-Sep-2025 18:47:08 CEST  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'random'
  master seed: 308129324
  seed within: [ 1 ; 900000000 ]
   Configured value          Last value   ModuleLabel.InstanceName
          573237776              (same)   ar39.BaseRadioGen
          795652387              (same)   ar42.BaseRadioGen
          148990037              (same)   co60apa.BaseRadioGen
          109611054              (same)   cosmicgenerator.gen
          765748872              (same)   cosmicgenerator.pois
           71795233              (same)   generator.protoDUNEBeam
          850413241              (same)   k40apaboards.BaseRadioGen
          317920475              (same)   k40beam.BaseRadioGen
          350109589              (same)   k40cpa.BaseRadioGen
          186669543              (same)   k42fromar42.BaseRadioGen
          644063978              (same)   kr85.BaseRadioGen
          391947139              (same)   th232apa.BaseRadioGen
           49478001              (same)   th232apaboards.BaseRadioGen
          500583015              (same)   th232beam.BaseRadioGen
          531537579              (same)   th232cpa.BaseRadioGen
           20118733              (same)   u238apa.BaseRadioGen
          298635363              (same)   u238apaboards.BaseRadioGen
          495254499              (same)   u238beam.BaseRadioGen
           95740518              (same)   u238cpa.BaseRadioGen

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1386.21 MB
  Peak resident set size usage (VmHWM): 773.579 MB
  Details saved in: 'mem.db'
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 0 passed = 0 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport          0          0          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1.012284 Real = 1.422220

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1386.21 VmHWM = 773.579

%MSG-s ArtException:  PostEndJob 16-Sep-2025 18:47:08 CEST ModuleEndJob
---- FatalRootError BEGIN
  Fatal Root Error: TNetXNGFile::Open
  [FATAL] Auth failed: No protocols left to try
  ROOT severity: 3000
---- FatalRootError END
%MSG
Art has completed and will exit with status 1.

Stderr:
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/6862534214c2d14e6efd2b5670af25f8bf3eae46/dunecore/v10_10_02d00/gdml/protodunehd_v6_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
registering to  primaryGeneratorActionsMap_
registering to   eventActionsMap_
registering to   trackingActionsMap_
registering to  steppingActionsMap_
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
59+1 records in
59+1 records out
31174656 bytes (31 MB) copied, 0.640671 s, 48.7 MB/s
3+1 records in
3+1 records out
1619968 bytes (1.6 MB) copied, 0.00684969 s, 237 MB/s
0+1 records in
0+1 records out
160768 bytes (161 kB) copied, 0.00113145 s, 142 MB/s
0+1 records in
0+1 records out
114688 bytes (115 kB) copied, 0.000646791 s, 177 MB/s
0+1 records in
0+1 records out
41984 bytes (42 kB) copied, 0.000452885 s, 92.7 MB/s

Error in processing gen
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/6862534214c2d14e6efd2b5670af25f8bf3eae46/dunecore/v10_10_02d00/gdml/protodunehd_v6_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
registering to  primaryGeneratorActionsMap_
registering to   eventActionsMap_
registering to   trackingActionsMap_
registering to  steppingActionsMap_
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
59+1 records in
59+1 records out
31174656 bytes (31 MB) copied, 0.640671 s, 48.7 MB/s
3+1 records in
3+1 records out
1619968 bytes (1.6 MB) copied, 0.00684969 s, 237 MB/s
0+1 records in
0+1 records out
160768 bytes (161 kB) copied, 0.00113145 s, 142 MB/s
0+1 records in
0+1 records out
114688 bytes (115 kB) copied, 0.000646791 s, 177 MB/s
0+1 records in
0+1 records out
41984 bytes (42 kB) copied, 0.000452885 s, 92.7 MB/s

Error running. Exiting with 1
justIN time: 2025-09-18 19:03:35 UTC       justIN version: 01.05.00