justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 40456.34@dunegpschedd02.fnal.gov

Jobsub ID40456.34@dunegpschedd02.fnal.gov
Workflow ID2663
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-09-16 16:25:13
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce16-multicore
Last heartbeat2025-09-16 16:44:44
From worker nodeHostnamehnode50.pic.es
cpuinfoAMD EPYC 7402P 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2025-09-16 16:43:52
Input filesehn1-beam-np04:H4_v34b_-1GeV_-27.7_001562_230344_114_20250626T173910.root
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-09-16 16:44:44
Saved logsjustin-logs:40456.34-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

oGen" with seed 0.
%MSG
%MSG-i NuRandomService:  Decay0Gen:u238beam@Construction  16-Sep-2025 18:44:23 CEST ModuleConstruction
Seeding HepJamesRandom engine "u238beam:BaseRadioGen" with seed 457332239.
%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238beam@Construction 16-Sep-2025 18:44:23 CEST  ModuleConstruction BaseRadioGen.h:311
Calculating the volume of FR4 and the volume volEWBeam in the geometry.

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238beam@Construction 16-Sep-2025 18:44:23 CEST  ModuleConstruction BaseRadioGen.h:324
  Volume volEWBeam is an accepted volume of 4133.64cm^3.

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238beam@Construction 16-Sep-2025 18:44:23 CEST  ModuleConstruction BaseRadioGen.h:330
  It is a box of size 340.42 x 10.16 x 5.08 cm^3

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238beam@Construction 16-Sep-2025 18:44:23 CEST  ModuleConstruction BaseRadioGen.h:347
1 volumes correspond to the regex "volEWBeam".

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238beam@Construction 16-Sep-2025 18:44:23 CEST  ModuleConstruction BaseRadioGen.h:349
1 materials correspond to the regex "FR4".

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238beam@Construction 16-Sep-2025 18:44:23 CEST  ModuleConstruction BaseRadioGen.h:415
6 nodes (i.e. instance of the volumes) satisfy both the regexes.

%MSG
%MSG-i RANDOM:  Decay0Gen:u238cpa@Construction 16-Sep-2025 18:44:23 CEST  ModuleConstruction
Instantiated HepJamesRandom engine "u238cpa:0:BaseRadioGen" with seed 0.
%MSG
%MSG-i NuRandomService:  Decay0Gen:u238cpa@Construction  16-Sep-2025 18:44:23 CEST ModuleConstruction
Seeding HepJamesRandom engine "u238cpa:BaseRadioGen" with seed 538959857.
%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238cpa@Construction 16-Sep-2025 18:44:23 CEST  ModuleConstruction BaseRadioGen.h:311
Calculating the volume of .* and the volume .*Cathode.* in the geometry.

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238cpa@Construction 16-Sep-2025 18:44:23 CEST  ModuleConstruction BaseRadioGen.h:324
  Volume volCathode is an accepted volume of 46114.3cm^3.

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238cpa@Construction 16-Sep-2025 18:44:23 CEST  ModuleConstruction BaseRadioGen.h:330
  It is a box of size 0.3302 x 603.275 x 231.496 cm^3

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238cpa@Construction 16-Sep-2025 18:44:23 CEST  ModuleConstruction BaseRadioGen.h:347
1 volumes correspond to the regex ".*Cathode.*".

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238cpa@Construction 16-Sep-2025 18:44:23 CEST  ModuleConstruction BaseRadioGen.h:349
46 materials correspond to the regex ".*".

%MSG
%MSG-i BaseRadioGen:  Decay0Gen:u238cpa@Construction 16-Sep-2025 18:44:23 CEST  ModuleConstruction BaseRadioGen.h:415
2 nodes (i.e. instance of the volumes) satisfy both the regexes.

%MSG
Number of overlays = 1249
%MSG-i H4Beam:  OpenFile 16-Sep-2025 18:44:24 CEST BeforeEvents H4BeamInput_source.cc:15
Opening Beam Input File root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/ehn1-beam-np04/ce/1e/H4_v34b_-1GeV_-27.7_001562_230344_114_20250626T173910.root
%MSG
Opening root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/ehn1-beam-np04/ce/1e/H4_v34b_-1GeV_-27.7_001562_230344_114_20250626T173910.root

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
[ No processed events ]
====================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 16-Sep-2025 18:44:26 CEST  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'random'
  master seed: 863836949
  seed within: [ 1 ; 900000000 ]
   Configured value          Last value   ModuleLabel.InstanceName
          759074062              (same)   ar39.BaseRadioGen
          631146627              (same)   ar42.BaseRadioGen
          185885633              (same)   co60apa.BaseRadioGen
          664860866              (same)   cosmicgenerator.gen
          508073242              (same)   cosmicgenerator.pois
          791989419              (same)   generator.protoDUNEBeam
          862512624              (same)   k40apaboards.BaseRadioGen
          735045915              (same)   k40beam.BaseRadioGen
          517005634              (same)   k40cpa.BaseRadioGen
          594854876              (same)   k42fromar42.BaseRadioGen
          115782324              (same)   kr85.BaseRadioGen
          333326883              (same)   th232apa.BaseRadioGen
          513820978              (same)   th232apaboards.BaseRadioGen
          757432659              (same)   th232beam.BaseRadioGen
          284019916              (same)   th232cpa.BaseRadioGen
          740314351              (same)   u238apa.BaseRadioGen
          560887535              (same)   u238apaboards.BaseRadioGen
          457332239              (same)   u238beam.BaseRadioGen
          538959857              (same)   u238cpa.BaseRadioGen

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1386.21 MB
  Peak resident set size usage (VmHWM): 773.882 MB
  Details saved in: 'mem.db'
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 0 passed = 0 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport          0          0          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1.584162 Real = 2.023087

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1386.21 VmHWM = 773.882

%MSG-s ArtException:  PostEndJob 16-Sep-2025 18:44:26 CEST ModuleEndJob
---- FatalRootError BEGIN
  Fatal Root Error: TNetXNGFile::Open
  [FATAL] Auth failed: No protocols left to try
  ROOT severity: 3000
---- FatalRootError END
%MSG
Art has completed and will exit with status 1.

Stderr:
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/6862534214c2d14e6efd2b5670af25f8bf3eae46/dunecore/v10_10_02d00/gdml/protodunehd_v6_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
registering to  primaryGeneratorActionsMap_
registering to   eventActionsMap_
registering to   trackingActionsMap_
registering to  steppingActionsMap_
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
59+1 records in
59+1 records out
31190016 bytes (31 MB) copied, 0.618799 s, 50.4 MB/s
3+1 records in
3+1 records out
1630208 bytes (1.6 MB) copied, 0.00378469 s, 431 MB/s
0+1 records in
0+1 records out
182272 bytes (182 kB) copied, 0.000909467 s, 200 MB/s
0+1 records in
0+1 records out
120832 bytes (121 kB) copied, 0.000712371 s, 170 MB/s
0+1 records in
0+1 records out
45056 bytes (45 kB) copied, 0.000400022 s, 113 MB/s

Error in processing gen
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/6862534214c2d14e6efd2b5670af25f8bf3eae46/dunecore/v10_10_02d00/gdml/protodunehd_v6_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
registering to  primaryGeneratorActionsMap_
registering to   eventActionsMap_
registering to   trackingActionsMap_
registering to  steppingActionsMap_
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
59+1 records in
59+1 records out
31190016 bytes (31 MB) copied, 0.618799 s, 50.4 MB/s
3+1 records in
3+1 records out
1630208 bytes (1.6 MB) copied, 0.00378469 s, 431 MB/s
0+1 records in
0+1 records out
182272 bytes (182 kB) copied, 0.000909467 s, 200 MB/s
0+1 records in
0+1 records out
120832 bytes (121 kB) copied, 0.000712371 s, 170 MB/s
0+1 records in
0+1 records out
45056 bytes (45 kB) copied, 0.000400022 s, 113 MB/s

Error running. Exiting with 1
justIN time: 2025-09-18 23:31:05 UTC       justIN version: 01.05.00