justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 40558.2@dunegpschedd02.fnal.gov

Jobsub ID40558.2@dunegpschedd02.fnal.gov
Workflow ID2461
Stage ID1
User namepgranger@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-16 18:36:15
SiteNL_SURFsara
EntryDUNE_SurfSARA_arc01
Last heartbeat2025-09-16 18:39:23
From worker nodeHostnamewn-lb-03.gina.surf.nl
cpuinfoAMD EPYC 9754 128-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2025-09-16 18:37:32
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574782_785_20231203T110556Z_gen_g4_detsim_hitreco__20240509T201115Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66004350_287_20231202T160711Z_gen_g4_detsim_hitreco__20240508T040343Z_reco2.root
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-09-16 18:39:23
Saved logsjustin-logs:40558.2-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
total 4.0K
-rw-r--r--. 1 dune003 dune 141 Sep 16 20:37 jobscript.log
Justin processors: 1
Will use justin-get-file
No files available from this stage
Could not get file
No files available from this stage
Could not get file
No files available from this stage
Could not get file
No files available from this stage
Could not get file
No files available from this stage
Could not get file
No files available from this stage
Could not get file
No files available from this stage
Could not get file
No files available from this stage
Could not get file
now run lar on these files
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/91/3c/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574782_785_20231203T110556Z_gen_g4_detsim_hitreco__20240509T201115Z_reco2.root
root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/57/be/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66004350_287_20231202T160711Z_gen_g4_detsim_hitreco__20240508T040343Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574782_785_20231203T110556Z_gen_g4_detsim_hitreco__20240509T201115Z_reco2.root
fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66004350_287_20231202T160711Z_gen_g4_detsim_hitreco__20240508T040343Z_reco2.root
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
  blurredcluster
  caldata
  emshower
  emtrkmichelid
  gaushit
  hitfd
  linecluster
  pmtrack
  pmtrackcalo
  pmtrackpid
  pmtracktc
  pmtracktccalo
  pmtracktcpid
  pmtrajfit
  pmtrajfitcalo
  pmtrajfitpid
  pmtrajfittc
  pmtrajfittccalo
  pmtrajfittcpid
  solarflash
  spsolve
  trajcluster
  trkshowersplit
  wclsmcnfsp
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_10_00d00/gdml/dune10kt_v6_refactored_1x2x6.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1149
Info in <TGeoManager::CloseGeometry>: 67545 nodes/ 5439 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
16-Sep-2025 20:38:44 CEST  Initiating request to open input file "root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/91/3c/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574782_785_20231203T110556Z_gen_g4_detsim_hitreco__20240509T201115Z_reco2.root"
%MSG-s ArtException:  TriggerResultInserter:TriggerResults@Construction  16-Sep-2025 20:38:45 CEST ModuleConstruction
cet::exception caught in art
---- FileOpenError BEGIN
  RootInputFileSequence::initFile(): Input file root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/91/3c/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574782_785_20231203T110556Z_gen_g4_detsim_hitreco__20240509T201115Z_reco2.root was not found or could not be opened.
---- FileOpenError END
%MSG
lar exit code 20
=== Start last 100 lines of lar log file ===
tail: cannot open '_20250916T183747Z.log' for reading: No such file or directory
=== End last 100 lines of lar log file ===
processed files
root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/91/3c/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50574782_785_20231203T110556Z_gen_g4_detsim_hitreco__20240509T201115Z_reco2.root
root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/57/be/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66004350_287_20231202T160711Z_gen_g4_detsim_hitreco__20240508T040343Z_reco2.root
.:
total 64
-rw-r--r--. 1 dune003 dune 14566 Sep 16 20:38 caf_20250916T183747Z.log
-rw-r--r--. 1 dune003 dune  4407 Sep 16 20:38 jobscript.log
-rw-r--r--. 1 dune003 dune   519 Sep 16 20:38 caf.root
-rw-r--r--. 1 dune003 dune   519 Sep 16 20:38 caf_fd_hd_atmo_2461_20250916T183747Z.root
-rw-r--r--. 1 dune003 dune   411 Sep 16 20:38 flatcaf.root
-rw-r--r--. 1 dune003 dune   406 Sep 16 20:38 caf_20250916T183747Z.file
-rw-r--r--. 1 dune003 dune   406 Sep 16 20:38 caf_20250916T183747Z.pfns
-rw-r--r--. 1 dune003 dune   406 Sep 16 20:37 file.list
-rw-r--r--. 1 dune003 dune   406 Sep 16 20:38 justin-processed-pfns.txt
-rw-r--r--. 1 dune003 dune   276 Sep 16 20:37 all-input-dids.txt
-rw-r--r--. 1 dune003 dune   276 Sep 16 20:38 caf_20250916T183747Z.did
-rw-r--r--. 1 dune003 dune   276 Sep 16 20:37 did.list
-rw-r--r--. 1 dune003 dune     0 Sep 16 20:38 debugprod.log
justIN time: 2025-09-18 23:59:28 UTC       justIN version: 01.05.00