Jobsub ID 296356.1@dunegpschedd02.fnal.gov
| Jobsub ID | 296356.1@dunegpschedd02.fnal.gov |
| Workflow ID | 12478 |
| Stage ID | 1 |
| User name | nivedpm@fnal.gov |
| Requested | Processors | 4 |
| GPU | No |
| RSS bytes | 6815744000 (6500 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2026-01-28 15:32:49 |
| Site | UK_Imperial |
| Entry | DUNE_T2_UK_London_IC_ceprod00 |
| Last heartbeat | 2026-01-28 15:37:36 |
| From worker node | Hostname | wm18.grid.hep.ph.ic.ac.uk |
| cpuinfo | AMD EPYC 7742 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 4 |
| RSS bytes | 7864320000 (7500 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-28 15:34:39 |
| Input files | monte-carlo-012478-000147
|
| Jobscript | Exit code | 0 |
| Real time | 2m (140s) |
| CPU time | 0m (59s = 42%) |
| Max RSS bytes | 762232832 (726 MiB) |
| Outputting started | 2026-01-28 15:37:00 |
| Output files | |
| Finished | 2026-01-28 15:37:36 |
| Saved logs | justin-logs:296356.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
in the specified volume volCryostat.
%MSG
%MSG-i BaseRadioGen: Decay0Gen:ar39@Construction 28-Jan-2026 15:36:02 GMT ModuleConstruction BaseRadioGen.h:467
There is 93.4501% (+/- 0.411021%) of LAr and .* in the specified volume (0.43983% relat. uncert.).
If the uncertainty is too big, crank up the parameters "max_tries_rate_calculation" (default=40,000,000) and/or "target_n_point_rate_calculation" (default=100,000) in your fhicl.
%MSG
%MSG-i RANDOM: Decay0Gen:ar42@Construction 28-Jan-2026 15:36:02 GMT ModuleConstruction
Instantiated HepJamesRandom engine "ar42:0:BaseRadioGen" with seed 0.
%MSG
%MSG-i NuRandomService: Decay0Gen:ar42@Construction 28-Jan-2026 15:36:02 GMT ModuleConstruction
Seeding HepJamesRandom engine "ar42:BaseRadioGen" with seed 630455401.
%MSG
%MSG-i BaseRadioGen: Decay0Gen:ar42@Construction 28-Jan-2026 15:36:02 GMT ModuleConstruction BaseRadioGen.h:311
Calculating the volume of LAr and the volume .* in the geometry.
%MSG
%MSG-i BaseRadioGen: Decay0Gen:ar42@Construction 28-Jan-2026 15:36:02 GMT ModuleConstruction BaseRadioGen.h:347
2469 volumes correspond to the regex ".*".
%MSG
%MSG-i BaseRadioGen: Decay0Gen:ar42@Construction 28-Jan-2026 15:36:02 GMT ModuleConstruction BaseRadioGen.h:349
1 materials correspond to the regex "LAr".
%MSG
%MSG-i BaseRadioGen: Decay0Gen:ar42@Construction 28-Jan-2026 15:36:02 GMT ModuleConstruction BaseRadioGen.h:429
Calculating the proportion of LAr and the volume .* in the specified volume volCryostat.
%MSG
%MSG-i BaseRadioGen: Decay0Gen:ar42@Construction 28-Jan-2026 15:36:02 GMT ModuleConstruction BaseRadioGen.h:467
There is 93.3698% (+/- 0.410583%) of LAr and .* in the specified volume (0.439738% relat. uncert.).
If the uncertainty is too big, crank up the parameters "max_tries_rate_calculation" (default=40,000,000) and/or "target_n_point_rate_calculation" (default=100,000) in your fhicl.
%MSG
%MSG-i RANDOM: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 15:36:02 GMT ModuleConstruction
Instantiated HepJamesRandom engine "cosmicgenerator:0:gen" with seed 0.
%MSG
%MSG-i NuRandomService: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 15:36:02 GMT ModuleConstruction
Seeding HepJamesRandom engine "cosmicgenerator:gen" with seed 379610309.
%MSG
%MSG-i RANDOM: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 15:36:02 GMT ModuleConstruction
Instantiated HepJamesRandom engine "cosmicgenerator:0:pois" with seed 0.
%MSG
%MSG-i NuRandomService: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 15:36:02 GMT ModuleConstruction
Seeding HepJamesRandom engine "cosmicgenerator:pois" with seed 863726241.
%MSG
/cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard p_showers_*db
%MSG-i CorsikaGendp: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 15:36:02 GMT ModuleConstruction
For /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/p_showers_*db:p_showers_
Found 73 candidate files
Choosing file number 58
Selected /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/p_showers_210147.db
%MSG
/cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard He_showers_*db
%MSG-i CorsikaGendp: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 15:36:02 GMT ModuleConstruction
For /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/He_showers_*db:He_showers_
Found 76 candidate files
Choosing file number 29
Selected /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/He_showers_310100.db
%MSG
/cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard N_showers_*db
%MSG-i CorsikaGendp: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 15:36:02 GMT ModuleConstruction
For /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/N_showers_*db:N_showers_
Found 81 candidate files
Choosing file number 64
Selected /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/N_showers_410142.db
%MSG
/cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard Mg_showers_*db
%MSG-i CorsikaGendp: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 15:36:02 GMT ModuleConstruction
For /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/Mg_showers_*db:Mg_showers_
Found 81 candidate files
Choosing file number 72
Selected /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/Mg_showers_510050.db
%MSG
/cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard Fe_showers_*db
%MSG-i CorsikaGendp: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 15:36:02 GMT ModuleConstruction
For /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/Fe_showers_*db:Fe_showers_
Found 79 candidate files
Choosing file number 14
Selected /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/Fe_showers_610079.db
%MSG
%MSG-i Gen311: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 15:36:02 GMT ModuleConstruction
Fetching: /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/p_showers_210147.db 325
%MSG
%MSG-i Gen311: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 15:36:02 GMT ModuleConstruction
Fetching: /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/He_showers_310100.db 164
%MSG
%MSG-i Gen311: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 15:36:02 GMT ModuleConstruction
Fetching: /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/N_showers_410142.db 309
%MSG
%MSG-i Gen311: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 15:36:02 GMT ModuleConstruction
Fetching: /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/Mg_showers_510050.db 356
%MSG
%MSG-i Gen311: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 15:36:02 GMT ModuleConstruction
Fetching: /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/Fe_showers_610079.db 61
%MSG
%MSG-s ArtException: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 15:36:55 GMT ModuleConstruction
cet::exception caught in art
---- Gen311 BEGIN
Error opening db: (/cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/p_showers_210147.db) (10): disk I/O error; memory used:<<397376/405312
---- Gen311 END
%MSG
Art has completed and will exit with status 65.
Stderr:
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_16_00d00/gdml/protodunevd_v5_ggd.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16484 nodes/ 2469 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Error in processing gen
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_16_00d00/gdml/protodunevd_v5_ggd.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16484 nodes/ 2469 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
ls: cannot access *larcvpdvd*.root: No such file or directory
Output files:
larcv files:
formed
{
"name": "",
"namespace": "usertests",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_16_00d00",
"core.data_tier": "root-tuple-virtual",
"core.runs": null,
"core.runs_subruns": null,
"dune.config_file": "run_supera_pdunevd_mpvmpr_doublets.fcl",
"dune.campaign": "vd-protodune-spine-reco",
"core.start_time": 1769614495.0,
"core.end_time": 1769614616.0
}
} 