Jobsub ID 301949.1@dunegpschedd01.fnal.gov
| Jobsub ID | 301949.1@dunegpschedd01.fnal.gov |
| Workflow ID | 12478 |
| Stage ID | 1 |
| User name | nivedpm@fnal.gov |
| Requested | Processors | 4 |
| GPU | No |
| RSS bytes | 6815744000 (6500 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2026-01-28 14:52:47 |
| Site | UK_Imperial |
| Entry | DUNE_T2_UK_London_IC_ceprod03 |
| Last heartbeat | 2026-01-28 14:56:15 |
| From worker node | Hostname | wm21.grid.hep.ph.ic.ac.uk |
| cpuinfo | AMD EPYC 7742 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 4 |
| RSS bytes | 7864320000 (7500 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-28 14:53:37 |
| Input files | monte-carlo-012478-000407
|
| Jobscript | Exit code | 0 |
| Real time | 2m (124s) |
| CPU time | 0m (39s = 31%) |
| Max RSS bytes | 761614336 (726 MiB) |
| Outputting started | 2026-01-28 14:55:42 |
| Output files | |
| Finished | 2026-01-28 14:56:15 |
| Saved logs | justin-logs:301949.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
* in the specified volume volCryostat.
%MSG
%MSG-i BaseRadioGen: Decay0Gen:ar39@Construction 28-Jan-2026 14:54:36 GMT ModuleConstruction BaseRadioGen.h:467
There is 93.471% (+/- 0.411136%) of LAr and .* in the specified volume (0.439853% relat. uncert.).
If the uncertainty is too big, crank up the parameters "max_tries_rate_calculation" (default=40,000,000) and/or "target_n_point_rate_calculation" (default=100,000) in your fhicl.
%MSG
%MSG-i RANDOM: Decay0Gen:ar42@Construction 28-Jan-2026 14:54:36 GMT ModuleConstruction
Instantiated HepJamesRandom engine "ar42:0:BaseRadioGen" with seed 0.
%MSG
%MSG-i NuRandomService: Decay0Gen:ar42@Construction 28-Jan-2026 14:54:36 GMT ModuleConstruction
Seeding HepJamesRandom engine "ar42:BaseRadioGen" with seed 291212440.
%MSG
%MSG-i BaseRadioGen: Decay0Gen:ar42@Construction 28-Jan-2026 14:54:36 GMT ModuleConstruction BaseRadioGen.h:311
Calculating the volume of LAr and the volume .* in the geometry.
%MSG
%MSG-i BaseRadioGen: Decay0Gen:ar42@Construction 28-Jan-2026 14:54:36 GMT ModuleConstruction BaseRadioGen.h:347
2469 volumes correspond to the regex ".*".
%MSG
%MSG-i BaseRadioGen: Decay0Gen:ar42@Construction 28-Jan-2026 14:54:36 GMT ModuleConstruction BaseRadioGen.h:349
1 materials correspond to the regex "LAr".
%MSG
%MSG-i BaseRadioGen: Decay0Gen:ar42@Construction 28-Jan-2026 14:54:36 GMT ModuleConstruction BaseRadioGen.h:429
Calculating the proportion of LAr and the volume .* in the specified volume volCryostat.
%MSG
%MSG-i BaseRadioGen: Decay0Gen:ar42@Construction 28-Jan-2026 14:54:36 GMT ModuleConstruction BaseRadioGen.h:467
There is 93.4047% (+/- 0.410773%) of LAr and .* in the specified volume (0.439778% relat. uncert.).
If the uncertainty is too big, crank up the parameters "max_tries_rate_calculation" (default=40,000,000) and/or "target_n_point_rate_calculation" (default=100,000) in your fhicl.
%MSG
%MSG-i RANDOM: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 14:54:36 GMT ModuleConstruction
Instantiated HepJamesRandom engine "cosmicgenerator:0:gen" with seed 0.
%MSG
%MSG-i NuRandomService: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 14:54:36 GMT ModuleConstruction
Seeding HepJamesRandom engine "cosmicgenerator:gen" with seed 292247567.
%MSG
%MSG-i RANDOM: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 14:54:36 GMT ModuleConstruction
Instantiated HepJamesRandom engine "cosmicgenerator:0:pois" with seed 0.
%MSG
%MSG-i NuRandomService: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 14:54:36 GMT ModuleConstruction
Seeding HepJamesRandom engine "cosmicgenerator:pois" with seed 509757880.
%MSG
/cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard p_showers_*db
%MSG-i CorsikaGendp: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 14:54:36 GMT ModuleConstruction
For /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/p_showers_*db:p_showers_
Found 73 candidate files
Choosing file number 61
Selected /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/p_showers_210142.db
%MSG
/cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard He_showers_*db
%MSG-i CorsikaGendp: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 14:54:36 GMT ModuleConstruction
For /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/He_showers_*db:He_showers_
Found 76 candidate files
Choosing file number 55
Selected /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/He_showers_310066.db
%MSG
/cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard N_showers_*db
%MSG-i CorsikaGendp: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 14:54:36 GMT ModuleConstruction
For /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/N_showers_*db:N_showers_
Found 81 candidate files
Choosing file number 9
Selected /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/N_showers_410129.db
%MSG
/cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard Mg_showers_*db
%MSG-i CorsikaGendp: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 14:54:36 GMT ModuleConstruction
For /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/Mg_showers_*db:Mg_showers_
Found 81 candidate files
Choosing file number 69
Selected /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/Mg_showers_510166.db
%MSG
/cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard Fe_showers_*db
%MSG-i CorsikaGendp: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 14:54:36 GMT ModuleConstruction
For /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/Fe_showers_*db:Fe_showers_
Found 79 candidate files
Choosing file number 69
Selected /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/Fe_showers_610087.db
%MSG
%MSG-i Gen311: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 14:54:36 GMT ModuleConstruction
Fetching: /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/p_showers_210142.db 353
%MSG
%MSG-i Gen311: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 14:54:36 GMT ModuleConstruction
Fetching: /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/He_showers_310066.db 299
%MSG
%MSG-i Gen311: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 14:54:36 GMT ModuleConstruction
Fetching: /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/N_showers_410129.db 53
%MSG
%MSG-i Gen311: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 14:54:36 GMT ModuleConstruction
Fetching: /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/Mg_showers_510166.db 349
%MSG
%MSG-i Gen311: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 14:54:36 GMT ModuleConstruction
Fetching: /cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/Fe_showers_610087.db 346
%MSG
%MSG-s ArtException: CORSIKAGendp:cosmicgenerator@Construction 28-Jan-2026 14:55:38 GMT ModuleConstruction
cet::exception caught in art
---- Gen311 BEGIN
Error opening db: (/cvmfs/dune.osgstorage.org/pnfs/fnal.gov/usr/dune/persistent/stash/Cosmics/CERN/CORSIKA/standard/p_showers_210142.db) (10): disk I/O error; memory used:<<397376/405312
---- Gen311 END
%MSG
Art has completed and will exit with status 65.
Stderr:
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_16_00d00/gdml/protodunevd_v5_ggd.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16484 nodes/ 2469 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Error in processing gen
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_16_00d00/gdml/protodunevd_v5_ggd.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 292
Info in <TGeoManager::CloseGeometry>: 16484 nodes/ 2469 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
ls: cannot access *larcvpdvd*.root: No such file or directory
Output files:
larcv files:
formed
{
"name": "",
"namespace": "usertests",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_16_00d00",
"core.data_tier": "root-tuple-virtual",
"core.runs": null,
"core.runs_subruns": null,
"dune.config_file": "run_supera_pdunevd_mpvmpr_doublets.fcl",
"dune.campaign": "vd-protodune-spine-reco",
"core.start_time": 1769612032.0,
"core.end_time": 1769612138.0
}
} 