justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 294412.2@dunegpschedd02.fnal.gov

Jobsub ID294412.2@dunegpschedd02.fnal.gov
Workflow ID12142
Stage ID1
User namecdalmazz@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-23 23:04:52
SiteUK_Sheffield
EntryDUNE_UK_Sheffield_lcgce2
Last heartbeat2026-01-24 07:26:29
From worker nodeHostnamewn031.hep
cpuinfoIntel(R) Xeon(R) Gold 6226 CPU @ 2.70GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-23 23:05:51
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_800_20231202T103750Z_gen_g4_detsim_hitreco__20240507T214721Z_reco2.root
JobscriptExit code0
Real time8h (29992s)
CPU time7h (27316s = 91%)
Max RSS bytes7294951424 (6957 MiB)
Outputting started2026-01-24 07:25:44
Output files
Finished2026-01-24 07:26:29
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Events option -n 99
Input PFN = root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/3b/8b/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_800_20231202T103750Z_gen_g4_detsim_hitreco__20240507T214721Z_reco2.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
using fcl file for detsim /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/5984a1f2318de3e78e4e1be1e837a24c3b9e3004/fcls/detsyst_detsim_dune10kt_1x2x6.fcl
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_4_3b/Linux64bit+3.10-2.17-e26-p3913-prof/lib/libXrdPosixPreload.so
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
using fcl file for reco2 /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/5984a1f2318de3e78e4e1be1e837a24c3b9e3004/fcls/detsyst_reco2_dune10kt_1x2x6.fcl
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_4_3b/Linux64bit+3.10-2.17-e26-p3913-prof/lib/libXrdPosixPreload.so
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
using fcl file for CAFmaker cafmaker_atmos_dune10kt_1x2x6_runreco-nuenergy-nuangular_geov5.fcl
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
5+1 records in
5+1 records out
2681300 bytes (2.7 MB) copied, 0.00299685 s, 895 MB/s
=== Start last 100 lines of lar log file ===
%MSG-w DUNEAna:  EnergyReco:energyrecnumumcsllhd@BeginModule  24-Jan-2026 07:25:41 GMT run: 6404651 subRun: 1 event: 80099
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  EnergyReco:energyrecnumumcsllhd@BeginModule  24-Jan-2026 07:25:41 GMT run: 6404651 subRun: 1 event: 80099
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  EnergyReco:energyrecnue@BeginModule 24-Jan-2026 07:25:42 GMT  run: 6404651 subRun: 1 event: 80099
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  EnergyReco:energyrecnue@BeginModule 24-Jan-2026 07:25:42 GMT  run: 6404651 subRun: 1 event: 80099
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  EnergyReco:energyrecnc@BeginModule 24-Jan-2026 07:25:42 GMT  run: 6404651 subRun: 1 event: 80099
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  EnergyReco:energyrecnc@BeginModule 24-Jan-2026 07:25:42 GMT  run: 6404651 subRun: 1 event: 80099
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconue@BeginModule  24-Jan-2026 07:25:42 GMT run: 6404651 subRun: 1 event: 80099
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconue@BeginModule  24-Jan-2026 07:25:42 GMT run: 6404651 subRun: 1 event: 80099
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconumu@BeginModule  24-Jan-2026 07:25:42 GMT run: 6404651 subRun: 1 event: 80099
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconumu@BeginModule  24-Jan-2026 07:25:42 GMT run: 6404651 subRun: 1 event: 80099
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconuepfps@BeginModule  24-Jan-2026 07:25:42 GMT run: 6404651 subRun: 1 event: 80099
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconuepfps@BeginModule  24-Jan-2026 07:25:42 GMT run: 6404651 subRun: 1 event: 80099
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconumupfps@BeginModule  24-Jan-2026 07:25:42 GMT run: 6404651 subRun: 1 event: 80099
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconumupfps@BeginModule  24-Jan-2026 07:25:42 GMT run: 6404651 subRun: 1 event: 80099
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconumupfps@BeginModule  24-Jan-2026 07:25:42 GMT run: 6404651 subRun: 1 event: 80099
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglerecohits@BeginModule  24-Jan-2026 07:25:42 GMT run: 6404651 subRun: 1 event: 80099
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglerecohits@BeginModule  24-Jan-2026 07:25:42 GMT run: 6404651 subRun: 1 event: 80099
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-i CAFMaker:  CAFMaker:cafmaker@BeginModule 24-Jan-2026 07:25:42 GMT  run: 6404651 subRun: 1 event: 80099
Geo name is: dune10kt_v5_1x2x6
%MSG
%MSG-i CAFMaker:  CAFMaker:cafmaker@BeginModule 24-Jan-2026 07:25:42 GMT  run: 6404651 subRun: 1 event: 80099
Assuming the FD HD detector
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 24-Jan-2026 07:25:42 GMT  run: 6404651 subRun: 1 event: 80099
InputTag: label = 'regcnneval', instance = 'regcnnresult' does not correspond to a valid RegCNNResult product
%MSG
24-Jan-2026 07:25:42 GMT  Closed input file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6404651_800_20231202T103750Z_gen_g4_detsim_hitreco__20240507T214721Z_reco2_2026-01-23T_230614Z_g4_detsim_reco1_reco2.root"
%MSG-i NuRandomService:  CAFMaker:cafmaker@EndJob 24-Jan-2026 07:25:42 GMT  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

TrigReport ---------- Event summary -------------
TrigReport Events total = 99 passed = 99 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         99         99          0 cafmaker

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 120.776213 Real = 128.344740

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 8687.12 VmHWM = 1180.95

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-04 04:44:49 UTC       justIN version: 01.06.00