Jobsub ID 237983.0@dunegpschedd01.fnal.gov

Jobsub ID	237983.0@dunegpschedd01.fnal.gov
Workflow ID	9250
Stage ID	1
User name	atonazzo@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-10-23 20:10:06
Site	US_UCSD
Entry	CMSHTPC_T2_US_UCSD_gw7
Last heartbeat	2025-10-24 03:02:57
From worker node	Hostname	mh-7662-2.t2.ucsd.edu
	cpuinfo	AMD EPYC 7662 64-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	171000 (47 hours)
	GPU
	Inner Apptainer?	True
Job state	outputting_failed
Started	2025-10-23 20:10:34
Input files	fardet-hd:nu_dune10kt_1x2x6_1421_462_20230827T093352Z_gen_g4_detsim_hitreco__20240223T015154Z_reco2.root
Jobscript	Exit code	0
	Real time	6h (24708s)
	CPU time	6h (22613s = 91%)
	Max RSS bytes	21484924928 (20489 MiB)
Outputting started	2025-10-24 03:02:22
Output files
Finished	2025-10-24 03:02:57
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Events option -n 99
Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/32/b1/nu_dune10kt_1x2x6_1421_462_20230827T093352Z_gen_g4_detsim_hitreco__20240223T015154Z_reco2.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
using fcl file for detsim /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/354d79804f7587f68e20f5c9c7d06123079cd31c/detsyst_fcls/detsyst_detsim_dune10kt_1x2x6.fcl
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_4_3b/Linux64bit+3.10-2.17-e26-p3913-prof/lib/libXrdPosixPreload.so
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
using fcl file for reco2 /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/354d79804f7587f68e20f5c9c7d06123079cd31c/detsyst_fcls/detsyst_reco2_dune10kt_1x2x6.fcl
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_4_3b/Linux64bit+3.10-2.17-e26-p3913-prof/lib/libXrdPosixPreload.so
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
using fcl file for CAFmaker cafmaker_atmos_dune10kt_1x2x6_runreco-nuenergy-nuangular_geov5.fcl
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
3+1 records in
3+1 records out
1787529 bytes (1.8 MB) copied, 0.00802561 s, 223 MB/s
=== Start last 100 lines of lar log file ===
%MSG-w DUNEAna:  EnergyReco:energyrecnumumcsllhd@BeginModule  23-Oct-2025 20:02:18 PDT run: 1421 subRun: 1 event: 46299
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  EnergyReco:energyrecnumumcsllhd@BeginModule  23-Oct-2025 20:02:18 PDT run: 1421 subRun: 1 event: 46299
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  EnergyReco:energyrecnue@BeginModule 23-Oct-2025 20:02:20 PDT  run: 1421 subRun: 1 event: 46299
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  EnergyReco:energyrecnue@BeginModule 23-Oct-2025 20:02:20 PDT  run: 1421 subRun: 1 event: 46299
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  EnergyReco:energyrecnc@BeginModule 23-Oct-2025 20:02:20 PDT  run: 1421 subRun: 1 event: 46299
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  EnergyReco:energyrecnc@BeginModule 23-Oct-2025 20:02:20 PDT  run: 1421 subRun: 1 event: 46299
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconue@BeginModule  23-Oct-2025 20:02:20 PDT run: 1421 subRun: 1 event: 46299
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconue@BeginModule  23-Oct-2025 20:02:20 PDT run: 1421 subRun: 1 event: 46299
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconumu@BeginModule  23-Oct-2025 20:02:20 PDT run: 1421 subRun: 1 event: 46299
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconumu@BeginModule  23-Oct-2025 20:02:20 PDT run: 1421 subRun: 1 event: 46299
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconuepfps@BeginModule  23-Oct-2025 20:02:20 PDT run: 1421 subRun: 1 event: 46299
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconuepfps@BeginModule  23-Oct-2025 20:02:20 PDT run: 1421 subRun: 1 event: 46299
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconumupfps@BeginModule  23-Oct-2025 20:02:20 PDT run: 1421 subRun: 1 event: 46299
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconumupfps@BeginModule  23-Oct-2025 20:02:20 PDT run: 1421 subRun: 1 event: 46299
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconumupfps@BeginModule  23-Oct-2025 20:02:20 PDT run: 1421 subRun: 1 event: 46299
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglerecohits@BeginModule  23-Oct-2025 20:02:20 PDT run: 1421 subRun: 1 event: 46299
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglerecohits@BeginModule  23-Oct-2025 20:02:20 PDT run: 1421 subRun: 1 event: 46299
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-i CAFMaker:  CAFMaker:cafmaker@BeginModule 23-Oct-2025 20:02:20 PDT  run: 1421 subRun: 1 event: 46299
Geo name is: dune10kt_v5_1x2x6
%MSG
%MSG-i CAFMaker:  CAFMaker:cafmaker@BeginModule 23-Oct-2025 20:02:20 PDT  run: 1421 subRun: 1 event: 46299
Assuming the FD HD detector
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 23-Oct-2025 20:02:20 PDT  run: 1421 subRun: 1 event: 46299
InputTag: label = 'regcnneval', instance = 'regcnnresult' does not correspond to a valid RegCNNResult product
%MSG
23-Oct-2025 20:02:20 PDT  Closed input file "nu_dune10kt_1x2x6_1421_462_20230827T093352Z_gen_g4_detsim_hitreco__20240223T015154Z_reco2_2025-10-23T_201130Z_g4_detsim_reco1_reco2.root"
%MSG-i NuRandomService:  CAFMaker:cafmaker@EndJob 23-Oct-2025 20:02:20 PDT  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

TrigReport ---------- Event summary -------------
TrigReport Events total = 99 passed = 99 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         99         99          0 cafmaker

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 182.911909 Real = 206.457159

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 36324.9 VmHWM = 834.707

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0