justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 266825.55@dunegpschedd02.fnal.gov

Jobsub ID266825.55@dunegpschedd02.fnal.gov
Workflow ID11596
Stage ID1
User namecdalmazz@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-08 09:22:50
SiteUK_Edinburgh
EntryDUNE_UK_SGridECDF_ce1_multicore
Last heartbeat2026-01-08 14:26:38
From worker nodeHostnamenode2b05.ecdf.ed.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 6338 CPU @ 2.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-08 10:03:13
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66027687_413_20231207T000916Z_gen_g4_detsim_hitreco__20240510T061109Z_reco2.root
JobscriptExit code0
Real time4h (15129s)
CPU time4h (15036s = 99%)
Max RSS bytes8603824128 (8205 MiB)
Outputting started2026-01-08 14:15:23
Output files
Finished2026-01-08 14:26:38
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

xrootd client version: v5.5.5
[2026-01-08 14:15:22.164909 +0000][Debug  ][Utility           ] Unable to process user config file: [ERROR] OS Error: no such file or directory
[2026-01-08 14:15:22.165084 +0000][Debug  ][PlugInMgr         ] Initializing plug-in manager...
[2026-01-08 14:15:22.165093 +0000][Debug  ][PlugInMgr         ] No default plug-in, loading plug-in configs...
[2026-01-08 14:15:22.165099 +0000][Debug  ][PlugInMgr         ] Processing plug-in definitions in /etc/xrootd/client.plugins.d...
[2026-01-08 14:15:22.165261 +0000][Debug  ][PlugInMgr         ] Trying to disable plug-in for '*'
[2026-01-08 14:15:22.165301 +0000][Debug  ][PlugInMgr         ] Processing plug-in definitions in /home/.xrootd/client.plugins.d...
[2026-01-08 14:15:22.165309 +0000][Debug  ][PlugInMgr         ] Unable to process directory /home/.xrootd/client.plugins.d: [ERROR] OS Error: no such file or directory
[2026-01-08 14:15:22.168823 +0000][Debug  ][Utility           ] In the prepare fork handler for process 6449
[2026-01-08 14:15:22.168853 +0000][Debug  ][Utility           ] Running the prepare fork handler for process 6449
[2026-01-08 14:15:22.168859 +0000][Debug  ][Utility           ] Locking File and FileSystem objects for process: 6449
[2026-01-08 14:15:22.169209 +0000][Debug  ][Utility           ] In the parent fork handler for process 6449
[2026-01-08 14:15:22.169232 +0000][Debug  ][Utility           ][ 6449] Running the parent fork handler for process 6449
[2026-01-08 14:15:22.169248 +0000][Debug  ][Utility           ][ 6449] Unlocking File and FileSystem objects for process:  6449
[2026-01-08 14:15:22.169439 +0000][Debug  ][Utility           ] In the child fork handler for process 6451
[2026-01-08 14:15:22.169509 +0000][Debug  ][Utility           ][ 6451] Running the child fork handler for process 6451
[2026-01-08 14:15:22.169528 +0000][Debug  ][Utility           ][ 6451] Unlocking File and FileSystem objects for process:  6451
[2026-01-08 14:15:22.191727 +0000][Debug  ][Utility           ] Initializing xrootd client version: v5.5.5
[2026-01-08 14:15:22.192024 +0000][Debug  ][Utility           ] Unable to process user config file: [ERROR] OS Error: no such file or directory
[2026-01-08 14:15:22.192196 +0000][Debug  ][PlugInMgr         ] Initializing plug-in manager...
[2026-01-08 14:15:22.192205 +0000][Debug  ][PlugInMgr         ] No default plug-in, loading plug-in configs...
[2026-01-08 14:15:22.192210 +0000][Debug  ][PlugInMgr         ] Processing plug-in definitions in /etc/xrootd/client.plugins.d...
[2026-01-08 14:15:22.192387 +0000][Debug  ][PlugInMgr         ] Trying to disable plug-in for '*'
[2026-01-08 14:15:22.192418 +0000][Debug  ][PlugInMgr         ] Processing plug-in definitions in /home/.xrootd/client.plugins.d...
[2026-01-08 14:15:22.192426 +0000][Debug  ][PlugInMgr         ] Unable to process directory /home/.xrootd/client.plugins.d: [ERROR] OS Error: no such file or directory
3+1 records in
3+1 records out
1615449 bytes (1.6 MB) copied, 0.0016843 s, 959 MB/s
=== Start last 100 lines of lar log file ===
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  EnergyReco:energyrecnue@BeginModule 08-Jan-2026 14:15:21 GMT  run: 66027687 subRun: 1 event: 41399
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  EnergyReco:energyrecnue@BeginModule 08-Jan-2026 14:15:21 GMT  run: 66027687 subRun: 1 event: 41399
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  EnergyReco:energyrecnc@BeginModule 08-Jan-2026 14:15:21 GMT  run: 66027687 subRun: 1 event: 41399
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  EnergyReco:energyrecnc@BeginModule 08-Jan-2026 14:15:21 GMT  run: 66027687 subRun: 1 event: 41399
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconue@BeginModule  08-Jan-2026 14:15:21 GMT run: 66027687 subRun: 1 event: 41399
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconue@BeginModule  08-Jan-2026 14:15:21 GMT run: 66027687 subRun: 1 event: 41399
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconumu@BeginModule  08-Jan-2026 14:15:21 GMT run: 66027687 subRun: 1 event: 41399
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconumu@BeginModule  08-Jan-2026 14:15:21 GMT run: 66027687 subRun: 1 event: 41399
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconuepfps@BeginModule  08-Jan-2026 14:15:21 GMT run: 66027687 subRun: 1 event: 41399
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconuepfps@BeginModule  08-Jan-2026 14:15:21 GMT run: 66027687 subRun: 1 event: 41399
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconumupfps@BeginModule  08-Jan-2026 14:15:21 GMT run: 66027687 subRun: 1 event: 41399
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconumupfps@BeginModule  08-Jan-2026 14:15:21 GMT run: 66027687 subRun: 1 event: 41399
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglereconumupfps@BeginModule  08-Jan-2026 14:15:21 GMT run: 66027687 subRun: 1 event: 41399
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglerecohits@BeginModule  08-Jan-2026 14:15:21 GMT run: 66027687 subRun: 1 event: 41399
 Please note: accessing PFParticle tracks through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetTrack.
%MSG
%MSG-w DUNEAna:  NuAngularReco:anglerecohits@BeginModule  08-Jan-2026 14:15:21 GMT run: 66027687 subRun: 1 event: 41399
 Please note: accessing PFParticle showers through this method is not the recommended workflow.
 Please use DUNEAnaEventUtils::GetPFParticles and access the tracks with DUNEAnaPFParticleUtils::GetShower.
%MSG
%MSG-i CAFMaker:  CAFMaker:cafmaker@BeginModule 08-Jan-2026 14:15:21 GMT  run: 66027687 subRun: 1 event: 41399
Geo name is: dune10kt_v5_1x2x6
%MSG
%MSG-i CAFMaker:  CAFMaker:cafmaker@BeginModule 08-Jan-2026 14:15:21 GMT  run: 66027687 subRun: 1 event: 41399
Assuming the FD HD detector
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 08-Jan-2026 14:15:21 GMT  run: 66027687 subRun: 1 event: 41399
InputTag: label = 'regcnneval', instance = 'regcnnresult' does not correspond to a valid RegCNNResult product
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 08-Jan-2026 14:15:21 GMT  run: 66027687 subRun: 1 event: 41399
Unknown property 'LArThreeDChargeFeatureTool_EndFraction' for PFP with ID 2
%MSG
%MSG-w CAFMaker:  CAFMaker:cafmaker@BeginModule 08-Jan-2026 14:15:21 GMT  run: 66027687 subRun: 1 event: 41399
Unknown property 'LArThreeDChargeFeatureTool_FractionalSpread' for PFP with ID 2
%MSG
08-Jan-2026 14:15:21 GMT  Closed input file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66027687_413_20231207T000916Z_gen_g4_detsim_hitreco__20240510T061109Z_reco2_2026-01-08T_100316Z_g4_detsim_reco1_reco2.root"
%MSG-i NuRandomService:  CAFMaker:cafmaker@EndJob 08-Jan-2026 14:15:21 GMT  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

TrigReport ---------- Event summary -------------
TrigReport Events total = 99 passed = 99 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         99         99          0 cafmaker

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 28.101351 Real = 28.263625

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 10665.5 VmHWM = 1013.26

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-04 06:06:22 UTC       justIN version: 01.06.00