justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 47546.43@dunegpschedd01.fnal.gov

Jobsub ID	47546.43@dunegpschedd01.fnal.gov
Workflow ID	2813
Stage ID	1
User name	smanthey@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-09-17 13:41:16
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat	2025-09-17 14:01:43
From worker node	Hostname	dunegli-7051091-0-fnpc19141.fnal.gov
	cpuinfo	AMD EPYC 7502 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	outputting_failed
Started	2025-09-17 14:01:17
Input files	fardet-vd:fardet-vd_mc_le_mc_2024a_list-4246_input.list_out1_standard_reco1_dunevd10kt_1x8x14_3view_30deg_hit-reconstructed_merged_skip000350_lim000025_mergeLar_20241220T183202_20250610T120746Z_reco2.root
Jobscript	Exit code	0
	Real time	0m (14s)
	CPU time	0m (12s = 85%)
	Max RSS bytes	403906560 (385 MiB)
Outputting started	2025-09-17 14:01:32
Output files
Finished	2025-09-17 14:01:43
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

4 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 27 (apa027) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 28 (apa028) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 29 (apa029) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 30 (apa030) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 31 (apa031) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 32 (apa032) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 33 (apa033) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 34 (apa034) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 35 (apa035) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 36 (apa036) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 37 (apa037) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 38 (apa038) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 39 (apa039) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 40 (apa040) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 41 (apa041) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 42 (apa042) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 43 (apa043) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 44 (apa044) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 45 (apa045) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 46 (apa046) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 47 (apa047) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 48 (apa048) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 49 (apa049) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 50 (apa050) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 51 (apa051) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 52 (apa052) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 53 (apa053) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 54 (apa054) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 55 (apa055) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 56 (apa056) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 57 (apa057) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 58 (apa058) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 59 (apa059) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 60 (apa060) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 61 (apa061) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 62 (apa062) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 63 (apa063) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 64 (apa064) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 65 (apa065) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 66 (apa066) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 67 (apa067) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 68 (apa068) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 69 (apa069) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 70 (apa070) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 71 (apa071) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 72 (apa072) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 73 (apa073) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 74 (apa074) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 75 (apa075) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 76 (apa076) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 77 (apa077) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 78 (apa078) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 79 (apa079) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 80 (apa080) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 81 (apa081) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 82 (apa082) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 83 (apa083) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 84 (apa084) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 85 (apa085) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 86 (apa086) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 87 (apa087) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 88 (apa088) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 89 (apa089) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 90 (apa090) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 91 (apa091) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 92 (apa092) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 93 (apa093) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 94 (apa094) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 95 (apa095) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 96 (apa096) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 97 (apa097) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 98 (apa098) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 99 (apa099) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 100 (apa100) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 101 (apa101) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 102 (apa102) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 103 (apa103) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 104 (apa104) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 105 (apa105) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 106 (apa106) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 107 (apa107) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 108 (apa108) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 109 (apa109) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 110 (apa110) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 111 (apa111) has 864 channels from 3/3 readout planes.
%MSG-i SimpleChannelStatusService:  Early 17-Sep-2025 14:01:30 UTC JobSetup
Loaded from configuration:
  - 0 bad channels
  - 0 noisy channels
  - largest channel ID: 96767, largest present: 96767
%MSG
%MSG-i setupProvider<DetectorPropertiesStandard>:  Early  17-Sep-2025 14:01:30 UTC JobSetup
Asked to ignore 1 keys: 'InheritNumberTimeSamples'
%MSG
%MSG-i SignalShapingServiceDUNE:  Early 17-Sep-2025 14:01:30 UTC JobSetup
Getting Filter from .fcl file
%MSG
%MSG-i SignalShapingServiceDUNE:  Early 17-Sep-2025 14:01:30 UTC JobSetup
 using the field response provided from a .root file 
%MSG
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
17-Sep-2025 14:01:31 UTC  Initiating request to open input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/b3/22/fardet-vd_mc_le_mc_2024a_list-4246_input.list_out1_standard_reco1_dunevd10kt_1x8x14_3view_30deg_hit-reconstructed_merged_skip000350_lim000025_mergeLar_20241220T183202_20250610T120746Z_reco2.root"
%MSG-s ArtException:  SolarNuAna:solarnuana@Construction  17-Sep-2025 14:01:32 UTC ModuleConstruction
cet::exception caught in art
---- FileOpenError BEGIN
  ---- FatalRootError BEGIN
    Fatal Root Error: TNetXNGFile::Open
    [FATAL] Auth failed: No protocols left to try
    ROOT severity: 3000
  ---- FatalRootError END
  
  RootInputFileSequence::initFile(): Input file root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/b3/22/fardet-vd_mc_le_mc_2024a_list-4246_input.list_out1_standard_reco1_dunevd10kt_1x8x14_3view_30deg_hit-reconstructed_merged_skip000350_lim000025_mergeLar_20241220T183202_20250610T120746Z_reco2.root was not found or could not be opened.
---- FileOpenError END
%MSG
Art has completed and will exit with status 20.
=== End last 100 lines of lar log file ===
lar exit code 0

justIN time: 2025-09-18 23:23:23 UTC       justIN version: 01.05.00