Jobsub ID 245951.2@dunegpschedd02.fnal.gov

Jobsub ID	245951.2@dunegpschedd02.fnal.gov
Workflow ID	10205
Stage ID	1
User name	szh2@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	8388608000 (8000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-15 10:25:34
Site	UK_Lancaster
Entry	UBoone_UK_Lancaster_HEC_grendel_ce02
Last heartbeat	2025-11-15 10:37:38
From worker node	Hostname	comp21-06
	cpuinfo	Intel(R) Xeon(R) Gold 6248 CPU @ 2.50GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	10485760000 (10000 MiB)
	Wall seconds limit	257400 (71 hours)
	GPU
	Inner Apptainer?	True
Job state	jobscript_error
Started	2025-11-15 10:36:35
Input files	hd-protodune:np04hd_raw_run028116_0032_dataflow5_datawriter_0_20240724T092800.hdf5
Jobscript	Exit code	1
	Real time	0m (0s)
	CPU time	0m (0s = 0%)
	Max RSS bytes	0 (0 MiB)
Outputting started
Output files
Finished	2025-11-15 10:37:38
Saved logs	justin-logs:245951.2-dunegpschedd02.fnal.gov.logs.tgz
List job events (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

[INFO] Using:
       FCL_DECON  = protodunehd_deconvolution_run.fcl
       FCL_MICHEL = runmicheltime.fcl
       Output dir = /pnfs/dune/scratch/users/szh2/pdhd_DATA_Michel/output_justIN
==========================================================
[INFO] DID : hd-protodune:np04hd_raw_run028116_0032_dataflow5_datawriter_0_20240724T092800.hdf5
[INFO] PFN : root://xgate.hec.lancs.ac.uk:1094//cephfs/grid/dune/hd-protodune/92/3d/np04hd_raw_run028116_0032_dataflow5_datawriter_0_20240724T092800.hdf5
[INFO] RSE : DUNE_UK_LANCASTER_CEPH
[INFO] Extracted pattern: run028116_0032_dataflow5_datawriter_0_20240724T092800.hdf5
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
[INFO] Loading your CVMFS localProducts...

MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v10_04_00d00
MRB_QUALS=e26:prof
MRB_TOP=/exp/dune/app/users/szh2/rsl_Feb2025
MRB_SOURCE=/exp/dune/app/users/szh2/rsl_Feb2025/srcs
MRB_BUILDDIR=/exp/dune/app/users/szh2/rsl_Feb2025/build_slf7.x86_64
MRB_INSTALL=/exp/dune/app/users/szh2/rsl_Feb2025/localProducts_larsoft_v10_04_00d00_e26_prof

PRODUCTS=/exp/dune/app/users/szh2/rsl_Feb2025/localProducts_larsoft_v10_04_00d00_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/exp/dune/app/users/szh2/rsl_Feb2025/localProducts_larsoft_v10_04_00d00_e26_prof

local product directory is /exp/dune/app/users/szh2/rsl_Feb2025/localProducts_larsoft_v10_04_00d00_e26_prof
----------- this block should be empty ------------------
WARNING: Unable to open file /exp/dune/app/users/szh2/rsl_Feb2025/localProducts_larsoft_v10_04_00d00_e26_prof.
---------------------------------------------------------
[STEP 1] Running deconvolution...
[ERROR] Deconvolution FAILED.
    V channels per APA = 800
    Z channels per APA = 960
    Pitch in U Plane = 0.4669
    Pitch in V Plane = 0.4669
    Pitch in Z Plane = 0.4792
GeoApaChannelGroupService::ctor: Group 0 (apa0) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 1 (apa1) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 2 (apa2) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 3 (apa3) has 2560 channels from 4/4 readout planes.
%MSG-i SimpleChannelStatusService:  Early 15-Nov-2025 10:36:55 GMT JobSetup
Loaded from configuration:
  - 0 bad channels
  - 0 noisy channels
  - largest channel ID: 10239, largest present: 10239
%MSG
%MSG-i setupProvider<DetectorPropertiesStandard>:  Early  15-Nov-2025 10:36:55 GMT JobSetup
Asked to ignore 1 keys: 'InheritNumberTimeSamples'
%MSG
%MSG-i SignalShapingServiceDUNE:  Early 15-Nov-2025 10:36:55 GMT JobSetup
Getting Filter from .fcl file
%MSG
%MSG-i SignalShapingServiceDUNE:  Early 15-Nov-2025 10:36:55 GMT JobSetup
 using the field response provided from a .root file 
%MSG
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Deconvolution::BuildExtraFilter sigma is 5.52105
%MSG-i Deconvolution::Deconvolution():  Deconvolution:opdec@Construction  15-Nov-2025 10:36:56 GMT ModuleConstruction
Will look in ProtoDUNE/HD/opdetresponse/v0/ for 112 SPE template files.
Will look in ProtoDUNE/HD/opdetresponse/v0/ for 2 noise template files.
Input waveform polarity set to: -1
Default white noise RMS: 4.5

Ignoring channels:
    3, 35, 86, 87, 97, 107, 116, 117, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 

%MSG
15-Nov-2025 10:37:00 GMT  Initiating request to open input file "root://xgate.hec.lancs.ac.uk:1094//cephfs/grid/dune/hd-protodune/92/3d/np04hd_raw_run028116_0032_dataflow5_datawriter_0_20240724T092800.hdf5"
%MSG-i Root_Information:  TriggerResultInserter:TriggerResults@Construction  TNetXNGFile::Open() 15-Nov-2025 10:37:01 GMT ModuleConstruction
[ERROR] Server responded with an error: [3010] Unable to open /cephfs/grid/dune/hd-protodune/92/3d/np04hd_raw_run028116_0032_dataflow5_datawriter_0_20240724T092800.hdf5; permission denied
ROOT severity: 3000
%MSG
%MSG-s ArtException:  TriggerResultInserter:TriggerResults@Construction  15-Nov-2025 10:37:01 GMT ModuleConstruction
cet::exception caught in art
---- FileOpenError BEGIN
  RootInputFileSequence::initFile(): Input file root://xgate.hec.lancs.ac.uk:1094//cephfs/grid/dune/hd-protodune/92/3d/np04hd_raw_run028116_0032_dataflow5_datawriter_0_20240724T092800.hdf5 was not found or could not be opened.
---- FileOpenError END
%MSG
Art has completed and will exit with status 20.