Jobsub ID 231455.1@dunegpschedd02.fnal.gov

Jobsub ID	231455.1@dunegpschedd02.fnal.gov
Workflow ID	9219
Stage ID	1
User name	avizcaya@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	5242880000 (5000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-10-20 21:22:17
Site	US_FNAL-T1
Entry	CMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat	2025-10-20 21:24:34
From worker node	Hostname	dunegli-47251-0-cmswn4066.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	5242880000 (5000 MiB)
	Wall seconds limit	171000 (47 hours)
	GPU
	Inner Apptainer?	True
Job state	jobscript_error
Started	2025-10-20 21:23:42
Input files	usertests:pdhd_prod_beam__226002_119_1_20251007T164849Z_gen_g4_IonScintPDExt.root_231780_86_1_20251008T193106Z_PDInt.root_232179_17_1_20251009T180144Z_detsim_reco1.root
Jobscript	Exit code	1
	Real time	0m (0s)
	CPU time	0m (0s = 0%)
	Max RSS bytes	0 (0 MiB)
Outputting started
Output files
Finished	2025-10-20 21:24:34
Saved logs	justin-logs:231455.1-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

LogLevel: 1
StandardRawDigitExtractService::ctor:    DigitReadTool: digitReader
StandardRawDigitExtractService::ctor:   PedestalOption: 1
StandardRawDigitExtractService::ctor:     FlagStuckOff: 0
StandardRawDigitExtractService::ctor:      FlagStuckOn: 0
ToolBasedRawDigitPrepService::ctor:      Fetching digitReader
AcdDigitReader::ctor:     LogLevel: 1
ToolBasedRawDigitPrepService::ctor:     Found tool digitReader @ 0xbea2e60
ToolBasedRawDigitPrepService::ctor:      Fetching adcSampleFiller
AdcSampleFiller::ctor: Configuration parameters:
AdcSampleFiller::ctor:       LogLevel: 1
AdcSampleFiller::ctor:   AdcUnderflow: 0
AdcSampleFiller::ctor:    AdcOverflow: 4095
ToolBasedRawDigitPrepService::ctor:     Found tool adcSampleFiller @ 0xb676160
ToolBasedRawDigitPrepService::ctor:      Fetching adcScaleAdcToKe
AdcSampleScaler::ctor: Parameters:
AdcSampleScaler::ctor:          LogLevel: 1
AdcSampleScaler::ctor:       ScaleFactor: 0.02401
AdcSampleScaler::ctor:        OutputUnit: ke/tick
AdcSampleScaler::ctor:         InputUnit: ADC count
ToolBasedRawDigitPrepService::ctor:     Found tool adcScaleAdcToKe @ 0xc481040
ToolBasedRawDigitPrepService::ctor:      Fetching pdspTailPedRemovalZKe
AdcThresholdSignalFinder::ctor: Configuration parameters:
AdcThresholdSignalFinder::ctor:       LogLevel: 1
AdcThresholdSignalFinder::ctor:      Threshold: 5e-1
AdcThresholdSignalFinder::ctor:     BinsBefore: 10
AdcThresholdSignalFinder::ctor:      BinsAfter: 20
AdcThresholdSignalFinder::ctor:   FlagPositive: true
AdcThresholdSignalFinder::ctor:   FlagNegative: true
ExpTailPedRemover::ctor: Parameters:
ExpTailPedRemover::ctor:               LogLevel: 1
ExpTailPedRemover::ctor:             SignalFlag: 3
ExpTailPedRemover::ctor:   SignalIterationLimit: 10
ExpTailPedRemover::ctor:             SignalTool: adcTailSignalFinderKe
ExpTailPedRemover::ctor:              DecayTime: 2200
ExpTailPedRemover::ctor:                MaxTick: 21000
ExpTailPedRemover::ctor:              PedDegree: 0
ExpTailPedRemover::ctor:               PedTick0: 3000
ExpTailPedRemover::ctor:               PedFreqs: []
ExpTailPedRemover::ctor:   IncludeChannelRanges: [apa1z, apa2z, apa3z, apa4z, apa5z, apa6z, apa1c, apa2c, apa3c, apa4c, apa5c, apa6c]
ExpTailPedRemover::ctor:   NoWarnStatuses: [1]
ExpTailPedRemover::ctor:   ExcludeChannelRanges: []
ExpTailPedRemover::ctor: Channel checking enabled for 5760 channels.
ToolBasedRawDigitPrepService::ctor:     Found tool pdspTailPedRemovalZKe @ 0xd7258d0
ToolBasedRawDigitPrepService::ctor: Fetching wire building service.
ToolBasedRawDigitPrepService::ctor:   Wire building service: @0x4807030
ToolBasedRawDigitPrepService::ctor: ToolBasedRawDigitPrepService:
ToolBasedRawDigitPrepService::ctor:                     LogLevel: 3
ToolBasedRawDigitPrepService::ctor:                      DoWires: 1
ToolBasedRawDigitPrepService::ctor:      ADC channel tools:
ToolBasedRawDigitPrepService::ctor:            digitReader
ToolBasedRawDigitPrepService::ctor:            adcSampleFiller
ToolBasedRawDigitPrepService::ctor:            adcScaleAdcToKe
ToolBasedRawDigitPrepService::ctor:            pdspTailPedRemovalZKe
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
20-Oct-2025 21:24:18 UTC  Initiating request to open input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/9d/17/pdhd_prod_beam__226002_119_1_20251007T164849Z_gen_g4_IonScintPDExt.root_231780_86_1_20251008T193106Z_PDInt.root_232179_17_1_20251009T180144Z_detsim_reco1.root"
20-Oct-2025 21:24:18 UTC  Initiating request to open input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/9d/17/pdhd_prod_beam__226002_119_1_20251007T164849Z_gen_g4_IonScintPDExt.root_231780_86_1_20251008T193106Z_PDInt.root_232179_17_1_20251009T180144Z_detsim_reco1.root"
20-Oct-2025 21:24:19 UTC  Opened input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/9d/17/pdhd_prod_beam__226002_119_1_20251007T164849Z_gen_g4_IonScintPDExt.root_231780_86_1_20251008T193106Z_PDInt.root_232179_17_1_20251009T180144Z_detsim_reco1.root"
20-Oct-2025 21:24:19 UTC  Opened input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/9d/17/pdhd_prod_beam__226002_119_1_20251007T164849Z_gen_g4_IonScintPDExt.root_231780_86_1_20251008T193106Z_PDInt.root_232179_17_1_20251009T180144Z_detsim_reco1.root"
Setting applicationFamily: "art"
Setting process_name: "PDHDAna"
db: runtime0
%MSG-w PhotonBackTrackerService:  ProcessEvent 20-Oct-2025 21:24:23 UTC  run: 20250627 subRun: 1 event: 10
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
########## EvtNo.10
20-Oct-2025 21:24:23 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/9d/17/pdhd_prod_beam__226002_119_1_20251007T164849Z_gen_g4_IonScintPDExt.root_231780_86_1_20251008T193106Z_PDInt.root_232179_17_1_20251009T180144Z_detsim_reco1.root"
20-Oct-2025 21:24:23 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/9d/17/pdhd_prod_beam__226002_119_1_20251007T164849Z_gen_g4_IonScintPDExt.root_231780_86_1_20251008T193106Z_PDInt.root_232179_17_1_20251009T180144Z_detsim_reco1.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
[ No processed events ]
====================================================================================================================

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
[ No processed events ]
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3922.15 MB
  Peak resident set size usage (VmHWM): 2893.74 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3922.15 MB
  Peak resident set size usage (VmHWM): 2893.74 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 1 passed = 1 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport          1          0          1 pduneana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 3.608537 Real = 3.712413

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3922.15 VmHWM = 2893.74

ToolBasedRawDigitPrepService:dtor: Event count: 0
ToolBasedRawDigitPrepService:dtor:  Call count: 0
ToolBasedRawDigitPrepService:dtor: Time report for 4 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.00 sec
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   0.00 sec
%MSG-s ArtException:  PostEndJob 20-Oct-2025 21:24:23 UTC ModuleEndJob
---- EventProcessorFailure BEGIN
  EventProcessor: an exception occurred during current event processing
  ---- EventProcessorFailure BEGIN
    EndPathExecutor: an exception occurred during current event processing
    ---- ScheduleExecutionFailure BEGIN
      Path: ProcessingStopped.
      ---- ProductNotFound BEGIN
        Found zero products matching all selection criteria
          C++ type: std::vector<recob::SpacePoint>
          Module label: 'reco3d'
          Product instance name: ''
          Process name: (empty)
        The above exception was thrown while processing module PDSPAnalyzer/pduneana run: 20250627 subRun: 1 event: 10
      ---- ProductNotFound END
      Exception going through path end_path
    ---- ScheduleExecutionFailure END
  ---- EventProcessorFailure END
---- EventProcessorFailure END
%MSG
%MSG-s ArtException:  PostEndJob 20-Oct-2025 21:24:23 UTC ModuleEndJob
---- EventProcessorFailure BEGIN
  EventProcessor: an exception occurred during current event processing
  ---- EventProcessorFailure BEGIN
    EndPathExecutor: an exception occurred during current event processing
    ---- ScheduleExecutionFailure BEGIN
      Path: ProcessingStopped.
      ---- ProductNotFound BEGIN
        Found zero products matching all selection criteria
          C++ type: std::vector<recob::SpacePoint>
          Module label: 'reco3d'
          Product instance name: ''
          Process name: (empty)
        The above exception was thrown while processing module PDSPAnalyzer/pduneana run: 20250627 subRun: 1 event: 10
      ---- ProductNotFound END
      Exception going through path end_path
    ---- ScheduleExecutionFailure END
  ---- EventProcessorFailure END
---- EventProcessorFailure END
%MSG
Art has completed and will exit with status 1.