justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 269106.1@dunegpschedd01.fnal.gov

Jobsub ID269106.1@dunegpschedd01.fnal.gov
Workflow ID11251
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors4
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-18 17:25:00
SiteUK_Imperial
EntryDUNE_T2_UK_London_IC_ceprod02
Last heartbeat2025-12-18 17:28:57
From worker nodeHostnamewl03.grid.hep.ph.ic.ac.uk
cpuinfoAMD EPYC 7742 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors4
RSS bytes7864320000 (7500 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2025-12-18 17:26:32
Input filesvd-protodune-top:3430_41_d_pvdt.test
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-12-18 17:28:57
Saved logsjustin-logs:269106.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

::SigProc::OmnibusSigProc cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ](WireCell::IFrame:0)
[17:27:58.625] D [ pgraph ] connect <Node  type:WireCell::SigProc::ChannelSelector cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ]:(WireCell::IFrame:0) -> <Node  type:WireCell::Aux::Resampler cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ](WireCell::IFrame:0)
[17:27:58.625] D [ pgraph ] connect <Node  type:WireCell::Aux::Resampler cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ]:(WireCell::IFrame:0) -> <Node  type:WireCell::SigProc::OmnibusNoiseFilter cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ](WireCell::IFrame:0)
[17:27:58.625] D [ pgraph ] connect <Node  type:WireCell::SigProc::OmnibusNoiseFilter cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ]:(WireCell::IFrame:0) -> <Node  type:WireCell::SigProc::OmnibusSigProc cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ](WireCell::IFrame:0)
[17:27:58.625] D [ pgraph ] connect <Node  type:WireCell::SigProc::ChannelSelector cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ]:(WireCell::IFrame:0) -> <Node  type:WireCell::Aux::Resampler cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ](WireCell::IFrame:0)
[17:27:58.625] D [ pgraph ] connect <Node  type:WireCell::Aux::Resampler cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ]:(WireCell::IFrame:0) -> <Node  type:WireCell::SigProc::OmnibusNoiseFilter cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ](WireCell::IFrame:0)
[17:27:58.625] D [ pgraph ] connect <Node  type:WireCell::SigProc::OmnibusNoiseFilter cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ]:(WireCell::IFrame:0) -> <Node  type:WireCell::SigProc::OmnibusSigProc cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ](WireCell::IFrame:0)
[17:27:58.625] D [ pgraph ] connect <Node  type:WireCell::SigProc::ChannelSelector cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ]:(WireCell::IFrame:0) -> <Node  type:WireCell::Aux::Resampler cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ](WireCell::IFrame:0)
[17:27:58.625] D [ pgraph ] connect <Node  type:WireCell::Aux::Resampler cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ]:(WireCell::IFrame:0) -> <Node  type:WireCell::SigProc::OmnibusNoiseFilter cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ](WireCell::IFrame:0)
[17:27:58.625] D [ pgraph ] connect <Node  type:WireCell::SigProc::OmnibusNoiseFilter cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ]:(WireCell::IFrame:0) -> <Node  type:WireCell::SigProc::OmnibusSigProc cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ](WireCell::IFrame:0)
[17:27:58.625] D [ pgraph ] connect <Node  type:WireCell::SigProc::ChannelSelector cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ]:(WireCell::IFrame:0) -> <Node  type:WireCell::SigProc::OmnibusNoiseFilter cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ](WireCell::IFrame:0)
[17:27:58.625] D [ pgraph ] connect <Node  type:WireCell::SigProc::OmnibusNoiseFilter cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ]:(WireCell::IFrame:0) -> <Node  type:WireCell::SigProc::OmnibusSigProc cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ](WireCell::IFrame:0)
[17:27:58.626] D [ pgraph ] connect <Node  type:WireCell::SigProc::ChannelSelector cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ]:(WireCell::IFrame:0) -> <Node  type:WireCell::SigProc::OmnibusNoiseFilter cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ](WireCell::IFrame:0)
[17:27:58.626] D [ pgraph ] connect <Node  type:WireCell::SigProc::OmnibusNoiseFilter cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ]:(WireCell::IFrame:0) -> <Node  type:WireCell::SigProc::OmnibusSigProc cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ](WireCell::IFrame:0)
[17:27:58.626] D [ pgraph ] connect <Node  type:WireCell::SigProc::ChannelSelector cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ]:(WireCell::IFrame:0) -> <Node  type:WireCell::SigProc::OmnibusNoiseFilter cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ](WireCell::IFrame:0)
[17:27:58.626] D [ pgraph ] connect <Node  type:WireCell::SigProc::OmnibusNoiseFilter cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ]:(WireCell::IFrame:0) -> <Node  type:WireCell::SigProc::OmnibusSigProc cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ](WireCell::IFrame:0)
[17:27:58.626] D [ pgraph ] connect <Node  type:WireCell::SigProc::ChannelSelector cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ]:(WireCell::IFrame:0) -> <Node  type:WireCell::SigProc::OmnibusNoiseFilter cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ](WireCell::IFrame:0)
[17:27:58.626] D [ pgraph ] connect <Node  type:WireCell::SigProc::OmnibusNoiseFilter cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ]:(WireCell::IFrame:0) -> <Node  type:WireCell::SigProc::OmnibusSigProc cat:3 sig:WireCell::IFrameFilter inputs:[ WireCell::IFrame ] outputs:[ WireCell::IFrame ](WireCell::IFrame:0)
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
VDColdboxTDERawInput::ctor:        Configuration        : 
VDColdboxTDERawInput::ctor:        LogLevel             : 10
VDColdboxTDERawInput::ctor:        SamplesPerChannel    : 10000
VDColdboxTDERawInput::ctor:        maxEvents            : -1
VDColdboxTDERawInput::ctor:        StartTDEChCRU        : 0
VDColdboxTDERawInput::ctor:        OutputLabelRawDigits : tpcrawdecoder:daq
VDColdboxTDERawInput::ctor:        OutputLabelRDStatus  : daq
VDColdboxTDERawInput::ctor:        OutputLabelRDtime    : timingrawdecoder:daq
VDColdboxTDERawInput::ctor:        SelectCRPs           : 0, 1
VDColdboxTDERawInput::ctor:        InvertBaseline       : None
VDColdboxTDERawInput::ctor:        CRP 0 selected 1
VDColdboxTDERawInput::ctor:        CRP 0 baseline 0
VDColdboxTDERawInput::ctor:        CRP 1 selected 1
VDColdboxTDERawInput::ctor:        CRP 1 baseline 0
VDColdboxTDERawInput::ctor:        CRP 4294967295 selected 0
VDColdboxTDERawInput::ctor:        CRP 4294967295 baseline 0
VDColdboxTDERawInput::ctor:        Readout info              : 
VDColdboxTDERawInput::ctor:        Number of CRPs from chmap : 3
VDColdboxTDERawInput::ctor:        Total channels expected   : 6144
AdaBoostDecisionTree::Initialize - Invalid xml file.
BdtBeamParticleIdTool::ReadSettings - unable to load bdt
pLocalAlgorithmTool->ReadSettings(TiXmlHandle(pXmlElement)) throw STATUS_CODE_INVALID_PARAMETER
    in function: CreateAlgorithmTool
    in file:     /scratch/workspace/build-lar-products/BUILDTYPE/prof/QUAL/e26/label1/swarm/label2/ALMA9/build/pandora/v04_16_02/src/pandora-v04-16-02/PandoraSDK-v04-00-02/src/Managers/AlgorithmManager.cc line#: 177
Failure in reading pandora settings, STATUS_CODE_INVALID_PARAMETER
PandoraApi::ReadSettings(*m_pPrimaryPandora, fullConfigFileName) throw STATUS_CODE_FAILURE
    in function: ConfigurePandoraInstances
    in file:     /scratch/workspace/build-larsoft/BUILDTYPE/prof/QUAL/s131-e26/label1/swarm/label2/ALMA9/build/larpandora/v10_01_08-buildFW/src/larpandora/LArPandoraInterface/StandardPandora_module.cc line#: 120
DataPrepModule::endJob: # events processed: 0
DataPrepModule::endJob:   # events skipped: 0

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
[ No processed events ]
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3135.82 MB
  Peak resident set size usage (VmHWM): 798.482 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 0
ToolBasedRawDigitPrepService:dtor:  Call count: 0
ToolBasedRawDigitPrepService:dtor: Time report for 3 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.00 sec
ToolBasedRawDigitPrepService:dtor:    vdcb_adcChannelRawRmsFiller:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.00 sec
%MSG-s ArtException:  PostEndJob 18-Dec-2025 17:28:26 GMT ModuleEndJob
---- Unknown BEGIN
  An unknown exception was thrown while processing module StandardPandora/pandora during beginJob
---- Unknown END
%MSG
Art has completed and will exit with status 1.
Error in reco1
justIN time: 2025-12-19 04:36:23 UTC       justIN version: 01.05.03