Jobsub ID 294186.17@dunegpschedd01.fnal.gov
| Jobsub ID | 294186.17@dunegpschedd01.fnal.gov |
| Workflow ID | 12005 |
| Stage ID | 3 |
| User name | usher@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 6291456000 (6000 MiB) |
| Wall seconds limit | 28800 (8 hours) |
| Submitted time | 2026-01-20 14:18:50 |
| Site | CA_SFU |
| Entry | DUNE_CA_SFU_lcg-ce3 |
| Last heartbeat | 2026-01-20 14:20:57 |
| From worker node | Hostname | fc30562.int.fir.alliancecan.ca |
| cpuinfo | AMD EPYC 9655 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 7864320000 (7500 MiB) |
| Wall seconds limit | 84598 (23 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Started | 2026-01-20 14:20:19 |
| Input files | usertests:mpvmpr_monte-carlo-012005-005159_gen_g4.root
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Max RSS bytes | 0 (0 MiB) |
| Outputting started | |
| Output files | |
| Finished | 2026-01-20 14:20:57 |
| Saved logs | justin-logs:294186.17-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
26:p3915:prof -z /cvmfs/larsoft.opensciencegrid.org/products
nuevdb v1_09_12 -f Linux64bit+3.10-2.17 -q e26:prof -z /cvmfs/larsoft.opensciencegrid.org/products
nufinder v1_03_00 -f NULL -z /cvmfs/larsoft.opensciencegrid.org/products
nug4 v1_16_11 -f Linux64bit+3.10-2.17 -q e26:prof -z /cvmfs/larsoft.opensciencegrid.org/products
nugen v1_23_01 -f Linux64bit+3.10-2.17 -q e26:prof -z /cvmfs/larsoft.opensciencegrid.org/products
numpy v1_24_3 -f Linux64bit+3.10-2.17 -q e26:p3915 -z /cvmfs/larsoft.opensciencegrid.org/products
nurandom v1_11_05 -f Linux64bit+3.10-2.17 -q e26:prof -z /cvmfs/larsoft.opensciencegrid.org/products
nusimdata v1_29_02 -f Linux64bit+3.10-2.17 -q e26:prof -z /cvmfs/larsoft.opensciencegrid.org/products
nutools v3_21_00 -f Linux64bit+3.10-2.17 -q e26:prof -z /cvmfs/larsoft.opensciencegrid.org/products
openblas v0_3_23 -f Linux64bit+3.10-2.17 -q e26 -z /cvmfs/larsoft.opensciencegrid.org/products
pandora v04_16_02 -f Linux64bit+3.10-2.17 -q e26:prof -z /cvmfs/larsoft.opensciencegrid.org/products
postgresql v15_3 -f Linux64bit+3.10-2.17 -q p3915 -z /cvmfs/larsoft.opensciencegrid.org/products
ppfx v02_20_07 -f Linux64bit+3.10-2.17 -q e26:prof -z /cvmfs/larsoft.opensciencegrid.org/products
protobuf v3_21_12a -f Linux64bit+3.10-2.17 -q e26 -z /cvmfs/larsoft.opensciencegrid.org/products
protoduneana v10_16_00d00 -f Linux64bit+3.10-2.17 -q e26:prof -z /cvmfs/dune.opensciencegrid.org/products/dune
pygccxml v2_2_1b -f NULL -q p3915 -z /cvmfs/larsoft.opensciencegrid.org/products
pythia8 v8_3_15 -f Linux64bit+3.10-2.17 -q e26:p3915:prof -z /cvmfs/larsoft.opensciencegrid.org/products
pythia v6_4_28x -f Linux64bit+3.10-2.17 -q e26:prof -z /cvmfs/larsoft.opensciencegrid.org/products
python v3_9_15 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products
python_future_six_request v1_3_1 -f Linux64bit+3.10-2.17 -q python3.9 -z /cvmfs/fermilab.opensciencegrid.org/products/common/db/
range v3_0_12_0 -f NULL -z /cvmfs/larsoft.opensciencegrid.org/products
root v6_28_12 -f Linux64bit+3.10-2.17 -q e26:p3915:prof -z /cvmfs/larsoft.opensciencegrid.org/products
rstartree v2016_07 -f NULL -z /cvmfs/larsoft.opensciencegrid.org/products
sam_web_client v3_6 -f NULL -z /cvmfs/fermilab.opensciencegrid.org/products/common/db/
scitokens_cpp v1_0_1a -f Linux64bit+3.10-2.17 -q e26:sql34001 -z /cvmfs/larsoft.opensciencegrid.org/products
spdlog v1_9_2 -f Linux64bit+3.10-2.17 -q e26:prof -z /cvmfs/larsoft.opensciencegrid.org/products
sqlite v3_40_01_00 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products
srproxy v00.45 -f NULL -q py3915 -z /cvmfs/dune.opensciencegrid.org/products/dune
systematicstools v01_04_04 -f Linux64bit+3.10-2.17 -q e26:prof -z /cvmfs/larsoft.opensciencegrid.org/products
tbb v2021_9_0 -f Linux64bit+3.10-2.17 -q e26 -z /cvmfs/larsoft.opensciencegrid.org/products
tensorflow v2_15_0 -f Linux64bit+3.10-2.17 -q e26:p3915 -z /cvmfs/larsoft.opensciencegrid.org/products
torch_scatter v2_1_2a -f Linux64bit+3.10-2.17 -q e26 -z /cvmfs/larsoft.opensciencegrid.org/products
TRACE v3_17_11 -f NULL -z /cvmfs/larsoft.opensciencegrid.org/products
triton v2_25_0d -f Linux64bit+3.10-2.17 -q e26 -z /cvmfs/larsoft.opensciencegrid.org/products
ups v6_0_7 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune
valgrind v3_17_0 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products
wirecell v0_32_1 -f Linux64bit+3.10-2.17 -q e26:prof -z /cvmfs/larsoft.opensciencegrid.org/products
xerces_c v3_2_3e -f Linux64bit+3.10-2.17 -q e26 -z /cvmfs/larsoft.opensciencegrid.org/products
xrootd v5_5_5a -f Linux64bit+3.10-2.17 -q e26:p3915:prof -z /cvmfs/larsoft.opensciencegrid.org/products
art 3.14.04
Running lar DETSIM:
FCL: standard_detsim_dune10kt_1x2x6.fcl
Input: root://lcg-dunese1.sfu.computecanada.ca:1094//dune/RSE/usertests/6d/a6/mpvmpr_monte-carlo-012005-005159_gen_g4.root
Output: mpvmpr_monte-carlo-012005-005159_gen_g4_detsim.root
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_16_00d00/gdml/dune10kt_v6_refactored_1x2x6.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Error: Unsupported GDML Tag Used :gdml_simple_extension. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :extension. Please Check Geometry/Schema.
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1149
Info in <TGeoManager::CloseGeometry>: 67545 nodes/ 5439 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
registering to primaryGeneratorActionsMap_
registering to eventActionsMap_
registering to trackingActionsMap_
registering to steppingActionsMap_
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Using TESTbench spe!!!
With: SPE_DAPHNE2_FBK_2022.dat
[06:20:38.477] I [ wct ] loading compressed json file: /cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_16_00d00/wire-cell-cfg/dune10kt-1x2x6-wires-larsoft-v1.json.bz2
[06:20:46.006] I [ wct ] loading compressed json file: /cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_16_00d00/wire-cell-cfg/dune-garfield-1d60563.json.bz2
[06:20:47.731] I [ wct ] loading compressed json file: /cvmfs/dune.opensciencegrid.org/products/dune/dune_pardata/v01_84_00/WireCellData/protodune-noise-spectra-v1.json.bz2
[06:20:47.740] W [sigproc ] <OmnibusSigProc:apa0sigproc0> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces
[06:20:47.743] W [sigproc ] <OmnibusSigProc:apa1sigproc1> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces
[06:20:47.747] W [sigproc ] <OmnibusSigProc:apa2sigproc2> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces
[06:20:47.751] W [sigproc ] <OmnibusSigProc:apa3sigproc3> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces
[06:20:47.754] W [sigproc ] <OmnibusSigProc:apa4sigproc4> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces
[06:20:47.758] W [sigproc ] <OmnibusSigProc:apa5sigproc5> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces
[06:20:47.762] W [sigproc ] <OmnibusSigProc:apa6sigproc6> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces
[06:20:47.765] W [sigproc ] <OmnibusSigProc:apa7sigproc7> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces
[06:20:47.769] W [sigproc ] <OmnibusSigProc:apa8sigproc8> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces
[06:20:47.772] W [sigproc ] <OmnibusSigProc:apa9sigproc9> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces
[06:20:47.776] W [sigproc ] <OmnibusSigProc:apa10sigproc10> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces
[06:20:47.780] W [sigproc ] <OmnibusSigProc:apa11sigproc11> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces
Inputer: "wclsSimDepoSetSource:"
Outputer: "wclsDepoFluxWriter:postdrift"
Outputer: "wclsFrameSaver:spsignals"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
wclsFrameSaver: promising to produce recob::Wires named "dnnsp"
20-Jan-2026 06:20:47 PST Initiating request to open input file "root://lcg-dunese1.sfu.computecanada.ca:1094//dune/RSE/usertests/6d/a6/mpvmpr_monte-carlo-012005-005159_gen_g4.root"
%MSG-s ArtException: TriggerResultInserter:TriggerResults@Construction 20-Jan-2026 06:20:49 PST ModuleConstruction
cet::exception caught in art
---- FileOpenError BEGIN
RootInputFileSequence::initFile(): Input file root://lcg-dunese1.sfu.computecanada.ca:1094//dune/RSE/usertests/6d/a6/mpvmpr_monte-carlo-012005-005159_gen_g4.root was not found or could not be opened.
---- FileOpenError END
%MSG
Art has completed and will exit with status 20.
ERROR: Output file mpvmpr_monte-carlo-012005-005159_gen_g4_detsim.root not produced!