justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 294186.17@dunegpschedd01.fnal.gov

Jobsub ID294186.17@dunegpschedd01.fnal.gov
Workflow ID12005
Stage ID3
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes6291456000 (6000 MiB)
Wall seconds limit28800 (8 hours)
Submitted time2026-01-20 14:18:50
SiteCA_SFU
EntryDUNE_CA_SFU_lcg-ce3
Last heartbeat2026-01-20 14:20:57
From worker nodeHostnamefc30562.int.fir.alliancecan.ca
cpuinfoAMD EPYC 9655 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes7864320000 (7500 MiB)
Wall seconds limit84598 (23 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2026-01-20 14:20:19
Input filesusertests:mpvmpr_monte-carlo-012005-005159_gen_g4.root
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2026-01-20 14:20:57
Saved logsjustin-logs:294186.17-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

26:p3915:prof  -z /cvmfs/larsoft.opensciencegrid.org/products
nuevdb            v1_09_12        -f Linux64bit+3.10-2.17 -q e26:prof        -z /cvmfs/larsoft.opensciencegrid.org/products
nufinder          v1_03_00        -f NULL                                    -z /cvmfs/larsoft.opensciencegrid.org/products
nug4              v1_16_11        -f Linux64bit+3.10-2.17 -q e26:prof        -z /cvmfs/larsoft.opensciencegrid.org/products
nugen             v1_23_01        -f Linux64bit+3.10-2.17 -q e26:prof        -z /cvmfs/larsoft.opensciencegrid.org/products
numpy             v1_24_3         -f Linux64bit+3.10-2.17 -q e26:p3915       -z /cvmfs/larsoft.opensciencegrid.org/products
nurandom          v1_11_05        -f Linux64bit+3.10-2.17 -q e26:prof        -z /cvmfs/larsoft.opensciencegrid.org/products
nusimdata         v1_29_02        -f Linux64bit+3.10-2.17 -q e26:prof        -z /cvmfs/larsoft.opensciencegrid.org/products
nutools           v3_21_00        -f Linux64bit+3.10-2.17 -q e26:prof        -z /cvmfs/larsoft.opensciencegrid.org/products
openblas          v0_3_23         -f Linux64bit+3.10-2.17 -q e26             -z /cvmfs/larsoft.opensciencegrid.org/products
pandora           v04_16_02       -f Linux64bit+3.10-2.17 -q e26:prof        -z /cvmfs/larsoft.opensciencegrid.org/products
postgresql        v15_3           -f Linux64bit+3.10-2.17 -q p3915           -z /cvmfs/larsoft.opensciencegrid.org/products
ppfx              v02_20_07       -f Linux64bit+3.10-2.17 -q e26:prof        -z /cvmfs/larsoft.opensciencegrid.org/products
protobuf          v3_21_12a       -f Linux64bit+3.10-2.17 -q e26             -z /cvmfs/larsoft.opensciencegrid.org/products
protoduneana      v10_16_00d00    -f Linux64bit+3.10-2.17 -q e26:prof        -z /cvmfs/dune.opensciencegrid.org/products/dune
pygccxml          v2_2_1b         -f NULL                 -q p3915           -z /cvmfs/larsoft.opensciencegrid.org/products
pythia8           v8_3_15         -f Linux64bit+3.10-2.17 -q e26:p3915:prof  -z /cvmfs/larsoft.opensciencegrid.org/products
pythia            v6_4_28x        -f Linux64bit+3.10-2.17 -q e26:prof        -z /cvmfs/larsoft.opensciencegrid.org/products
python            v3_9_15         -f Linux64bit+3.10-2.17                    -z /cvmfs/larsoft.opensciencegrid.org/products
python_future_six_request  v1_3_1          -f Linux64bit+3.10-2.17 -q python3.9       -z /cvmfs/fermilab.opensciencegrid.org/products/common/db/
range             v3_0_12_0       -f NULL                                    -z /cvmfs/larsoft.opensciencegrid.org/products
root              v6_28_12        -f Linux64bit+3.10-2.17 -q e26:p3915:prof  -z /cvmfs/larsoft.opensciencegrid.org/products
rstartree         v2016_07        -f NULL                                    -z /cvmfs/larsoft.opensciencegrid.org/products
sam_web_client    v3_6            -f NULL                                    -z /cvmfs/fermilab.opensciencegrid.org/products/common/db/
scitokens_cpp     v1_0_1a         -f Linux64bit+3.10-2.17 -q e26:sql34001    -z /cvmfs/larsoft.opensciencegrid.org/products
spdlog            v1_9_2          -f Linux64bit+3.10-2.17 -q e26:prof        -z /cvmfs/larsoft.opensciencegrid.org/products
sqlite            v3_40_01_00     -f Linux64bit+3.10-2.17                    -z /cvmfs/larsoft.opensciencegrid.org/products
srproxy           v00.45          -f NULL                 -q py3915          -z /cvmfs/dune.opensciencegrid.org/products/dune
systematicstools  v01_04_04       -f Linux64bit+3.10-2.17 -q e26:prof        -z /cvmfs/larsoft.opensciencegrid.org/products
tbb               v2021_9_0       -f Linux64bit+3.10-2.17 -q e26             -z /cvmfs/larsoft.opensciencegrid.org/products
tensorflow        v2_15_0         -f Linux64bit+3.10-2.17 -q e26:p3915       -z /cvmfs/larsoft.opensciencegrid.org/products
torch_scatter     v2_1_2a         -f Linux64bit+3.10-2.17 -q e26             -z /cvmfs/larsoft.opensciencegrid.org/products
TRACE             v3_17_11        -f NULL                                    -z /cvmfs/larsoft.opensciencegrid.org/products
triton            v2_25_0d        -f Linux64bit+3.10-2.17 -q e26             -z /cvmfs/larsoft.opensciencegrid.org/products
ups               v6_0_7          -f Linux64bit+3.10-2.17                    -z /cvmfs/dune.opensciencegrid.org/products/dune
valgrind          v3_17_0         -f Linux64bit+3.10-2.17                    -z /cvmfs/larsoft.opensciencegrid.org/products
wirecell          v0_32_1         -f Linux64bit+3.10-2.17 -q e26:prof        -z /cvmfs/larsoft.opensciencegrid.org/products
xerces_c          v3_2_3e         -f Linux64bit+3.10-2.17 -q e26             -z /cvmfs/larsoft.opensciencegrid.org/products
xrootd            v5_5_5a         -f Linux64bit+3.10-2.17 -q e26:p3915:prof  -z /cvmfs/larsoft.opensciencegrid.org/products
art 3.14.04
Running lar DETSIM:
  FCL:     standard_detsim_dune10kt_1x2x6.fcl
  Input:   root://lcg-dunese1.sfu.computecanada.ca:1094//dune/RSE/usertests/6d/a6/mpvmpr_monte-carlo-012005-005159_gen_g4.root
  Output:  mpvmpr_monte-carlo-012005-005159_gen_g4_detsim.root
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_16_00d00/gdml/dune10kt_v6_refactored_1x2x6.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Error: Unsupported GDML Tag Used :gdml_simple_extension. Please Check Geometry/Schema.
Error: Unsupported GDML Tag Used :extension. Please Check Geometry/Schema.
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1149
Info in <TGeoManager::CloseGeometry>: 67545 nodes/ 5439 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
registering to  primaryGeneratorActionsMap_
registering to   eventActionsMap_
registering to   trackingActionsMap_
registering to  steppingActionsMap_
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Using TESTbench spe!!! 
With: SPE_DAPHNE2_FBK_2022.dat
[06:20:38.477] I [  wct   ] loading compressed json file: /cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_16_00d00/wire-cell-cfg/dune10kt-1x2x6-wires-larsoft-v1.json.bz2
[06:20:46.006] I [  wct   ] loading compressed json file: /cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_16_00d00/wire-cell-cfg/dune-garfield-1d60563.json.bz2
[06:20:47.731] I [  wct   ] loading compressed json file: /cvmfs/dune.opensciencegrid.org/products/dune/dune_pardata/v01_84_00/WireCellData/protodune-noise-spectra-v1.json.bz2
[06:20:47.740] W [sigproc ] <OmnibusSigProc:apa0sigproc0> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces 
[06:20:47.743] W [sigproc ] <OmnibusSigProc:apa1sigproc1> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces 
[06:20:47.747] W [sigproc ] <OmnibusSigProc:apa2sigproc2> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces 
[06:20:47.751] W [sigproc ] <OmnibusSigProc:apa3sigproc3> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces 
[06:20:47.754] W [sigproc ] <OmnibusSigProc:apa4sigproc4> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces 
[06:20:47.758] W [sigproc ] <OmnibusSigProc:apa5sigproc5> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces 
[06:20:47.762] W [sigproc ] <OmnibusSigProc:apa6sigproc6> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces 
[06:20:47.765] W [sigproc ] <OmnibusSigProc:apa7sigproc7> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces 
[06:20:47.769] W [sigproc ] <OmnibusSigProc:apa8sigproc8> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces 
[06:20:47.772] W [sigproc ] <OmnibusSigProc:apa9sigproc9> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces 
[06:20:47.776] W [sigproc ] <OmnibusSigProc:apa10sigproc10> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces 
[06:20:47.780] W [sigproc ] <OmnibusSigProc:apa11sigproc11> The 'wiener_threshold_tag' is obsolete, thresholds in summary on 'wiener' tagged traces 
Inputer: "wclsSimDepoSetSource:"
Outputer: "wclsDepoFluxWriter:postdrift"
Outputer: "wclsFrameSaver:spsignals"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
wclsFrameSaver: promising to produce recob::Wires named "dnnsp"
20-Jan-2026 06:20:47 PST  Initiating request to open input file "root://lcg-dunese1.sfu.computecanada.ca:1094//dune/RSE/usertests/6d/a6/mpvmpr_monte-carlo-012005-005159_gen_g4.root"
%MSG-s ArtException:  TriggerResultInserter:TriggerResults@Construction  20-Jan-2026 06:20:49 PST ModuleConstruction
cet::exception caught in art
---- FileOpenError BEGIN
  RootInputFileSequence::initFile(): Input file root://lcg-dunese1.sfu.computecanada.ca:1094//dune/RSE/usertests/6d/a6/mpvmpr_monte-carlo-012005-005159_gen_g4.root was not found or could not be opened.
---- FileOpenError END
%MSG
Art has completed and will exit with status 20.
ERROR: Output file mpvmpr_monte-carlo-012005-005159_gen_g4_detsim.root not produced!
justIN time: 2026-02-04 06:07:24 UTC       justIN version: 01.06.00