justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 299905.47@dunegpschedd01.fnal.gov

Jobsub ID299905.47@dunegpschedd01.fnal.gov
Workflow ID12307
Stage ID1
User namenivedpm@fnal.gov
RequestedProcessors4
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-23 11:54:17
SiteUK_Brunel
EntryCMSHTPC_T2_UK_London_Brunel_dc2_22
Last heartbeat2026-01-23 14:15:07
From worker nodeHostnamewn-b8-28-00.brunel.ac.uk
cpuinfoIntel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors4
RSS bytes7864320000 (7500 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-23 13:33:24
Input filesmonte-carlo-012307-000623
JobscriptExit code0
Real time40m (2448s)
CPU time39m (2340s = 95%)
Max RSS bytes3040858112 (2899 MiB)
Outputting started2026-01-23 14:14:14
Output files
Finished2026-01-23 14:15:07
Saved logsjustin-logs:299905.47-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

isolated hits, the alpha parameter is 0.001
**> PCA len: 0.144335, wid: 0, height: 0, ratio: -nan
**> Sorted 2 hits, longest distance: 0.402039
**> Best path has 3 hits, 2 edges
************* Finding best path with A* in cluster *****************
**> There are 3 hits, 2 isolated hits, the alpha parameter is 0.001
**> PCA len: 0.355156, wid: 0, height: 0, ratio: -nan
**> Sorted 2 hits, longest distance: 0.279236
**> Best path has 3 hits, 2 edges
************* Finding best path with A* in cluster *****************
**> There are 3 hits, 2 isolated hits, the alpha parameter is 0.230307
**> PCA len: 1.00956, wid: 0.232508, height: -nan, ratio: -nan
**> Sorted 2 hits, longest distance: 0.156494
**> Best path has 3 hits, 2 edges
************* Finding best path with A* in cluster *****************
**> There are 3 hits, 2 isolated hits, the alpha parameter is 0.001
**> PCA len: 0.118173, wid: 0, height: 0, ratio: -nan
**> Sorted 2 hits, longest distance: 0.39431
**> Best path has 3 hits, 2 edges
************* Finding best path with A* in cluster *****************
**> There are 3 hits, 2 isolated hits, the alpha parameter is 0.001
**> PCA len: 0.590328, wid: 0, height: 0, ratio: -nan
**> Sorted 2 hits, longest distance: 0.295437
**> Best path has 3 hits, 2 edges
************* Finding best path with A* in cluster *****************
**> There are 3 hits, 2 isolated hits, the alpha parameter is 0.001
**> PCA len: 0.0938836, wid: 0, height: 0, ratio: -nan
**> Sorted 2 hits, longest distance: 0.280781
**> Best path has 3 hits, 2 edges

Stderr:
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
  hitpdune
  pandora
  pandora2Shower
  pandora2Track
  pandora2cali
  pandora2calipid
  pandora2pid
  pandoraShower
  pandoraTrack
  pandoraWriter
  pandoracalipid
  pandorapid
  reco3d
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_16_00d00/gdml/protodune_v7.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 36176 nodes/ 5435 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
23-Jan-2026 14:03:46 GMT  Initiating request to open input file "prod_mpvmpr_protodunesp_1_299905_47_1769175213_gen_g4_stage1_detsim.root"
23-Jan-2026 14:03:47 GMT  Opened input file "prod_mpvmpr_protodunesp_1_299905_47_1769175213_gen_g4_stage1_detsim.root"
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 34986 traces, 34986 summary
Retagger: tagging trace set: gauss with 32445 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 32445 traces tagged "gauss"
FrameSaver: q=1.86545e+06 n=435411 tag=gauss
wclsFrameSaver: saving 34986 traces tagged "wiener"
FrameSaver: q=1.98207e+06 n=376894 tag=wiener
23-Jan-2026 14:05:45 GMT  Opened output file with pattern "prod_mpvmpr_protodunesp_1_299905_47_1769175213_gen_g4_stage1_detsim_reco.root"
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 42820 traces, 42820 summary
Retagger: tagging trace set: gauss with 39386 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 39386 traces tagged "gauss"
FrameSaver: q=2.92237e+06 n=600748 tag=gauss
wclsFrameSaver: saving 42820 traces tagged "wiener"
FrameSaver: q=3.09801e+06 n=535188 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 50458 traces, 50458 summary
Retagger: tagging trace set: gauss with 44243 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 44243 traces tagged "gauss"
FrameSaver: q=3.8468e+06 n=665276 tag=gauss
wclsFrameSaver: saving 50458 traces tagged "wiener"
FrameSaver: q=4.14669e+06 n=585035 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 30938 traces, 30938 summary
Retagger: tagging trace set: gauss with 30655 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 30655 traces tagged "gauss"
FrameSaver: q=1.55267e+06 n=417034 tag=gauss
wclsFrameSaver: saving 30938 traces tagged "wiener"
FrameSaver: q=1.64451e+06 n=373715 tag=wiener

Error in processing reco
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
  hitpdune
  pandora
  pandora2Shower
  pandora2Track
  pandora2cali
  pandora2calipid
  pandora2pid
  pandoraShower
  pandoraTrack
  pandoraWriter
  pandoracalipid
  pandorapid
  reco3d
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_16_00d00/gdml/protodune_v7.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 36176 nodes/ 5435 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
23-Jan-2026 14:03:46 GMT  Initiating request to open input file "prod_mpvmpr_protodunesp_1_299905_47_1769175213_gen_g4_stage1_detsim.root"
23-Jan-2026 14:03:47 GMT  Opened input file "prod_mpvmpr_protodunesp_1_299905_47_1769175213_gen_g4_stage1_detsim.root"
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 34986 traces, 34986 summary
Retagger: tagging trace set: gauss with 32445 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 32445 traces tagged "gauss"
FrameSaver: q=1.86545e+06 n=435411 tag=gauss
wclsFrameSaver: saving 34986 traces tagged "wiener"
FrameSaver: q=1.98207e+06 n=376894 tag=wiener
23-Jan-2026 14:05:45 GMT  Opened output file with pattern "prod_mpvmpr_protodunesp_1_299905_47_1769175213_gen_g4_stage1_detsim_reco.root"
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 42820 traces, 42820 summary
Retagger: tagging trace set: gauss with 39386 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 39386 traces tagged "gauss"
FrameSaver: q=2.92237e+06 n=600748 tag=gauss
wclsFrameSaver: saving 42820 traces tagged "wiener"
FrameSaver: q=3.09801e+06 n=535188 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 50458 traces, 50458 summary
Retagger: tagging trace set: gauss with 44243 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 44243 traces tagged "gauss"
FrameSaver: q=3.8468e+06 n=665276 tag=gauss
wclsFrameSaver: saving 50458 traces tagged "wiener"
FrameSaver: q=4.14669e+06 n=585035 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 30938 traces, 30938 summary
Retagger: tagging trace set: gauss with 30655 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 30655 traces tagged "gauss"
FrameSaver: q=1.55267e+06 n=417034 tag=gauss
wclsFrameSaver: saving 30938 traces tagged "wiener"
FrameSaver: q=1.64451e+06 n=373715 tag=wiener

ls: cannot access *larcvpdsp*.root: No such file or directory
Output files:
 larcv files: 
formed
{
  "name": "",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_16_00d00",
    "core.data_tier": "root-tuple-virtual",
    "core.runs": null,
    "core.runs_subruns": null,
    "dune.config_file": "run_supera_pdunesp_mpvmpr_d.fcl",
    "dune.campaign": "sp-protodune-spine-reco",
    "core.start_time": 1769175213.0,
    "core.end_time": 1769177649.0
  }
}
justIN time: 2026-02-04 09:49:37 UTC       justIN version: 01.06.00