justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 276491.1@dunegpschedd01.fnal.gov

Jobsub ID276491.1@dunegpschedd01.fnal.gov
Workflow ID11748
Stage ID1
User namenivedpm@fnal.gov
RequestedProcessors4
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-12 18:46:23
SiteUK_QMUL
EntryDUNE_UK_London_QMUL_arcce03
Last heartbeat2026-01-12 19:35:21
From worker nodeHostnamecn066.htc.esc.qmul
cpuinfoIntel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors4
RSS bytes7864320000 (7500 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-12 18:47:42
Input filesmonte-carlo-011748-000042
JobscriptExit code0
Real time47m (2833s)
CPU time46m (2777s = 98%)
Max RSS bytes2361741312 (2252 MiB)
Outputting started2026-01-12 19:34:56
Output files
Finished2026-01-12 19:35:21
Saved logsjustin-logs:276491.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

er *****************
**> There are 3 hits, 2 isolated hits, the alpha parameter is 0.0789488
**> PCA len: 1.09931, wid: 0.086789, height: -nan, ratio: -nan
**> Sorted 2 hits, longest distance: 0.583622
**> Best path has 3 hits, 2 edges
************* Finding best path with A* in cluster *****************
**> There are 3 hits, 2 isolated hits, the alpha parameter is 0.0187573
**> PCA len: 1.39911, wid: 0.0262437, height: 1.6263e-08, ratio: 6.19691e-07
**> Sorted 2 hits, longest distance: 0.805833
**> Best path has 3 hits, 2 edges
************* Finding best path with A* in cluster *****************
**> There are 3 hits, 2 isolated hits, the alpha parameter is 0.0430241
**> PCA len: 1.50579, wid: 0.0647853, height: -nan, ratio: -nan
**> Sorted 2 hits, longest distance: 0.65214
**> Best path has 3 hits, 2 edges
************* Finding best path with A* in cluster *****************
**> There are 3 hits, 2 isolated hits, the alpha parameter is 0.0435321
**> PCA len: 1.68838, wid: 0.0734987, height: -nan, ratio: -nan
**> Sorted 2 hits, longest distance: 0.693043
**> Best path has 3 hits, 2 edges
************* Finding best path with A* in cluster *****************
**> There are 3 hits, 2 isolated hits, the alpha parameter is 0.170654
**> PCA len: 1.14954, wid: 0.196173, height: 1.28535e-08, ratio: 6.55211e-08
**> Sorted 2 hits, longest distance: 0.631153
**> Best path has 3 hits, 2 edges
************* Finding best path with A* in cluster *****************
**> There are 3 hits, 2 isolated hits, the alpha parameter is 0.738717
**> PCA len: 0.703399, wid: 0.519613, height: -nan, ratio: -nan
**> Sorted 2 hits, longest distance: 0.690843
**> Best path has 3 hits, 2 edges
************* Finding best path with A* in cluster *****************
**> There are 3 hits, 2 isolated hits, the alpha parameter is 0.20778
**> PCA len: 1.0003, wid: 0.207842, height: 0, ratio: 0
**> Sorted 2 hits, longest distance: 0.411322
**> Best path has 3 hits, 2 edges

Stderr:
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
  hitpdune
  pandora
  pandora2Shower
  pandora2Track
  pandora2cali
  pandora2calipid
  pandora2pid
  pandoraShower
  pandoraTrack
  pandoraWriter
  pandoracalipid
  pandorapid
  reco3d
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_15_00d00/gdml/protodune_v7.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 36176 nodes/ 5435 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
12-Jan-2026 19:24:57 GMT  Initiating request to open input file "prod_muon_400MeV_protodunevd_1_276491_1_1768243683_gen_g4_stage1_detsim.root"
12-Jan-2026 19:24:58 GMT  Opened input file "prod_muon_400MeV_protodunevd_1_276491_1_1768243683_gen_g4_stage1_detsim.root"
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 40426 traces, 40426 summary
Retagger: tagging trace set: gauss with 37027 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 37027 traces tagged "gauss"
FrameSaver: q=2.53501e+06 n=516691 tag=gauss
wclsFrameSaver: saving 40426 traces tagged "wiener"
FrameSaver: q=2.71395e+06 n=455751 tag=wiener
12-Jan-2026 19:27:09 GMT  Opened output file with pattern "prod_muon_400MeV_protodunevd_1_276491_1_1768243683_gen_g4_stage1_detsim_reco.root"
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 31166 traces, 31166 summary
Retagger: tagging trace set: gauss with 31325 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 31325 traces tagged "gauss"
FrameSaver: q=1.869e+06 n=462355 tag=gauss
wclsFrameSaver: saving 31166 traces tagged "wiener"
FrameSaver: q=1.99223e+06 n=422646 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 43336 traces, 43336 summary
Retagger: tagging trace set: gauss with 39601 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 39601 traces tagged "gauss"
FrameSaver: q=3.17623e+06 n=612980 tag=gauss
wclsFrameSaver: saving 43336 traces tagged "wiener"
FrameSaver: q=3.35508e+06 n=546942 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 35483 traces, 35483 summary
Retagger: tagging trace set: gauss with 33631 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 33631 traces tagged "gauss"
FrameSaver: q=2.95964e+06 n=485249 tag=gauss
wclsFrameSaver: saving 35483 traces tagged "wiener"
FrameSaver: q=3.22942e+06 n=436844 tag=wiener

Error in processing reco
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
  hitpdune
  pandora
  pandora2Shower
  pandora2Track
  pandora2cali
  pandora2calipid
  pandora2pid
  pandoraShower
  pandoraTrack
  pandoraWriter
  pandoracalipid
  pandorapid
  reco3d
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_15_00d00/gdml/protodune_v7.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 36176 nodes/ 5435 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
12-Jan-2026 19:24:57 GMT  Initiating request to open input file "prod_muon_400MeV_protodunevd_1_276491_1_1768243683_gen_g4_stage1_detsim.root"
12-Jan-2026 19:24:58 GMT  Opened input file "prod_muon_400MeV_protodunevd_1_276491_1_1768243683_gen_g4_stage1_detsim.root"
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 40426 traces, 40426 summary
Retagger: tagging trace set: gauss with 37027 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 37027 traces tagged "gauss"
FrameSaver: q=2.53501e+06 n=516691 tag=gauss
wclsFrameSaver: saving 40426 traces tagged "wiener"
FrameSaver: q=2.71395e+06 n=455751 tag=wiener
12-Jan-2026 19:27:09 GMT  Opened output file with pattern "prod_muon_400MeV_protodunevd_1_276491_1_1768243683_gen_g4_stage1_detsim_reco.root"
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 31166 traces, 31166 summary
Retagger: tagging trace set: gauss with 31325 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 31325 traces tagged "gauss"
FrameSaver: q=1.869e+06 n=462355 tag=gauss
wclsFrameSaver: saving 31166 traces tagged "wiener"
FrameSaver: q=1.99223e+06 n=422646 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 43336 traces, 43336 summary
Retagger: tagging trace set: gauss with 39601 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 39601 traces tagged "gauss"
FrameSaver: q=3.17623e+06 n=612980 tag=gauss
wclsFrameSaver: saving 43336 traces tagged "wiener"
FrameSaver: q=3.35508e+06 n=546942 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 35483 traces, 35483 summary
Retagger: tagging trace set: gauss with 33631 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 33631 traces tagged "gauss"
FrameSaver: q=2.95964e+06 n=485249 tag=gauss
wclsFrameSaver: saving 35483 traces tagged "wiener"
FrameSaver: q=3.22942e+06 n=436844 tag=wiener

ls: cannot access *_g4_stage2.root: No such file or directory
ls: cannot access *_reco.root: No such file or directory
Forming g4 metadata
Forming reco metadata
justIN time: 2026-02-06 09:02:15 UTC       justIN version: 01.06.00