justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 277491.0@dunegpschedd01.fnal.gov

Jobsub ID277491.0@dunegpschedd01.fnal.gov
Workflow ID11746
Stage ID1
User namenivedpm@fnal.gov
RequestedProcessors4
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-14 00:13:55
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_dissel_multicore
Last heartbeat2026-01-14 00:52:42
From worker nodeHostnamewn-lot-034.farm.nikhef.nl
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors4
RSS bytes7864320000 (7500 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-14 00:14:37
Input filesmonte-carlo-011746-000009
JobscriptExit code0
Real time37m (2261s)
CPU time35m (2124s = 93%)
Max RSS bytes2535297024 (2417 MiB)
Outputting started2026-01-14 00:52:19
Output files
Finished2026-01-14 00:52:42
Saved logsjustin-logs:277491.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

e are 3 hits, 2 isolated hits, the alpha parameter is 0.19577
**> PCA len: 1.24727, wid: 0.244178, height: 3.63398e-09, ratio: 1.48825e-08
**> Sorted 2 hits, longest distance: 0.57744
**> Best path has 3 hits, 2 edges
************* Finding best path with A* in cluster *****************
**> There are 3 hits, 2 isolated hits, the alpha parameter is 0.547384
**> PCA len: 0.68323, wid: 0.373989, height: -nan, ratio: -nan
**> Sorted 2 hits, longest distance: 0.460575
**> Best path has 3 hits, 2 edges
************* Finding best path with A* in cluster *****************
**> There are 3 hits, 2 isolated hits, the alpha parameter is 0.0740102
**> PCA len: 1.73606, wid: 0.128486, height: -nan, ratio: -nan
**> Sorted 2 hits, longest distance: 0.800066
**> Best path has 3 hits, 2 edges
************* Finding best path with A* in cluster *****************
**> There are 3 hits, 2 isolated hits, the alpha parameter is 0.0692305
**> PCA len: 1.62052, wid: 0.112189, height: 1.48189e-08, ratio: 1.32089e-07
**> Sorted 2 hits, longest distance: 0.66131
**> Best path has 3 hits, 2 edges
************* Finding best path with A* in cluster *****************
**> There are 3 hits, 2 isolated hits, the alpha parameter is 0.0590298
**> PCA len: 2.25767, wid: 0.13327, height: -nan, ratio: -nan
**> Sorted 2 hits, longest distance: 1.16293
**> Best path has 3 hits, 2 edges
************* Finding best path with A* in cluster *****************
**> There are 3 hits, 2 isolated hits, the alpha parameter is 0.178313
**> PCA len: 2.02427, wid: 0.360954, height: -nan, ratio: -nan
**> Sorted 2 hits, longest distance: 1.50086
**> Best path has 3 hits, 2 edges
************* Finding best path with A* in cluster *****************
**> There are 3 hits, 2 isolated hits, the alpha parameter is 0.001
**> PCA len: 0.985866, wid: 0, height: 0, ratio: -nan
**> Sorted 2 hits, longest distance: 0.950407
**> Best path has 3 hits, 2 edges
************* Finding best path with A* in cluster *****************
**> There are 3 hits, 2 isolated hits, the alpha parameter is 0.629062
**> PCA len: 1.11829, wid: 0.703476, height: -nan, ratio: -nan
**> Sorted 2 hits, longest distance: 0.607309
**> Best path has 3 hits, 2 edges
************* Finding best path with A* in cluster *****************
**> There are 3 hits, 2 isolated hits, the alpha parameter is 0.396391
**> PCA len: 1.00243, wid: 0.397354, height: -nan, ratio: -nan
**> Sorted 2 hits, longest distance: 0.617762
**> Best path has 3 hits, 2 edges
************* Finding best path with A* in cluster *****************
**> There are 3 hits, 2 isolated hits, the alpha parameter is 0.00343227
**> PCA len: 1.78505, wid: 0.00612678, height: -nan, ratio: -nan
**> Sorted 2 hits, longest distance: 0.6564
**> Best path has 3 hits, 2 edges
************* Finding best path with A* in cluster *****************
**> There are 3 hits, 2 isolated hits, the alpha parameter is 0.202036
**> PCA len: 1.78547, wid: 0.360729, height: -nan, ratio: -nan
**> Sorted 2 hits, longest distance: 1.20072
**> Best path has 3 hits, 2 edges
************* Finding best path with A* in cluster *****************
**> There are 3 hits, 2 isolated hits, the alpha parameter is 0.0145179
**> PCA len: 1.28797, wid: 0.0186985, height: 7.11492e-09, ratio: 3.80507e-07
**> Sorted 2 hits, longest distance: 0.594569
**> Best path has 3 hits, 2 edges

Stderr:
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
  crtreco
  crttag
  emtrkmichelid
  hitpdune
  pandora
  pandora2GnocchiCalo
  pandora2GnocchiCalonosce
  pandora2Shower
  pandora2Showercalo
  pandora2Showercalonosce
  pandora2Track
  pandora2calo
  pandora2calonosce
  pandoraGnocchiCalo
  pandoraGnocchiCalonosce
  pandoraShower
  pandoraShowercalo
  pandoraShowercalonosce
  pandoraTrack
  pandoraWriter
  pandoracalo
  pandoracalonosce
  pandorapid
  reco3d
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_15_00d00/gdml/protodunehd_v6_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
14-Jan-2026 01:49:46 CET  Initiating request to open input file "prod_mpvmpr_protodunehd_1_277491_0_1768349686_gen_g4_stage1_detsim.root"
14-Jan-2026 01:49:47 CET  Opened input file "prod_mpvmpr_protodunehd_1_277491_0_1768349686_gen_g4_stage1_detsim.root"
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 41795 traces, 41795 summary
Retagger: tagging trace set: gauss with 38850 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 38850 traces tagged "gauss"
FrameSaver: q=490930 n=426730 tag=gauss
wclsFrameSaver: saving 41795 traces tagged "wiener"
FrameSaver: q=697020 n=453188 tag=wiener
14-Jan-2026 01:50:47 CET  Opened output file with pattern "prod_mpvmpr_protodunehd_1_277491_0_1768349686_gen_g4_stage1_detsim_reco.root"
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 42958 traces, 42958 summary
Retagger: tagging trace set: gauss with 39822 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 39822 traces tagged "gauss"
FrameSaver: q=566849 n=475264 tag=gauss
wclsFrameSaver: saving 42958 traces tagged "wiener"
FrameSaver: q=767060 n=495556 tag=wiener

Error in processing reco
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
  crtreco
  crttag
  emtrkmichelid
  hitpdune
  pandora
  pandora2GnocchiCalo
  pandora2GnocchiCalonosce
  pandora2Shower
  pandora2Showercalo
  pandora2Showercalonosce
  pandora2Track
  pandora2calo
  pandora2calonosce
  pandoraGnocchiCalo
  pandoraGnocchiCalonosce
  pandoraShower
  pandoraShowercalo
  pandoraShowercalonosce
  pandoraTrack
  pandoraWriter
  pandoracalo
  pandoracalonosce
  pandorapid
  reco3d
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_15_00d00/gdml/protodunehd_v6_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
14-Jan-2026 01:49:46 CET  Initiating request to open input file "prod_mpvmpr_protodunehd_1_277491_0_1768349686_gen_g4_stage1_detsim.root"
14-Jan-2026 01:49:47 CET  Opened input file "prod_mpvmpr_protodunehd_1_277491_0_1768349686_gen_g4_stage1_detsim.root"
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 41795 traces, 41795 summary
Retagger: tagging trace set: gauss with 38850 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 38850 traces tagged "gauss"
FrameSaver: q=490930 n=426730 tag=gauss
wclsFrameSaver: saving 41795 traces tagged "wiener"
FrameSaver: q=697020 n=453188 tag=wiener
14-Jan-2026 01:50:47 CET  Opened output file with pattern "prod_mpvmpr_protodunehd_1_277491_0_1768349686_gen_g4_stage1_detsim_reco.root"
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 42958 traces, 42958 summary
Retagger: tagging trace set: gauss with 39822 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 39822 traces tagged "gauss"
FrameSaver: q=566849 n=475264 tag=gauss
wclsFrameSaver: saving 42958 traces tagged "wiener"
FrameSaver: q=767060 n=495556 tag=wiener

ls: cannot access *_g4_stage2.root: No such file or directory
ls: cannot access *_reco.root: No such file or directory
Forming g4 metadata
Forming reco metadata
justIN time: 2026-02-06 09:00:45 UTC       justIN version: 01.06.00