justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 276677.1@dunegpschedd01.fnal.gov

Jobsub ID276677.1@dunegpschedd01.fnal.gov
Workflow ID11778
Stage ID1
User namenivedpm@fnal.gov
RequestedProcessors4
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-13 04:16:54
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_klomp_multicore
Last heartbeat2026-01-13 05:13:55
From worker nodeHostnamewn-pijl-025.farm.nikhef.nl
cpuinfoAMD EPYC 9754 128-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors4
RSS bytes7864320000 (7500 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-13 04:17:55
Input filesmonte-carlo-011778-000018
JobscriptExit code0
Real time55m (3319s)
CPU time54m (3284s = 98%)
Max RSS bytes2459824128 (2345 MiB)
Outputting started2026-01-13 05:13:16
Output files
Finished2026-01-13 05:13:55
Saved logsjustin-logs:276677.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0357e+06 n=594965 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 38543 traces, 38543 summary
Retagger: tagging trace set: gauss with 35308 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 35308 traces tagged "gauss"
FrameSaver: q=2.32172e+06 n=501401 tag=gauss
wclsFrameSaver: saving 38543 traces tagged "wiener"
FrameSaver: q=2.49871e+06 n=445742 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 34983 traces, 34983 summary
Retagger: tagging trace set: gauss with 32211 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 32211 traces tagged "gauss"
FrameSaver: q=2.06105e+06 n=435654 tag=gauss
wclsFrameSaver: saving 34983 traces tagged "wiener"
FrameSaver: q=2.26882e+06 n=390084 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 31256 traces, 31256 summary
Retagger: tagging trace set: gauss with 31768 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 31768 traces tagged "gauss"
FrameSaver: q=2.19838e+06 n=472199 tag=gauss
wclsFrameSaver: saving 31256 traces tagged "wiener"
FrameSaver: q=2.34435e+06 n=435758 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 34512 traces, 34512 summary
Retagger: tagging trace set: gauss with 32163 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 32163 traces tagged "gauss"
FrameSaver: q=1.8583e+06 n=431018 tag=gauss
wclsFrameSaver: saving 34512 traces tagged "wiener"
FrameSaver: q=1.9681e+06 n=373670 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 37718 traces, 37718 summary
Retagger: tagging trace set: gauss with 35202 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 35202 traces tagged "gauss"
FrameSaver: q=2.55812e+06 n=489369 tag=gauss
wclsFrameSaver: saving 37718 traces tagged "wiener"
FrameSaver: q=2.71957e+06 n=433404 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 41634 traces, 41634 summary
Retagger: tagging trace set: gauss with 39167 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 39167 traces tagged "gauss"
FrameSaver: q=2.80046e+06 n=593495 tag=gauss
wclsFrameSaver: saving 41634 traces tagged "wiener"
FrameSaver: q=3.00172e+06 n=539909 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 42411 traces, 42411 summary
Retagger: tagging trace set: gauss with 38219 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 38219 traces tagged "gauss"
FrameSaver: q=2.97517e+06 n=570256 tag=gauss
wclsFrameSaver: saving 42411 traces tagged "wiener"
FrameSaver: q=3.20129e+06 n=514094 tag=wiener

Error in processing reco
The following module labels are either not assigned to any path,
or they have been assigned to ignored path(s):
  hitpdune
  pandora
  pandora2Shower
  pandora2Track
  pandora2cali
  pandora2calipid
  pandora2pid
  pandoraShower
  pandoraTrack
  pandoraWriter
  pandoracalipid
  pandorapid
  reco3d
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_15_00d00/gdml/protodune_v7.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 36176 nodes/ 5435 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
13-Jan-2026 05:53:39 CET  Initiating request to open input file "prod_muon_400MeV_protodunevd_1_276677_1_1768277894_gen_g4_stage1_detsim.root"
13-Jan-2026 05:53:40 CET  Opened input file "prod_muon_400MeV_protodunevd_1_276677_1_1768277894_gen_g4_stage1_detsim.root"
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 37950 traces, 37950 summary
Retagger: tagging trace set: gauss with 37608 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 37608 traces tagged "gauss"
FrameSaver: q=3.09737e+06 n=642387 tag=gauss
wclsFrameSaver: saving 37950 traces tagged "wiener"
FrameSaver: q=3.25375e+06 n=599894 tag=wiener
13-Jan-2026 05:55:33 CET  Opened output file with pattern "prod_muon_400MeV_protodunevd_1_276677_1_1768277894_gen_g4_stage1_detsim_reco.root"
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 53983 traces, 53983 summary
Retagger: tagging trace set: gauss with 45441 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 45441 traces tagged "gauss"
FrameSaver: q=3.75413e+06 n=672068 tag=gauss
wclsFrameSaver: saving 53983 traces tagged "wiener"
FrameSaver: q=4.04307e+06 n=585702 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 49140 traces, 49140 summary
Retagger: tagging trace set: gauss with 44401 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 44401 traces tagged "gauss"
FrameSaver: q=4.05364e+06 n=669427 tag=gauss
wclsFrameSaver: saving 49140 traces tagged "wiener"
FrameSaver: q=4.40357e+06 n=594965 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 38543 traces, 38543 summary
Retagger: tagging trace set: gauss with 35308 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 35308 traces tagged "gauss"
FrameSaver: q=2.32172e+06 n=501401 tag=gauss
wclsFrameSaver: saving 38543 traces tagged "wiener"
FrameSaver: q=2.49871e+06 n=445742 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 34983 traces, 34983 summary
Retagger: tagging trace set: gauss with 32211 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 32211 traces tagged "gauss"
FrameSaver: q=2.06105e+06 n=435654 tag=gauss
wclsFrameSaver: saving 34983 traces tagged "wiener"
FrameSaver: q=2.26882e+06 n=390084 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 31256 traces, 31256 summary
Retagger: tagging trace set: gauss with 31768 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 31768 traces tagged "gauss"
FrameSaver: q=2.19838e+06 n=472199 tag=gauss
wclsFrameSaver: saving 31256 traces tagged "wiener"
FrameSaver: q=2.34435e+06 n=435758 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 34512 traces, 34512 summary
Retagger: tagging trace set: gauss with 32163 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 32163 traces tagged "gauss"
FrameSaver: q=1.8583e+06 n=431018 tag=gauss
wclsFrameSaver: saving 34512 traces tagged "wiener"
FrameSaver: q=1.9681e+06 n=373670 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 37718 traces, 37718 summary
Retagger: tagging trace set: gauss with 35202 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 35202 traces tagged "gauss"
FrameSaver: q=2.55812e+06 n=489369 tag=gauss
wclsFrameSaver: saving 37718 traces tagged "wiener"
FrameSaver: q=2.71957e+06 n=433404 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 41634 traces, 41634 summary
Retagger: tagging trace set: gauss with 39167 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 39167 traces tagged "gauss"
FrameSaver: q=2.80046e+06 n=593495 tag=gauss
wclsFrameSaver: saving 41634 traces tagged "wiener"
FrameSaver: q=3.00172e+06 n=539909 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 42411 traces, 42411 summary
Retagger: tagging trace set: gauss with 38219 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 38219 traces tagged "gauss"
FrameSaver: q=2.97517e+06 n=570256 tag=gauss
wclsFrameSaver: saving 42411 traces tagged "wiener"
FrameSaver: q=3.20129e+06 n=514094 tag=wiener

ls: cannot access *_g4_stage2.root: No such file or directory
ls: cannot access *_reco.root: No such file or directory
Forming g4 metadata
Forming reco metadata
justIN time: 2026-02-06 07:39:13 UTC       justIN version: 01.06.00