justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 276297.1@dunegpschedd02.fnal.gov

Jobsub ID276297.1@dunegpschedd02.fnal.gov
Workflow ID12073
Stage ID1
User namenivedpm@fnal.gov
RequestedProcessors4
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-19 13:27:11
SiteCZ_FZU
EntryNova_CZ_FZU_osgce2
Last heartbeat2026-01-19 14:39:07
From worker nodeHostnamelupin09.farm.particle.cz
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors4
RSS bytes7864320000 (7500 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-19 13:28:05
Input filesmonte-carlo-012073-000941
JobscriptExit code0
Real time1h (3999s)
CPU time1h (4088s = 102%)
Max RSS bytes20994564096 (20021 MiB)
Outputting started2026-01-19 14:35:00
Output files
Finished2026-01-19 14:39:07
Saved logsjustin-logs:276297.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

une.opensciencegrid.org/products/dune/dunecore/v10_16_00d00/gdml/protodune_v7.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 36176 nodes/ 5435 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
19-Jan-2026 15:00:37 CET  Initiating request to open input file "prod_mpvmpr_protodunesp_1_276297_1_1768829299_gen_g4_stage1_detsim.root"
19-Jan-2026 15:00:37 CET  Opened input file "prod_mpvmpr_protodunesp_1_276297_1_1768829299_gen_g4_stage1_detsim.root"
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 41190 traces, 41190 summary
Retagger: tagging trace set: gauss with 38596 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 38596 traces tagged "gauss"
FrameSaver: q=3.10509e+06 n=591799 tag=gauss
wclsFrameSaver: saving 41190 traces tagged "wiener"
FrameSaver: q=3.31184e+06 n=533653 tag=wiener
19-Jan-2026 15:02:13 CET  Opened output file with pattern "prod_mpvmpr_protodunesp_1_276297_1_1768829299_gen_g4_stage1_detsim_reco.root"
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 34040 traces, 34040 summary
Retagger: tagging trace set: gauss with 31976 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 31976 traces tagged "gauss"
FrameSaver: q=1.76236e+06 n=411478 tag=gauss
wclsFrameSaver: saving 34040 traces tagged "wiener"
FrameSaver: q=1.89329e+06 n=357248 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 53331 traces, 53331 summary
Retagger: tagging trace set: gauss with 44868 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 44868 traces tagged "gauss"
FrameSaver: q=3.72823e+06 n=670385 tag=gauss
wclsFrameSaver: saving 53331 traces tagged "wiener"
FrameSaver: q=3.95501e+06 n=573700 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 35673 traces, 35673 summary
Retagger: tagging trace set: gauss with 34494 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 34494 traces tagged "gauss"
FrameSaver: q=2.6182e+06 n=551028 tag=gauss
wclsFrameSaver: saving 35673 traces tagged "wiener"
FrameSaver: q=2.75456e+06 n=507519 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 46745 traces, 46745 summary
Retagger: tagging trace set: gauss with 40135 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 40135 traces tagged "gauss"
FrameSaver: q=3.58089e+06 n=564808 tag=gauss
wclsFrameSaver: saving 46745 traces tagged "wiener"
FrameSaver: q=3.89013e+06 n=490379 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 47474 traces, 47474 summary
Retagger: tagging trace set: gauss with 40896 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 40896 traces tagged "gauss"
FrameSaver: q=3.27243e+06 n=595407 tag=gauss
wclsFrameSaver: saving 47474 traces tagged "wiener"
FrameSaver: q=3.52366e+06 n=519167 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 37253 traces, 37253 summary
Retagger: tagging trace set: gauss with 34629 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 34629 traces tagged "gauss"
FrameSaver: q=2.23956e+06 n=476522 tag=gauss
wclsFrameSaver: saving 37253 traces tagged "wiener"
FrameSaver: q=2.41661e+06 n=421281 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 38713 traces, 38713 summary
Retagger: tagging trace set: gauss with 35083 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 35083 traces tagged "gauss"
FrameSaver: q=2.61544e+06 n=475107 tag=gauss
wclsFrameSaver: saving 38713 traces tagged "wiener"
FrameSaver: q=2.87748e+06 n=421967 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 47310 traces, 47310 summary
Retagger: tagging trace set: gauss with 42653 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 42653 traces tagged "gauss"
FrameSaver: q=3.21453e+06 n=641107 tag=gauss
wclsFrameSaver: saving 47310 traces tagged "wiener"
FrameSaver: q=3.42754e+06 n=565997 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 39540 traces, 39540 summary
Retagger: tagging trace set: gauss with 37855 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 37855 traces tagged "gauss"
FrameSaver: q=3.02201e+06 n=621147 tag=gauss
wclsFrameSaver: saving 39540 traces tagged "wiener"
FrameSaver: q=3.2284e+06 n=577185 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 55647 traces, 55647 summary
Retagger: tagging trace set: gauss with 50659 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 50659 traces tagged "gauss"
FrameSaver: q=5.18221e+06 n=829302 tag=gauss
wclsFrameSaver: saving 55647 traces tagged "wiener"
FrameSaver: q=5.61257e+06 n=758266 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 54364 traces, 54364 summary
Retagger: tagging trace set: gauss with 48541 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 48541 traces tagged "gauss"
FrameSaver: q=4.02567e+06 n=772341 tag=gauss
wclsFrameSaver: saving 54364 traces tagged "wiener"
FrameSaver: q=4.25407e+06 n=690004 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 44229 traces, 44229 summary
Retagger: tagging trace set: gauss with 39248 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 39248 traces tagged "gauss"
FrameSaver: q=2.89129e+06 n=563572 tag=gauss
wclsFrameSaver: saving 44229 traces tagged "wiener"
FrameSaver: q=3.13108e+06 n=502713 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 33436 traces, 33436 summary
Retagger: tagging trace set: gauss with 31879 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 31879 traces tagged "gauss"
FrameSaver: q=1.94505e+06 n=415444 tag=gauss
wclsFrameSaver: saving 33436 traces tagged "wiener"
FrameSaver: q=2.10284e+06 n=366812 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 33095 traces, 33095 summary
Retagger: tagging trace set: gauss with 32337 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 32337 traces tagged "gauss"
FrameSaver: q=2.19269e+06 n=452637 tag=gauss
wclsFrameSaver: saving 33095 traces tagged "wiener"
FrameSaver: q=2.33436e+06 n=407202 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 42357 traces, 42357 summary
Retagger: tagging trace set: gauss with 41335 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 41335 traces tagged "gauss"
FrameSaver: q=3.6566e+06 n=686872 tag=gauss
wclsFrameSaver: saving 42357 traces tagged "wiener"
FrameSaver: q=3.84409e+06 n=635015 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 39976 traces, 39976 summary
Retagger: tagging trace set: gauss with 36690 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 36690 traces tagged "gauss"
FrameSaver: q=3.2703e+06 n=530151 tag=gauss
wclsFrameSaver: saving 39976 traces tagged "wiener"
FrameSaver: q=3.57497e+06 n=470466 tag=wiener

ls: cannot access *larcvpdsp*.root: No such file or directory
Output files:
 larcv files: 
formed
{
  "name": "",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_16_00d00",
    "core.data_tier": "root-tuple-virtual",
    "core.runs": null,
    "core.runs_subruns": null,
    "dune.config_file": "run_supera_pdunesp_mpvmpr_d.fcl",
    "dune.campaign": "sp-protodune-spine-reco",
    "core.start_time": 1768829298.0,
    "core.end_time": 1768833282.0
  }
}
justIN time: 2026-02-05 18:28:46 UTC       justIN version: 01.06.00