justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 292921.22@dunegpschedd02.fnal.gov

Jobsub ID292921.22@dunegpschedd02.fnal.gov
Workflow ID12174
Stage ID1
User namenivedpm@fnal.gov
RequestedProcessors4
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-21 16:24:57
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce4
Last heartbeat2026-01-21 17:57:00
From worker nodeHostnamen198.dur.scotgrid.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 5220 CPU @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors4
RSS bytes7864320000 (7500 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-21 16:26:46
Input filesmonte-carlo-012174-000073
JobscriptExit code0
Real time1h (5267s)
CPU time1h (4961s = 94%)
Max RSS bytes11353001984 (10827 MiB)
Outputting started2026-01-21 17:54:41
Output files
Finished2026-01-21 17:57:00
Saved logsjustin-logs:292921.22-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

cing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Inputer: "wclsRawFrameSource"
Outputer: "wclsFrameSaver:spsaver"
wclsFrameSaver: promising to produce recob::Wires named "gauss"
wclsFrameSaver: promising to produce recob::Wires named "wiener"
21-Jan-2026 17:04:52 GMT  Initiating request to open input file "prod_mpvmpr_protodunesp_1_292921_22_1769012832_gen_g4_stage1_detsim.root"
21-Jan-2026 17:04:52 GMT  Opened input file "prod_mpvmpr_protodunesp_1_292921_22_1769012832_gen_g4_stage1_detsim.root"
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 37253 traces, 37253 summary
Retagger: tagging trace set: gauss with 36214 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 36214 traces tagged "gauss"
FrameSaver: q=2.95092e+06 n=563834 tag=gauss
wclsFrameSaver: saving 37253 traces tagged "wiener"
FrameSaver: q=3.12168e+06 n=513645 tag=wiener
21-Jan-2026 17:06:54 GMT  Opened output file with pattern "prod_mpvmpr_protodunesp_1_292921_22_1769012832_gen_g4_stage1_detsim_reco.root"
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 52213 traces, 52213 summary
Retagger: tagging trace set: gauss with 45348 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 45348 traces tagged "gauss"
FrameSaver: q=3.69086e+06 n=666425 tag=gauss
wclsFrameSaver: saving 52213 traces tagged "wiener"
FrameSaver: q=3.93948e+06 n=584166 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 47801 traces, 47801 summary
Retagger: tagging trace set: gauss with 45414 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 45414 traces tagged "gauss"
FrameSaver: q=3.85634e+06 n=769512 tag=gauss
wclsFrameSaver: saving 47801 traces tagged "wiener"
FrameSaver: q=4.03795e+06 n=709388 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 38092 traces, 38092 summary
Retagger: tagging trace set: gauss with 34949 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 34949 traces tagged "gauss"
FrameSaver: q=2.6396e+06 n=481319 tag=gauss
wclsFrameSaver: saving 38092 traces tagged "wiener"
FrameSaver: q=3.05794e+06 n=441108 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 40161 traces, 40161 summary
Retagger: tagging trace set: gauss with 35357 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 35357 traces tagged "gauss"
FrameSaver: q=2.64736e+06 n=483103 tag=gauss
wclsFrameSaver: saving 40161 traces tagged "wiener"
FrameSaver: q=2.88348e+06 n=417349 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 44764 traces, 44764 summary
Retagger: tagging trace set: gauss with 40989 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 40989 traces tagged "gauss"
FrameSaver: q=3.95483e+06 n=640527 tag=gauss
wclsFrameSaver: saving 44764 traces tagged "wiener"
FrameSaver: q=4.35219e+06 n=583083 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 41110 traces, 41110 summary
Retagger: tagging trace set: gauss with 38282 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 38282 traces tagged "gauss"
FrameSaver: q=2.57507e+06 n=542994 tag=gauss
wclsFrameSaver: saving 41110 traces tagged "wiener"
FrameSaver: q=2.76927e+06 n=485267 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 46996 traces, 46996 summary
Retagger: tagging trace set: gauss with 43366 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 43366 traces tagged "gauss"
FrameSaver: q=4.41691e+06 n=681061 tag=gauss
wclsFrameSaver: saving 46996 traces tagged "wiener"
FrameSaver: q=4.77137e+06 n=622045 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 44223 traces, 44223 summary
Retagger: tagging trace set: gauss with 38182 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 38182 traces tagged "gauss"
FrameSaver: q=2.60587e+06 n=522579 tag=gauss
wclsFrameSaver: saving 44223 traces tagged "wiener"
FrameSaver: q=2.83812e+06 n=452911 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 51136 traces, 51136 summary
Retagger: tagging trace set: gauss with 43835 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 43835 traces tagged "gauss"
FrameSaver: q=3.73958e+06 n=642885 tag=gauss
wclsFrameSaver: saving 51136 traces tagged "wiener"
FrameSaver: q=4.12825e+06 n=568811 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 46796 traces, 46796 summary
Retagger: tagging trace set: gauss with 44052 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 44052 traces tagged "gauss"
FrameSaver: q=5.01964e+06 n=708702 tag=gauss
wclsFrameSaver: saving 46796 traces tagged "wiener"
FrameSaver: q=5.45247e+06 n=649140 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 53425 traces, 53425 summary
Retagger: tagging trace set: gauss with 44493 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 44493 traces tagged "gauss"
FrameSaver: q=3.82867e+06 n=661485 tag=gauss
wclsFrameSaver: saving 53425 traces tagged "wiener"
FrameSaver: q=4.22231e+06 n=584969 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 32404 traces, 32404 summary
Retagger: tagging trace set: gauss with 33236 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 33236 traces tagged "gauss"
FrameSaver: q=2.31446e+06 n=529176 tag=gauss
wclsFrameSaver: saving 32404 traces tagged "wiener"
FrameSaver: q=2.41949e+06 n=492979 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 38390 traces, 38390 summary
Retagger: tagging trace set: gauss with 37335 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 37335 traces tagged "gauss"
FrameSaver: q=2.47283e+06 n=542039 tag=gauss
wclsFrameSaver: saving 38390 traces tagged "wiener"
FrameSaver: q=2.65966e+06 n=492408 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 44886 traces, 44886 summary
Retagger: tagging trace set: gauss with 40015 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 40015 traces tagged "gauss"
FrameSaver: q=3.5837e+06 n=593466 tag=gauss
wclsFrameSaver: saving 44886 traces tagged "wiener"
FrameSaver: q=3.9356e+06 n=529424 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 45126 traces, 45126 summary
Retagger: tagging trace set: gauss with 41912 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 41912 traces tagged "gauss"
FrameSaver: q=3.65919e+06 n=672610 tag=gauss
wclsFrameSaver: saving 45126 traces tagged "wiener"
FrameSaver: q=3.93582e+06 n=612094 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 51940 traces, 51940 summary
Retagger: tagging trace set: gauss with 44668 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 44668 traces tagged "gauss"
FrameSaver: q=3.46715e+06 n=663452 tag=gauss
wclsFrameSaver: saving 51940 traces tagged "wiener"
FrameSaver: q=3.68985e+06 n=574351 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 37857 traces, 37857 summary
Retagger: tagging trace set: gauss with 35620 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 35620 traces tagged "gauss"
FrameSaver: q=2.39129e+06 n=497147 tag=gauss
wclsFrameSaver: saving 37857 traces tagged "wiener"
FrameSaver: q=2.52148e+06 n=437956 tag=wiener
RawFrameSource: got 15360 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 33758 traces, 33758 summary
Retagger: tagging trace set: gauss with 33138 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 33138 traces tagged "gauss"
FrameSaver: q=1.86275e+06 n=465548 tag=gauss
wclsFrameSaver: saving 33758 traces tagged "wiener"
FrameSaver: q=1.97612e+06 n=419209 tag=wiener

ls: cannot access *larcvpdsp*.root: No such file or directory
Output files:
 larcv files: 
formed
{
  "name": "",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_16_00d00",
    "core.data_tier": "root-tuple-virtual",
    "core.runs": null,
    "core.runs_subruns": null,
    "dune.config_file": "run_supera_pdunesp_mpvmpr_d.fcl",
    "dune.campaign": "sp-protodune-spine-reco",
    "core.start_time": 1769012831.0,
    "core.end_time": 1769018068.0
  }
}
justIN time: 2026-02-04 04:32:56 UTC       justIN version: 01.06.00