justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 271489.1@dunegpschedd02.fnal.gov

Jobsub ID271489.1@dunegpschedd02.fnal.gov
Workflow ID11816
Stage ID1
User namenivedpm@fnal.gov
RequestedProcessors4
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-13 15:45:28
SiteCZ_FZU
EntryNova_CZ_FZU_osgce2
Last heartbeat2026-01-13 16:43:52
From worker nodeHostnamemahagon20.farm.particle.cz
cpuinfoAMD EPYC 7301 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors4
RSS bytes7864320000 (7500 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-13 15:48:03
Input filesmonte-carlo-011816-000812
JobscriptExit code0
Real time55m (3318s)
CPU time53m (3239s = 97%)
Max RSS bytes1886601216 (1799 MiB)
Outputting started2026-01-13 16:43:23
Output files
Finished2026-01-13 16:43:52
Saved logsjustin-logs:271489.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

e "prod_muon_400MeV_protodunevd_1_271489_1_1768319298_gen_g4_stage1_g4_stage2_detsim.root"
13-Jan-2026 17:13:47 CET  Opened input file "prod_muon_400MeV_protodunevd_1_271489_1_1768319298_gen_g4_stage1_g4_stage2_detsim.root"
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 27302 traces, 27302 summary
Retagger: tagging trace set: gauss with 21146 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 21146 traces tagged "gauss"
FrameSaver: q=3.93024e+06 n=343468 tag=gauss
wclsFrameSaver: saving 27302 traces tagged "wiener"
FrameSaver: q=4.22435e+06 n=321930 tag=wiener
13-Jan-2026 17:15:09 CET  Opened output file with pattern "prod_muon_400MeV_protodunevd_1_271489_1_1768319298_gen_g4_stage1_g4_stage2_detsim_reco.root"
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 21775 traces, 21775 summary
Retagger: tagging trace set: gauss with 17144 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 17144 traces tagged "gauss"
FrameSaver: q=3.17689e+06 n=280895 tag=gauss
wclsFrameSaver: saving 21775 traces tagged "wiener"
FrameSaver: q=3.38447e+06 n=257795 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 18442 traces, 18442 summary
Retagger: tagging trace set: gauss with 13292 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 13292 traces tagged "gauss"
FrameSaver: q=2.22117e+06 n=194254 tag=gauss
wclsFrameSaver: saving 18442 traces tagged "wiener"
FrameSaver: q=2.45351e+06 n=166907 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 21819 traces, 21819 summary
Retagger: tagging trace set: gauss with 16653 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 16653 traces tagged "gauss"
FrameSaver: q=3.80816e+06 n=297272 tag=gauss
wclsFrameSaver: saving 21819 traces tagged "wiener"
FrameSaver: q=4.03636e+06 n=272448 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 23362 traces, 23362 summary
Retagger: tagging trace set: gauss with 17993 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 17993 traces tagged "gauss"
FrameSaver: q=4.50559e+06 n=316462 tag=gauss
wclsFrameSaver: saving 23362 traces tagged "wiener"
FrameSaver: q=4.81625e+06 n=291491 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 24589 traces, 24589 summary
Retagger: tagging trace set: gauss with 17257 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 17257 traces tagged "gauss"
FrameSaver: q=2.98741e+06 n=255661 tag=gauss
wclsFrameSaver: saving 24589 traces tagged "wiener"
FrameSaver: q=3.26367e+06 n=222652 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 28141 traces, 28141 summary
Retagger: tagging trace set: gauss with 22424 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 22424 traces tagged "gauss"
FrameSaver: q=4.76045e+06 n=352827 tag=gauss
wclsFrameSaver: saving 28141 traces tagged "wiener"
FrameSaver: q=5.08948e+06 n=323101 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 16998 traces, 16998 summary
Retagger: tagging trace set: gauss with 12489 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 12489 traces tagged "gauss"
FrameSaver: q=1.98983e+06 n=191682 tag=gauss
wclsFrameSaver: saving 16998 traces tagged "wiener"
FrameSaver: q=2.16066e+06 n=168730 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 26456 traces, 26456 summary
Retagger: tagging trace set: gauss with 19869 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 19869 traces tagged "gauss"
FrameSaver: q=4.73392e+06 n=347869 tag=gauss
wclsFrameSaver: saving 26456 traces tagged "wiener"
FrameSaver: q=5.04971e+06 n=319235 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 23418 traces, 23418 summary
Retagger: tagging trace set: gauss with 19230 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 19230 traces tagged "gauss"
FrameSaver: q=3.50808e+06 n=296625 tag=gauss
wclsFrameSaver: saving 23418 traces tagged "wiener"
FrameSaver: q=3.72153e+06 n=274395 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 18504 traces, 18504 summary
Retagger: tagging trace set: gauss with 14487 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 14487 traces tagged "gauss"
FrameSaver: q=2.58634e+06 n=239022 tag=gauss
wclsFrameSaver: saving 18504 traces tagged "wiener"
FrameSaver: q=2.75533e+06 n=220307 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 24212 traces, 24212 summary
Retagger: tagging trace set: gauss with 18845 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 18845 traces tagged "gauss"
FrameSaver: q=3.66227e+06 n=298996 tag=gauss
wclsFrameSaver: saving 24212 traces tagged "wiener"
FrameSaver: q=3.91073e+06 n=273853 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 18804 traces, 18804 summary
Retagger: tagging trace set: gauss with 15485 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 15485 traces tagged "gauss"
FrameSaver: q=3.06563e+06 n=269896 tag=gauss
wclsFrameSaver: saving 18804 traces tagged "wiener"
FrameSaver: q=3.21674e+06 n=256233 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 29132 traces, 29132 summary
Retagger: tagging trace set: gauss with 20653 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 20653 traces tagged "gauss"
FrameSaver: q=3.83005e+06 n=314702 tag=gauss
wclsFrameSaver: saving 29132 traces tagged "wiener"
FrameSaver: q=4.20719e+06 n=279287 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 24054 traces, 24054 summary
Retagger: tagging trace set: gauss with 19104 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 19104 traces tagged "gauss"
FrameSaver: q=3.9803e+06 n=343289 tag=gauss
wclsFrameSaver: saving 24054 traces tagged "wiener"
FrameSaver: q=4.18431e+06 n=320686 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 25574 traces, 25574 summary
Retagger: tagging trace set: gauss with 19946 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 19946 traces tagged "gauss"
FrameSaver: q=4.31166e+06 n=341858 tag=gauss
wclsFrameSaver: saving 25574 traces tagged "wiener"
FrameSaver: q=4.61792e+06 n=312440 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 15937 traces, 15937 summary
Retagger: tagging trace set: gauss with 11647 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 11647 traces tagged "gauss"
FrameSaver: q=1.88552e+06 n=180750 tag=gauss
wclsFrameSaver: saving 15937 traces tagged "wiener"
FrameSaver: q=2.07087e+06 n=164725 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 22132 traces, 22132 summary
Retagger: tagging trace set: gauss with 18050 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 18050 traces tagged "gauss"
FrameSaver: q=3.55474e+06 n=304254 tag=gauss
wclsFrameSaver: saving 22132 traces tagged "wiener"
FrameSaver: q=3.79317e+06 n=284662 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 19819 traces, 19819 summary
Retagger: tagging trace set: gauss with 15776 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 15776 traces tagged "gauss"
FrameSaver: q=2.54138e+06 n=243732 tag=gauss
wclsFrameSaver: saving 19819 traces tagged "wiener"
FrameSaver: q=2.73725e+06 n=225569 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 18332 traces, 18332 summary
Retagger: tagging trace set: gauss with 14025 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 14025 traces tagged "gauss"
FrameSaver: q=2.38601e+06 n=212242 tag=gauss
wclsFrameSaver: saving 18332 traces tagged "wiener"
FrameSaver: q=2.58074e+06 n=192122 tag=wiener

ls: cannot access *larcvpdvd*.root: No such file or directory
Output files:
 larcv files: 
formed
{
  "name": "",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_16_00d00",
    "core.data_tier": "root-tuple-virtual",
    "core.runs": null,
    "core.runs_subruns": null,
    "dune.config_file": "run_supera_pdunevd_mpvmpr_doublets.fcl",
    "dune.campaign": "vd-protodune-spine-reco",
    "core.start_time": 1768319297.0,
    "core.end_time": 1768322598.0
  }
}
justIN time: 2026-02-04 11:02:22 UTC       justIN version: 01.06.00