justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 279089.73@dunegpschedd01.fnal.gov

Jobsub ID	279089.73@dunegpschedd01.fnal.gov
Workflow ID	11899
Stage ID	1
User name	nivedpm@fnal.gov
Requested	Processors	4
	GPU	No
	RSS bytes	6815744000 (6500 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-15 12:39:53
Site	UK_Bristol
Entry	CMSHTPC_T2_UK_SGrid_Bristol_lcgce02
Last heartbeat	2026-01-15 13:22:06
From worker node	Hostname	hd89.dice.priv
	cpuinfo	AMD EPYC 7713 64-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	4
	RSS bytes	7864320000 (7500 MiB)
	Wall seconds limit	259200 (72 hours)
	GPU
	Inner Apptainer?	True
Job state	outputting_failed
Started	2026-01-15 12:49:41
Input files	monte-carlo-011899-000335
Jobscript	Exit code	1
	Real time	0m (0s)
	CPU time	0m (0s = 0%)
	Max RSS bytes	0 (0 MiB)
Outputting started
Output files
Finished	2026-01-15 13:22:06
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

meSaver: promising to produce recob::Wires named "wiener"
15-Jan-2026 13:05:27 UTC  Initiating request to open input file "prod_muon_400MeV_protodunevd_1_279089_73_1768481392_gen_g4_stage1_g4_stage2_detsim.root"
15-Jan-2026 13:05:28 UTC  Opened input file "prod_muon_400MeV_protodunevd_1_279089_73_1768481392_gen_g4_stage1_g4_stage2_detsim.root"
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 26623 traces, 26623 summary
Retagger: tagging trace set: gauss with 19543 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 19543 traces tagged "gauss"
FrameSaver: q=3.60014e+06 n=303825 tag=gauss
wclsFrameSaver: saving 26623 traces tagged "wiener"
FrameSaver: q=3.86404e+06 n=274626 tag=wiener
15-Jan-2026 13:06:16 UTC  Opened output file with pattern "prod_muon_400MeV_protodunevd_1_279089_73_1768481392_gen_g4_stage1_g4_stage2_detsim_reco.root"
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 14938 traces, 14938 summary
Retagger: tagging trace set: gauss with 10481 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 10481 traces tagged "gauss"
FrameSaver: q=1.71615e+06 n=161257 tag=gauss
wclsFrameSaver: saving 14938 traces tagged "wiener"
FrameSaver: q=1.88685e+06 n=142673 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 26199 traces, 26199 summary
Retagger: tagging trace set: gauss with 21175 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 21175 traces tagged "gauss"
FrameSaver: q=3.70581e+06 n=313868 tag=gauss
wclsFrameSaver: saving 26199 traces tagged "wiener"
FrameSaver: q=3.93645e+06 n=284223 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 15804 traces, 15804 summary
Retagger: tagging trace set: gauss with 11414 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 11414 traces tagged "gauss"
FrameSaver: q=1.65002e+06 n=166958 tag=gauss
wclsFrameSaver: saving 15804 traces tagged "wiener"
FrameSaver: q=1.80391e+06 n=143345 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 13566 traces, 13566 summary
Retagger: tagging trace set: gauss with 10872 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 10872 traces tagged "gauss"
FrameSaver: q=1.66586e+06 n=169469 tag=gauss
wclsFrameSaver: saving 13566 traces tagged "wiener"
FrameSaver: q=1.81227e+06 n=156415 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 14138 traces, 14138 summary
Retagger: tagging trace set: gauss with 11601 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 11601 traces tagged "gauss"
FrameSaver: q=2.17541e+06 n=203097 tag=gauss
wclsFrameSaver: saving 14138 traces tagged "wiener"
FrameSaver: q=2.30494e+06 n=191225 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 27379 traces, 27379 summary
Retagger: tagging trace set: gauss with 18845 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 18845 traces tagged "gauss"
FrameSaver: q=5.06247e+06 n=318727 tag=gauss
wclsFrameSaver: saving 27379 traces tagged "wiener"
FrameSaver: q=5.53916e+06 n=283924 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 17743 traces, 17743 summary
Retagger: tagging trace set: gauss with 13678 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 13678 traces tagged "gauss"
FrameSaver: q=2.51265e+06 n=213397 tag=gauss
wclsFrameSaver: saving 17743 traces tagged "wiener"
FrameSaver: q=2.70167e+06 n=196755 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 30664 traces, 30664 summary
Retagger: tagging trace set: gauss with 22657 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 22657 traces tagged "gauss"
FrameSaver: q=4.69066e+06 n=371047 tag=gauss
wclsFrameSaver: saving 30664 traces tagged "wiener"
FrameSaver: q=4.99514e+06 n=332703 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 27419 traces, 27419 summary
Retagger: tagging trace set: gauss with 21525 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 21525 traces tagged "gauss"
FrameSaver: q=4.02477e+06 n=326323 tag=gauss
wclsFrameSaver: saving 27419 traces tagged "wiener"
FrameSaver: q=4.35351e+06 n=296771 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 20118 traces, 20118 summary
Retagger: tagging trace set: gauss with 15694 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 15694 traces tagged "gauss"
FrameSaver: q=2.69156e+06 n=255211 tag=gauss
wclsFrameSaver: saving 20118 traces tagged "wiener"
FrameSaver: q=2.85794e+06 n=234343 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 20481 traces, 20481 summary
Retagger: tagging trace set: gauss with 17024 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 17024 traces tagged "gauss"
FrameSaver: q=3.31503e+06 n=283006 tag=gauss
wclsFrameSaver: saving 20481 traces tagged "wiener"
FrameSaver: q=3.51052e+06 n=266449 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 24787 traces, 24787 summary
Retagger: tagging trace set: gauss with 19817 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 19817 traces tagged "gauss"
FrameSaver: q=3.9287e+06 n=342724 tag=gauss
wclsFrameSaver: saving 24787 traces tagged "wiener"
FrameSaver: q=4.13e+06 n=319593 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 18947 traces, 18947 summary
Retagger: tagging trace set: gauss with 14125 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 14125 traces tagged "gauss"
FrameSaver: q=2.35694e+06 n=208735 tag=gauss
wclsFrameSaver: saving 18947 traces tagged "wiener"
FrameSaver: q=2.55992e+06 n=184687 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 17558 traces, 17558 summary
Retagger: tagging trace set: gauss with 13457 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 13457 traces tagged "gauss"
FrameSaver: q=2.40827e+06 n=213447 tag=gauss
wclsFrameSaver: saving 17558 traces tagged "wiener"
FrameSaver: q=2.60232e+06 n=194338 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 16956 traces, 16956 summary
Retagger: tagging trace set: gauss with 14142 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 14142 traces tagged "gauss"
FrameSaver: q=2.69904e+06 n=252591 tag=gauss
wclsFrameSaver: saving 16956 traces tagged "wiener"
FrameSaver: q=2.83499e+06 n=241457 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 23249 traces, 23249 summary
Retagger: tagging trace set: gauss with 18690 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 18690 traces tagged "gauss"
FrameSaver: q=3.93377e+06 n=347623 tag=gauss
wclsFrameSaver: saving 23249 traces tagged "wiener"
FrameSaver: q=4.13517e+06 n=331884 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 14010 traces, 14010 summary
Retagger: tagging trace set: gauss with 11141 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 11141 traces tagged "gauss"
FrameSaver: q=1.64202e+06 n=170341 tag=gauss
wclsFrameSaver: saving 14010 traces tagged "wiener"
FrameSaver: q=1.80742e+06 n=155716 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 18775 traces, 18775 summary
Retagger: tagging trace set: gauss with 14206 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 14206 traces tagged "gauss"
FrameSaver: q=2.85919e+06 n=225138 tag=gauss
wclsFrameSaver: saving 18775 traces tagged "wiener"
FrameSaver: q=3.08647e+06 n=199332 tag=wiener
RawFrameSource: got 12288 raw::RawDigit objects
	input nticks=6000 keeping as is
Retagger: tagging trace set: wiener with 19292 traces, 19292 summary
Retagger: tagging trace set: gauss with 15589 traces, 0 summary
wclsFrameSaver saving cooked to 6000 ticks
wclsFrameSaver: saving 15589 traces tagged "gauss"
FrameSaver: q=3.11139e+06 n=262490 tag=gauss
wclsFrameSaver: saving 19292 traces tagged "wiener"
FrameSaver: q=3.29755e+06 n=243831 tag=wiener

../justin-jobscript: line 167: date: command not found
../justin-jobscript: line 170: ls: command not found
Output files:
 larcv files: 
../justin-jobscript: line 175: grep: command not found
../justin-jobscript: line 175: grep: command not found
../justin-jobscript: line 175: cut: command not found
../justin-jobscript: line 177: /cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: Transport endpoint is not connected
Error in larcv metadata

justIN time: 2026-02-04 04:46:59 UTC       justIN version: 01.06.00