Jobsub ID 273485.70@dunegpschedd02.fnal.gov

Jobsub ID	273485.70@dunegpschedd02.fnal.gov
Workflow ID	11972
Stage ID	1
User name	imawby@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	1048576000 (1000 MiB)
	Wall seconds limit	7200 (2 hours)
Submitted time	2026-01-15 19:42:14
Site	UK_Bristol
Entry	CMSHTPC_T2_UK_SGrid_Bristol_lcgce02
Last heartbeat	2026-01-15 20:53:11
From worker node	Hostname	hd88.dice.priv
	cpuinfo	AMD EPYC 7713 64-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	1048576000 (1000 MiB)
	Wall seconds limit	259200 (72 hours)
	GPU
	Inner Apptainer?	True
Job state	outputting_failed
Started	2026-01-15 19:43:59
Input files	fardet-hd:nu_dune10kt_1x2x6_1100_451_20230826T034406Z_gen_g4_detsim_hitreco__20240229T201736Z_reco2.root
Jobscript	Exit code	0
	Real time	9m (592s)
	CPU time	5m (325s = 54%)
	Max RSS bytes	1306103808 (1245 MiB)
Outputting started	2026-01-15 19:53:53
Output files
Finished	2026-01-15 20:53:11
List job events Cached HTCondor job logs
Jobscript log (last 10,000 characters)

8969f3ed8/localProducts_larsoft_v10_13_00_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/44/79/nu_dune10kt_1x2x6_1100_451_20230826T034406Z_gen_g4_detsim_hitreco__20240229T201736Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Begin processing the 23rd record. run: 1100 subRun: 1 event: 45123 at 15-Jan-2026 19:48:59 UTC
Begin processing the 24th record. run: 1100 subRun: 1 event: 45124 at 15-Jan-2026 19:49:02 UTC
Begin processing the 25th record. run: 1100 subRun: 1 event: 45125 at 15-Jan-2026 19:49:04 UTC
Begin processing the 26th record. run: 1100 subRun: 1 event: 45126 at 15-Jan-2026 19:49:07 UTC
Begin processing the 27th record. run: 1100 subRun: 1 event: 45127 at 15-Jan-2026 19:49:09 UTC
Begin processing the 28th record. run: 1100 subRun: 1 event: 45128 at 15-Jan-2026 19:49:11 UTC
Begin processing the 29th record. run: 1100 subRun: 1 event: 45129 at 15-Jan-2026 19:49:15 UTC
Begin processing the 30th record. run: 1100 subRun: 1 event: 45130 at 15-Jan-2026 19:49:17 UTC
Begin processing the 31st record. run: 1100 subRun: 1 event: 45131 at 15-Jan-2026 19:49:20 UTC
Begin processing the 32nd record. run: 1100 subRun: 1 event: 45132 at 15-Jan-2026 19:49:30 UTC
Begin processing the 33rd record. run: 1100 subRun: 1 event: 45133 at 15-Jan-2026 19:49:34 UTC
Begin processing the 34th record. run: 1100 subRun: 1 event: 45134 at 15-Jan-2026 19:49:36 UTC
Begin processing the 35th record. run: 1100 subRun: 1 event: 45135 at 15-Jan-2026 19:49:39 UTC
Begin processing the 36th record. run: 1100 subRun: 1 event: 45136 at 15-Jan-2026 19:49:43 UTC
Begin processing the 37th record. run: 1100 subRun: 1 event: 45137 at 15-Jan-2026 19:49:45 UTC
Begin processing the 38th record. run: 1100 subRun: 1 event: 45138 at 15-Jan-2026 19:49:51 UTC
Begin processing the 39th record. run: 1100 subRun: 1 event: 45139 at 15-Jan-2026 19:49:53 UTC
Begin processing the 40th record. run: 1100 subRun: 1 event: 45140 at 15-Jan-2026 19:50:21 UTC
Begin processing the 41st record. run: 1100 subRun: 1 event: 45141 at 15-Jan-2026 19:50:23 UTC
Begin processing the 42nd record. run: 1100 subRun: 1 event: 45142 at 15-Jan-2026 19:50:26 UTC
Begin processing the 43rd record. run: 1100 subRun: 1 event: 45143 at 15-Jan-2026 19:50:28 UTC
Begin processing the 44th record. run: 1100 subRun: 1 event: 45144 at 15-Jan-2026 19:50:31 UTC
Begin processing the 45th record. run: 1100 subRun: 1 event: 45145 at 15-Jan-2026 19:50:45 UTC
Begin processing the 46th record. run: 1100 subRun: 1 event: 45146 at 15-Jan-2026 19:50:47 UTC
Begin processing the 47th record. run: 1100 subRun: 1 event: 45147 at 15-Jan-2026 19:50:50 UTC
Begin processing the 48th record. run: 1100 subRun: 1 event: 45148 at 15-Jan-2026 19:51:00 UTC
Begin processing the 49th record. run: 1100 subRun: 1 event: 45149 at 15-Jan-2026 19:51:10 UTC
Begin processing the 50th record. run: 1100 subRun: 1 event: 45150 at 15-Jan-2026 19:51:27 UTC
Begin processing the 51st record. run: 1100 subRun: 1 event: 45151 at 15-Jan-2026 19:51:30 UTC
Begin processing the 52nd record. run: 1100 subRun: 1 event: 45152 at 15-Jan-2026 19:51:32 UTC
Begin processing the 53rd record. run: 1100 subRun: 1 event: 45153 at 15-Jan-2026 19:51:35 UTC
Begin processing the 54th record. run: 1100 subRun: 1 event: 45154 at 15-Jan-2026 19:51:37 UTC
Begin processing the 55th record. run: 1100 subRun: 1 event: 45155 at 15-Jan-2026 19:51:40 UTC
Begin processing the 56th record. run: 1100 subRun: 1 event: 45156 at 15-Jan-2026 19:51:46 UTC
Begin processing the 57th record. run: 1100 subRun: 1 event: 45157 at 15-Jan-2026 19:51:49 UTC
Begin processing the 58th record. run: 1100 subRun: 1 event: 45158 at 15-Jan-2026 19:51:51 UTC
Begin processing the 59th record. run: 1100 subRun: 1 event: 45159 at 15-Jan-2026 19:51:54 UTC
Begin processing the 60th record. run: 1100 subRun: 1 event: 45160 at 15-Jan-2026 19:51:56 UTC
Begin processing the 61st record. run: 1100 subRun: 1 event: 45161 at 15-Jan-2026 19:52:00 UTC
Begin processing the 62nd record. run: 1100 subRun: 1 event: 45162 at 15-Jan-2026 19:52:08 UTC
Begin processing the 63rd record. run: 1100 subRun: 1 event: 45163 at 15-Jan-2026 19:52:10 UTC
Begin processing the 64th record. run: 1100 subRun: 1 event: 45164 at 15-Jan-2026 19:52:12 UTC
Begin processing the 65th record. run: 1100 subRun: 1 event: 45165 at 15-Jan-2026 19:52:15 UTC
Begin processing the 66th record. run: 1100 subRun: 1 event: 45166 at 15-Jan-2026 19:52:17 UTC
Begin processing the 67th record. run: 1100 subRun: 1 event: 45167 at 15-Jan-2026 19:52:19 UTC
Begin processing the 68th record. run: 1100 subRun: 1 event: 45168 at 15-Jan-2026 19:52:21 UTC
Begin processing the 69th record. run: 1100 subRun: 1 event: 45169 at 15-Jan-2026 19:52:24 UTC
Begin processing the 70th record. run: 1100 subRun: 1 event: 45170 at 15-Jan-2026 19:52:27 UTC
Begin processing the 71st record. run: 1100 subRun: 1 event: 45171 at 15-Jan-2026 19:52:29 UTC
Begin processing the 72nd record. run: 1100 subRun: 1 event: 45172 at 15-Jan-2026 19:52:31 UTC
Begin processing the 73rd record. run: 1100 subRun: 1 event: 45173 at 15-Jan-2026 19:52:34 UTC
Begin processing the 74th record. run: 1100 subRun: 1 event: 45174 at 15-Jan-2026 19:52:36 UTC
Begin processing the 75th record. run: 1100 subRun: 1 event: 45175 at 15-Jan-2026 19:52:38 UTC
Begin processing the 76th record. run: 1100 subRun: 1 event: 45176 at 15-Jan-2026 19:52:41 UTC
Begin processing the 77th record. run: 1100 subRun: 1 event: 45177 at 15-Jan-2026 19:52:44 UTC
Begin processing the 78th record. run: 1100 subRun: 1 event: 45178 at 15-Jan-2026 19:52:47 UTC
Begin processing the 79th record. run: 1100 subRun: 1 event: 45179 at 15-Jan-2026 19:52:49 UTC
Begin processing the 80th record. run: 1100 subRun: 1 event: 45180 at 15-Jan-2026 19:52:52 UTC
Begin processing the 81st record. run: 1100 subRun: 1 event: 45181 at 15-Jan-2026 19:53:01 UTC
Begin processing the 82nd record. run: 1100 subRun: 1 event: 45182 at 15-Jan-2026 19:53:03 UTC
Begin processing the 83rd record. run: 1100 subRun: 1 event: 45183 at 15-Jan-2026 19:53:05 UTC
Begin processing the 84th record. run: 1100 subRun: 1 event: 45184 at 15-Jan-2026 19:53:08 UTC
Begin processing the 85th record. run: 1100 subRun: 1 event: 45185 at 15-Jan-2026 19:53:10 UTC
Begin processing the 86th record. run: 1100 subRun: 1 event: 45186 at 15-Jan-2026 19:53:13 UTC
Begin processing the 87th record. run: 1100 subRun: 1 event: 45187 at 15-Jan-2026 19:53:16 UTC
Begin processing the 88th record. run: 1100 subRun: 1 event: 45188 at 15-Jan-2026 19:53:19 UTC
Begin processing the 89th record. run: 1100 subRun: 1 event: 45189 at 15-Jan-2026 19:53:21 UTC
Begin processing the 90th record. run: 1100 subRun: 1 event: 45190 at 15-Jan-2026 19:53:23 UTC
Begin processing the 91st record. run: 1100 subRun: 1 event: 45191 at 15-Jan-2026 19:53:26 UTC
Begin processing the 92nd record. run: 1100 subRun: 1 event: 45192 at 15-Jan-2026 19:53:28 UTC
Begin processing the 93rd record. run: 1100 subRun: 1 event: 45193 at 15-Jan-2026 19:53:30 UTC
Begin processing the 94th record. run: 1100 subRun: 1 event: 45194 at 15-Jan-2026 19:53:33 UTC
Begin processing the 95th record. run: 1100 subRun: 1 event: 45195 at 15-Jan-2026 19:53:36 UTC
Begin processing the 96th record. run: 1100 subRun: 1 event: 45196 at 15-Jan-2026 19:53:38 UTC
Begin processing the 97th record. run: 1100 subRun: 1 event: 45197 at 15-Jan-2026 19:53:40 UTC
Begin processing the 98th record. run: 1100 subRun: 1 event: 45198 at 15-Jan-2026 19:53:43 UTC
Begin processing the 99th record. run: 1100 subRun: 1 event: 45199 at 15-Jan-2026 19:53:46 UTC
Begin processing the 100th record. run: 1100 subRun: 1 event: 45200 at 15-Jan-2026 19:53:48 UTC
15-Jan-2026 19:53:51 UTC  Closed output file "nu_dune10kt_1x2x6_1100_451_20230826T034406Z_gen_g4_detsim_hitreco__20240229T201736Z_reco2_reco2.root"
15-Jan-2026 19:53:51 UTC  Closed input file "root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/44/79/nu_dune10kt_1x2x6_1100_451_20230826T034406Z_gen_g4_detsim_hitreco__20240229T201736Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      1.65207       3.05347       24.3845       1.95947       3.46956        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0487289     0.0630557     0.154524      0.0619032     0.0118011       100    
reco:pandora:StandardPandora                    1.60201       2.97811       24.2723       1.89428       3.45933        100    
[art]:TriggerResults:TriggerResultInserter    1.1341e-05    2.29099e-05   0.000219628   1.8476e-05    2.21736e-05      100    
end_path:out1:RootOutput                       2.394e-06    3.28842e-06   2.5138e-05    2.9855e-06    2.23525e-06      100    
end_path:out1:RootOutput(write)               0.000982511    0.0120673     0.0618546    0.00822767     0.012548        100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2312.08 MB
  Peak resident set size usage (VmHWM): 1306.1 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===