Jobsub ID 279275.165@dunegpschedd01.fnal.gov

Jobsub ID	279275.165@dunegpschedd01.fnal.gov
Workflow ID	11972
Stage ID	1
User name	imawby@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	1048576000 (1000 MiB)
	Wall seconds limit	7200 (2 hours)
Submitted time	2026-01-15 19:34:14
Site	FR_CCIN2P3
Entry	DUNE_FR_CCIN2P3_cccondorce01
Last heartbeat	2026-01-15 20:44:01
From worker node	Hostname	ccwcondor0403
	cpuinfo	AMD EPYC 9334 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	1048576000 (1000 MiB)
	Wall seconds limit	106200 (29 hours)
	GPU
	Inner Apptainer?	True
Job state	outputting_failed
Started	2026-01-15 19:36:02
Input files	fardet-hd:nu_dune10kt_1x2x6_1410_329_20230826T123334Z_gen_g4_detsim_hitreco__20240229T175814Z_reco2.root
Jobscript	Exit code	0
	Real time	8m (521s)
	CPU time	5m (326s = 62%)
	Max RSS bytes	1178943488 (1124 MiB)
Outputting started	2026-01-15 19:44:45
Output files
Finished	2026-01-15 20:44:01
List job events Cached HTCondor job logs
Jobscript log (last 10,000 characters)

is block should be empty ------------------
---------------------------------------------------------
Input PFN = root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/ba/f4/nu_dune10kt_1x2x6_1410_329_20230826T123334Z_gen_g4_detsim_hitreco__20240229T175814Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Begin processing the 23rd record. run: 1410 subRun: 1 event: 32923 at 15-Jan-2026 20:40:14 CET
Begin processing the 24th record. run: 1410 subRun: 1 event: 32924 at 15-Jan-2026 20:40:17 CET
Begin processing the 25th record. run: 1410 subRun: 1 event: 32925 at 15-Jan-2026 20:40:20 CET
Begin processing the 26th record. run: 1410 subRun: 1 event: 32926 at 15-Jan-2026 20:40:22 CET
Begin processing the 27th record. run: 1410 subRun: 1 event: 32927 at 15-Jan-2026 20:40:25 CET
Begin processing the 28th record. run: 1410 subRun: 1 event: 32928 at 15-Jan-2026 20:40:27 CET
Begin processing the 29th record. run: 1410 subRun: 1 event: 32929 at 15-Jan-2026 20:40:30 CET
Begin processing the 30th record. run: 1410 subRun: 1 event: 32930 at 15-Jan-2026 20:40:32 CET
Begin processing the 31st record. run: 1410 subRun: 1 event: 32931 at 15-Jan-2026 20:40:35 CET
Begin processing the 32nd record. run: 1410 subRun: 1 event: 32932 at 15-Jan-2026 20:40:38 CET
Begin processing the 33rd record. run: 1410 subRun: 1 event: 32933 at 15-Jan-2026 20:40:42 CET
Begin processing the 34th record. run: 1410 subRun: 1 event: 32934 at 15-Jan-2026 20:40:44 CET
Begin processing the 35th record. run: 1410 subRun: 1 event: 32935 at 15-Jan-2026 20:40:48 CET
Begin processing the 36th record. run: 1410 subRun: 1 event: 32936 at 15-Jan-2026 20:40:50 CET
Begin processing the 37th record. run: 1410 subRun: 1 event: 32937 at 15-Jan-2026 20:40:53 CET
Begin processing the 38th record. run: 1410 subRun: 1 event: 32938 at 15-Jan-2026 20:40:55 CET
Begin processing the 39th record. run: 1410 subRun: 1 event: 32939 at 15-Jan-2026 20:40:58 CET
Begin processing the 40th record. run: 1410 subRun: 1 event: 32940 at 15-Jan-2026 20:41:00 CET
Begin processing the 41st record. run: 1410 subRun: 1 event: 32941 at 15-Jan-2026 20:41:03 CET
Begin processing the 42nd record. run: 1410 subRun: 1 event: 32942 at 15-Jan-2026 20:41:06 CET
Begin processing the 43rd record. run: 1410 subRun: 1 event: 32943 at 15-Jan-2026 20:41:08 CET
Begin processing the 44th record. run: 1410 subRun: 1 event: 32944 at 15-Jan-2026 20:41:10 CET
Begin processing the 45th record. run: 1410 subRun: 1 event: 32945 at 15-Jan-2026 20:41:17 CET
Begin processing the 46th record. run: 1410 subRun: 1 event: 32946 at 15-Jan-2026 20:41:20 CET
Begin processing the 47th record. run: 1410 subRun: 1 event: 32947 at 15-Jan-2026 20:41:24 CET
Begin processing the 48th record. run: 1410 subRun: 1 event: 32948 at 15-Jan-2026 20:41:27 CET
Begin processing the 49th record. run: 1410 subRun: 1 event: 32949 at 15-Jan-2026 20:41:30 CET
Begin processing the 50th record. run: 1410 subRun: 1 event: 32950 at 15-Jan-2026 20:41:33 CET
Begin processing the 51st record. run: 1410 subRun: 1 event: 32951 at 15-Jan-2026 20:41:38 CET
Begin processing the 52nd record. run: 1410 subRun: 1 event: 32952 at 15-Jan-2026 20:41:41 CET
Begin processing the 53rd record. run: 1410 subRun: 1 event: 32953 at 15-Jan-2026 20:41:45 CET
Begin processing the 54th record. run: 1410 subRun: 1 event: 32954 at 15-Jan-2026 20:41:48 CET
Begin processing the 55th record. run: 1410 subRun: 1 event: 32955 at 15-Jan-2026 20:41:52 CET
Begin processing the 56th record. run: 1410 subRun: 1 event: 32956 at 15-Jan-2026 20:41:55 CET
Begin processing the 57th record. run: 1410 subRun: 1 event: 32957 at 15-Jan-2026 20:41:58 CET
Begin processing the 58th record. run: 1410 subRun: 1 event: 32958 at 15-Jan-2026 20:42:01 CET
Begin processing the 59th record. run: 1410 subRun: 1 event: 32959 at 15-Jan-2026 20:42:04 CET
Begin processing the 60th record. run: 1410 subRun: 1 event: 32960 at 15-Jan-2026 20:42:07 CET
Begin processing the 61st record. run: 1410 subRun: 1 event: 32961 at 15-Jan-2026 20:42:10 CET
Begin processing the 62nd record. run: 1410 subRun: 1 event: 32962 at 15-Jan-2026 20:42:13 CET
Begin processing the 63rd record. run: 1410 subRun: 1 event: 32963 at 15-Jan-2026 20:42:16 CET
Begin processing the 64th record. run: 1410 subRun: 1 event: 32964 at 15-Jan-2026 20:42:19 CET
Begin processing the 65th record. run: 1410 subRun: 1 event: 32965 at 15-Jan-2026 20:42:21 CET
Begin processing the 66th record. run: 1410 subRun: 1 event: 32966 at 15-Jan-2026 20:42:24 CET
Begin processing the 67th record. run: 1410 subRun: 1 event: 32967 at 15-Jan-2026 20:42:32 CET
Begin processing the 68th record. run: 1410 subRun: 1 event: 32968 at 15-Jan-2026 20:42:34 CET
Begin processing the 69th record. run: 1410 subRun: 1 event: 32969 at 15-Jan-2026 20:42:37 CET
Begin processing the 70th record. run: 1410 subRun: 1 event: 32970 at 15-Jan-2026 20:42:40 CET
Begin processing the 71st record. run: 1410 subRun: 1 event: 32971 at 15-Jan-2026 20:42:44 CET
Begin processing the 72nd record. run: 1410 subRun: 1 event: 32972 at 15-Jan-2026 20:42:48 CET
Begin processing the 73rd record. run: 1410 subRun: 1 event: 32973 at 15-Jan-2026 20:42:51 CET
Begin processing the 74th record. run: 1410 subRun: 1 event: 32974 at 15-Jan-2026 20:42:55 CET
Begin processing the 75th record. run: 1410 subRun: 1 event: 32975 at 15-Jan-2026 20:42:57 CET
Begin processing the 76th record. run: 1410 subRun: 1 event: 32976 at 15-Jan-2026 20:43:00 CET
Begin processing the 77th record. run: 1410 subRun: 1 event: 32977 at 15-Jan-2026 20:43:03 CET
Begin processing the 78th record. run: 1410 subRun: 1 event: 32978 at 15-Jan-2026 20:43:18 CET
Begin processing the 79th record. run: 1410 subRun: 1 event: 32979 at 15-Jan-2026 20:43:21 CET
Begin processing the 80th record. run: 1410 subRun: 1 event: 32980 at 15-Jan-2026 20:43:25 CET
Begin processing the 81st record. run: 1410 subRun: 1 event: 32981 at 15-Jan-2026 20:43:31 CET
Begin processing the 82nd record. run: 1410 subRun: 1 event: 32982 at 15-Jan-2026 20:43:34 CET
Begin processing the 83rd record. run: 1410 subRun: 1 event: 32983 at 15-Jan-2026 20:43:37 CET
Begin processing the 84th record. run: 1410 subRun: 1 event: 32984 at 15-Jan-2026 20:43:41 CET
Begin processing the 85th record. run: 1410 subRun: 1 event: 32985 at 15-Jan-2026 20:43:44 CET
Begin processing the 86th record. run: 1410 subRun: 1 event: 32986 at 15-Jan-2026 20:43:48 CET
Begin processing the 87th record. run: 1410 subRun: 1 event: 32987 at 15-Jan-2026 20:43:51 CET
Begin processing the 88th record. run: 1410 subRun: 1 event: 32988 at 15-Jan-2026 20:43:55 CET
Begin processing the 89th record. run: 1410 subRun: 1 event: 32989 at 15-Jan-2026 20:43:58 CET
Begin processing the 90th record. run: 1410 subRun: 1 event: 32990 at 15-Jan-2026 20:44:01 CET
Begin processing the 91st record. run: 1410 subRun: 1 event: 32991 at 15-Jan-2026 20:44:05 CET
Begin processing the 92nd record. run: 1410 subRun: 1 event: 32992 at 15-Jan-2026 20:44:09 CET
Begin processing the 93rd record. run: 1410 subRun: 1 event: 32993 at 15-Jan-2026 20:44:18 CET
Begin processing the 94th record. run: 1410 subRun: 1 event: 32994 at 15-Jan-2026 20:44:21 CET
Begin processing the 95th record. run: 1410 subRun: 1 event: 32995 at 15-Jan-2026 20:44:24 CET
Begin processing the 96th record. run: 1410 subRun: 1 event: 32996 at 15-Jan-2026 20:44:26 CET
Begin processing the 97th record. run: 1410 subRun: 1 event: 32997 at 15-Jan-2026 20:44:32 CET
Begin processing the 98th record. run: 1410 subRun: 1 event: 32998 at 15-Jan-2026 20:44:34 CET
Begin processing the 99th record. run: 1410 subRun: 1 event: 32999 at 15-Jan-2026 20:44:37 CET
Begin processing the 100th record. run: 1410 subRun: 1 event: 33000 at 15-Jan-2026 20:44:41 CET
15-Jan-2026 20:44:44 CET  Closed output file "nu_dune10kt_1x2x6_1410_329_20230826T123334Z_gen_g4_detsim_hitreco__20240229T175814Z_reco2_reco2.root"
15-Jan-2026 20:44:44 CET  Closed input file "root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/ba/f4/nu_dune10kt_1x2x6_1410_329_20230826T123334Z_gen_g4_detsim_hitreco__20240229T175814Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      1.78538       2.99657       13.5968       2.65766       1.50917        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0262843     0.058902      0.150875      0.0558612     0.0140478       100    
reco:pandora:StandardPandora                    1.73572       2.92785       13.4941       2.59262       1.50331        100    
[art]:TriggerResults:TriggerResultInserter    1.0045e-05    2.7033e-05    0.000206172   2.3305e-05    2.25708e-05      100    
end_path:out1:RootOutput                       3.486e-06    4.91304e-06   2.4888e-05     4.297e-06    3.2228e-06       100    
end_path:out1:RootOutput(write)               0.000815856    0.0095684     0.0479233    0.00763896    0.00846635       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2181.53 MB
  Peak resident set size usage (VmHWM): 1178.94 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===