Jobsub ID 272704.130@dunegpschedd01.fnal.gov

Jobsub ID	272704.130@dunegpschedd01.fnal.gov
Workflow ID	11624
Stage ID	1
User name	imawby@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	1048576000 (1000 MiB)
	Wall seconds limit	7200 (2 hours)
Submitted time	2026-01-08 15:57:13
Site	NL_SURFsara
Entry	DUNE_SurfSARA_arc01
Last heartbeat	2026-01-08 16:09:48
From worker node	Hostname	wn-da-20.gina.surf.nl
	cpuinfo	AMD EPYC 7702P 64-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	1048576000 (1000 MiB)
	Wall seconds limit	129600 (36 hours)
	GPU
	Inner Apptainer?	True
Job state	outputting_failed
Started	2026-01-08 15:58:10
Input files	fardet-hd:nu_dune10kt_1x2x6_1100_748_20230826T035504Z_gen_g4_detsim_hitreco__20240229T180428Z_reco2.root
Jobscript	Exit code	0
	Real time	4m (275s)
	CPU time	4m (265s = 96%)
	Max RSS bytes	1190199296 (1135 MiB)
Outputting started	2026-01-08 16:02:45
Output files
Finished	2026-01-08 16:09:48
List job events Cached HTCondor job logs
Jobscript log (last 10,000 characters)

his block should be empty ------------------
---------------------------------------------------------
Input PFN = root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/ba/42/nu_dune10kt_1x2x6_1100_748_20230826T035504Z_gen_g4_detsim_hitreco__20240229T180428Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Begin processing the 23rd record. run: 1100 subRun: 1 event: 74823 at 08-Jan-2026 16:59:57 CET
Begin processing the 24th record. run: 1100 subRun: 1 event: 74824 at 08-Jan-2026 17:00:00 CET
Begin processing the 25th record. run: 1100 subRun: 1 event: 74825 at 08-Jan-2026 17:00:01 CET
Begin processing the 26th record. run: 1100 subRun: 1 event: 74826 at 08-Jan-2026 17:00:04 CET
Begin processing the 27th record. run: 1100 subRun: 1 event: 74827 at 08-Jan-2026 17:00:05 CET
Begin processing the 28th record. run: 1100 subRun: 1 event: 74828 at 08-Jan-2026 17:00:06 CET
Begin processing the 29th record. run: 1100 subRun: 1 event: 74829 at 08-Jan-2026 17:00:08 CET
Begin processing the 30th record. run: 1100 subRun: 1 event: 74830 at 08-Jan-2026 17:00:12 CET
Begin processing the 31st record. run: 1100 subRun: 1 event: 74831 at 08-Jan-2026 17:00:14 CET
Begin processing the 32nd record. run: 1100 subRun: 1 event: 74832 at 08-Jan-2026 17:00:20 CET
Begin processing the 33rd record. run: 1100 subRun: 1 event: 74833 at 08-Jan-2026 17:00:22 CET
Begin processing the 34th record. run: 1100 subRun: 1 event: 74834 at 08-Jan-2026 17:00:23 CET
Begin processing the 35th record. run: 1100 subRun: 1 event: 74835 at 08-Jan-2026 17:00:24 CET
Begin processing the 36th record. run: 1100 subRun: 1 event: 74836 at 08-Jan-2026 17:00:28 CET
Begin processing the 37th record. run: 1100 subRun: 1 event: 74837 at 08-Jan-2026 17:00:35 CET
Begin processing the 38th record. run: 1100 subRun: 1 event: 74838 at 08-Jan-2026 17:00:37 CET
Begin processing the 39th record. run: 1100 subRun: 1 event: 74839 at 08-Jan-2026 17:00:38 CET
Begin processing the 40th record. run: 1100 subRun: 1 event: 74840 at 08-Jan-2026 17:00:39 CET
Begin processing the 41st record. run: 1100 subRun: 1 event: 74841 at 08-Jan-2026 17:00:40 CET
Begin processing the 42nd record. run: 1100 subRun: 1 event: 74842 at 08-Jan-2026 17:00:42 CET
Begin processing the 43rd record. run: 1100 subRun: 1 event: 74843 at 08-Jan-2026 17:00:44 CET
Begin processing the 44th record. run: 1100 subRun: 1 event: 74844 at 08-Jan-2026 17:00:45 CET
Begin processing the 45th record. run: 1100 subRun: 1 event: 74845 at 08-Jan-2026 17:00:46 CET
Begin processing the 46th record. run: 1100 subRun: 1 event: 74846 at 08-Jan-2026 17:00:47 CET
Begin processing the 47th record. run: 1100 subRun: 1 event: 74847 at 08-Jan-2026 17:00:49 CET
Begin processing the 48th record. run: 1100 subRun: 1 event: 74848 at 08-Jan-2026 17:00:50 CET
Begin processing the 49th record. run: 1100 subRun: 1 event: 74849 at 08-Jan-2026 17:00:52 CET
Begin processing the 50th record. run: 1100 subRun: 1 event: 74850 at 08-Jan-2026 17:00:55 CET
Begin processing the 51st record. run: 1100 subRun: 1 event: 74851 at 08-Jan-2026 17:00:56 CET
Begin processing the 52nd record. run: 1100 subRun: 1 event: 74852 at 08-Jan-2026 17:00:58 CET
Begin processing the 53rd record. run: 1100 subRun: 1 event: 74853 at 08-Jan-2026 17:00:59 CET
Begin processing the 54th record. run: 1100 subRun: 1 event: 74854 at 08-Jan-2026 17:01:00 CET
Begin processing the 55th record. run: 1100 subRun: 1 event: 74855 at 08-Jan-2026 17:01:02 CET
Begin processing the 56th record. run: 1100 subRun: 1 event: 74856 at 08-Jan-2026 17:01:03 CET
Begin processing the 57th record. run: 1100 subRun: 1 event: 74857 at 08-Jan-2026 17:01:05 CET
Begin processing the 58th record. run: 1100 subRun: 1 event: 74858 at 08-Jan-2026 17:01:07 CET
Begin processing the 59th record. run: 1100 subRun: 1 event: 74859 at 08-Jan-2026 17:01:08 CET
Begin processing the 60th record. run: 1100 subRun: 1 event: 74860 at 08-Jan-2026 17:01:10 CET
Begin processing the 61st record. run: 1100 subRun: 1 event: 74861 at 08-Jan-2026 17:01:12 CET
Begin processing the 62nd record. run: 1100 subRun: 1 event: 74862 at 08-Jan-2026 17:01:17 CET
Begin processing the 63rd record. run: 1100 subRun: 1 event: 74863 at 08-Jan-2026 17:01:19 CET
Begin processing the 64th record. run: 1100 subRun: 1 event: 74864 at 08-Jan-2026 17:01:20 CET
Begin processing the 65th record. run: 1100 subRun: 1 event: 74865 at 08-Jan-2026 17:01:22 CET
Begin processing the 66th record. run: 1100 subRun: 1 event: 74866 at 08-Jan-2026 17:01:24 CET
Begin processing the 67th record. run: 1100 subRun: 1 event: 74867 at 08-Jan-2026 17:01:25 CET
Begin processing the 68th record. run: 1100 subRun: 1 event: 74868 at 08-Jan-2026 17:01:30 CET
Begin processing the 69th record. run: 1100 subRun: 1 event: 74869 at 08-Jan-2026 17:01:32 CET
Begin processing the 70th record. run: 1100 subRun: 1 event: 74870 at 08-Jan-2026 17:01:33 CET
Begin processing the 71st record. run: 1100 subRun: 1 event: 74871 at 08-Jan-2026 17:01:34 CET
Begin processing the 72nd record. run: 1100 subRun: 1 event: 74872 at 08-Jan-2026 17:01:46 CET
Begin processing the 73rd record. run: 1100 subRun: 1 event: 74873 at 08-Jan-2026 17:01:47 CET
Begin processing the 74th record. run: 1100 subRun: 1 event: 74874 at 08-Jan-2026 17:01:50 CET
Begin processing the 75th record. run: 1100 subRun: 1 event: 74875 at 08-Jan-2026 17:01:51 CET
Begin processing the 76th record. run: 1100 subRun: 1 event: 74876 at 08-Jan-2026 17:02:04 CET
Begin processing the 77th record. run: 1100 subRun: 1 event: 74877 at 08-Jan-2026 17:02:05 CET
Begin processing the 78th record. run: 1100 subRun: 1 event: 74878 at 08-Jan-2026 17:02:07 CET
Begin processing the 79th record. run: 1100 subRun: 1 event: 74879 at 08-Jan-2026 17:02:08 CET
Begin processing the 80th record. run: 1100 subRun: 1 event: 74880 at 08-Jan-2026 17:02:09 CET
Begin processing the 81st record. run: 1100 subRun: 1 event: 74881 at 08-Jan-2026 17:02:10 CET
Begin processing the 82nd record. run: 1100 subRun: 1 event: 74882 at 08-Jan-2026 17:02:12 CET
Begin processing the 83rd record. run: 1100 subRun: 1 event: 74883 at 08-Jan-2026 17:02:14 CET
Begin processing the 84th record. run: 1100 subRun: 1 event: 74884 at 08-Jan-2026 17:02:16 CET
Begin processing the 85th record. run: 1100 subRun: 1 event: 74885 at 08-Jan-2026 17:02:18 CET
Begin processing the 86th record. run: 1100 subRun: 1 event: 74886 at 08-Jan-2026 17:02:19 CET
Begin processing the 87th record. run: 1100 subRun: 1 event: 74887 at 08-Jan-2026 17:02:20 CET
Begin processing the 88th record. run: 1100 subRun: 1 event: 74888 at 08-Jan-2026 17:02:22 CET
Begin processing the 89th record. run: 1100 subRun: 1 event: 74889 at 08-Jan-2026 17:02:23 CET
Begin processing the 90th record. run: 1100 subRun: 1 event: 74890 at 08-Jan-2026 17:02:25 CET
Begin processing the 91st record. run: 1100 subRun: 1 event: 74891 at 08-Jan-2026 17:02:26 CET
Begin processing the 92nd record. run: 1100 subRun: 1 event: 74892 at 08-Jan-2026 17:02:27 CET
Begin processing the 93rd record. run: 1100 subRun: 1 event: 74893 at 08-Jan-2026 17:02:30 CET
Begin processing the 94th record. run: 1100 subRun: 1 event: 74894 at 08-Jan-2026 17:02:32 CET
Begin processing the 95th record. run: 1100 subRun: 1 event: 74895 at 08-Jan-2026 17:02:36 CET
Begin processing the 96th record. run: 1100 subRun: 1 event: 74896 at 08-Jan-2026 17:02:37 CET
Begin processing the 97th record. run: 1100 subRun: 1 event: 74897 at 08-Jan-2026 17:02:39 CET
Begin processing the 98th record. run: 1100 subRun: 1 event: 74898 at 08-Jan-2026 17:02:40 CET
Begin processing the 99th record. run: 1100 subRun: 1 event: 74899 at 08-Jan-2026 17:02:41 CET
Begin processing the 100th record. run: 1100 subRun: 1 event: 74900 at 08-Jan-2026 17:02:43 CET
08-Jan-2026 17:02:44 CET  Closed output file "nu_dune10kt_1x2x6_1100_748_20230826T035504Z_gen_g4_detsim_hitreco__20240229T180428Z_reco2_reco2.root"
08-Jan-2026 17:02:44 CET  Closed input file "root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/ba/42/nu_dune10kt_1x2x6_1100_748_20230826T035504Z_gen_g4_detsim_hitreco__20240229T180428Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.987847       2.08243       14.2505       1.34445       2.19329        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.00323883    0.00830459     0.0252722    0.00521247    0.00601285       100    
reco:pandora:StandardPandora                   0.982368       2.06091       14.1831       1.32906       2.18094        100    
[art]:TriggerResults:TriggerResultInserter    1.1071e-05    2.20014e-05   0.00017821    1.79445e-05   2.28999e-05      100    
end_path:out1:RootOutput                       3.306e-06    4.23391e-06   1.8786e-05     3.922e-06    2.03902e-06      100    
end_path:out1:RootOutput(write)               0.00103535     0.0130212     0.0626697    0.00715487     0.0136162       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2170.86 MB
  Peak resident set size usage (VmHWM): 1190.2 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===