Jobsub ID 272704.6@dunegpschedd01.fnal.gov

Jobsub ID	272704.6@dunegpschedd01.fnal.gov
Workflow ID	11624
Stage ID	1
User name	imawby@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	1048576000 (1000 MiB)
	Wall seconds limit	7200 (2 hours)
Submitted time	2026-01-08 15:57:13
Site	US_Michigan
Entry	HCC_US_Michigan_gate02
Last heartbeat	2026-01-08 16:13:25
From worker node	Hostname	c-208-39.aglt2.org
	cpuinfo	AMD EPYC 9354 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	1048576000 (1000 MiB)
	Wall seconds limit	36000 (10 hours)
	GPU
	Inner Apptainer?	True
Job state	outputting_failed
Started	2026-01-08 15:58:16
Input files	fardet-hd:nu_dune10kt_1x2x6_1113_635_20230827T125342Z_gen_g4_detsim_hitreco__20240223T221959Z_reco2.root
Jobscript	Exit code	0
	Real time	6m (416s)
	CPU time	3m (226s = 54%)
	Max RSS bytes	1208135680 (1152 MiB)
Outputting started	2026-01-08 16:05:13
Output files
Finished	2026-01-08 16:13:25
List job events Cached HTCondor job logs
Jobscript log (last 10,000 characters)

3_00_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/f4/40/nu_dune10kt_1x2x6_1113_635_20230827T125342Z_gen_g4_detsim_hitreco__20240223T221959Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Failure in algorithm Alg0002, LArDLMaster, STATUS_CODE_NOT_INITIALIZED
Begin processing the 24th record. run: 1113 subRun: 1 event: 63524 at 08-Jan-2026 11:02:12 EST
Begin processing the 25th record. run: 1113 subRun: 1 event: 63525 at 08-Jan-2026 11:02:13 EST
Begin processing the 26th record. run: 1113 subRun: 1 event: 63526 at 08-Jan-2026 11:02:15 EST
Begin processing the 27th record. run: 1113 subRun: 1 event: 63527 at 08-Jan-2026 11:02:18 EST
Begin processing the 28th record. run: 1113 subRun: 1 event: 63528 at 08-Jan-2026 11:02:20 EST
Begin processing the 29th record. run: 1113 subRun: 1 event: 63529 at 08-Jan-2026 11:02:21 EST
Begin processing the 30th record. run: 1113 subRun: 1 event: 63530 at 08-Jan-2026 11:02:23 EST
Begin processing the 31st record. run: 1113 subRun: 1 event: 63531 at 08-Jan-2026 11:02:32 EST
Begin processing the 32nd record. run: 1113 subRun: 1 event: 63532 at 08-Jan-2026 11:02:34 EST
Begin processing the 33rd record. run: 1113 subRun: 1 event: 63533 at 08-Jan-2026 11:02:35 EST
Begin processing the 34th record. run: 1113 subRun: 1 event: 63534 at 08-Jan-2026 11:02:38 EST
Begin processing the 35th record. run: 1113 subRun: 1 event: 63535 at 08-Jan-2026 11:02:39 EST
Begin processing the 36th record. run: 1113 subRun: 1 event: 63536 at 08-Jan-2026 11:02:41 EST
Begin processing the 37th record. run: 1113 subRun: 1 event: 63537 at 08-Jan-2026 11:02:42 EST
Begin processing the 38th record. run: 1113 subRun: 1 event: 63538 at 08-Jan-2026 11:02:44 EST
Begin processing the 39th record. run: 1113 subRun: 1 event: 63539 at 08-Jan-2026 11:02:45 EST
Begin processing the 40th record. run: 1113 subRun: 1 event: 63540 at 08-Jan-2026 11:02:47 EST
Begin processing the 41st record. run: 1113 subRun: 1 event: 63541 at 08-Jan-2026 11:02:48 EST
Begin processing the 42nd record. run: 1113 subRun: 1 event: 63542 at 08-Jan-2026 11:02:50 EST
Begin processing the 43rd record. run: 1113 subRun: 1 event: 63543 at 08-Jan-2026 11:02:53 EST
Begin processing the 44th record. run: 1113 subRun: 1 event: 63544 at 08-Jan-2026 11:02:54 EST
Begin processing the 45th record. run: 1113 subRun: 1 event: 63545 at 08-Jan-2026 11:03:03 EST
Begin processing the 46th record. run: 1113 subRun: 1 event: 63546 at 08-Jan-2026 11:03:05 EST
Begin processing the 47th record. run: 1113 subRun: 1 event: 63547 at 08-Jan-2026 11:03:07 EST
Begin processing the 48th record. run: 1113 subRun: 1 event: 63548 at 08-Jan-2026 11:03:11 EST
Begin processing the 49th record. run: 1113 subRun: 1 event: 63549 at 08-Jan-2026 11:03:14 EST
Begin processing the 50th record. run: 1113 subRun: 1 event: 63550 at 08-Jan-2026 11:03:17 EST
Begin processing the 51st record. run: 1113 subRun: 1 event: 63551 at 08-Jan-2026 11:03:18 EST
Begin processing the 52nd record. run: 1113 subRun: 1 event: 63552 at 08-Jan-2026 11:03:19 EST
Begin processing the 53rd record. run: 1113 subRun: 1 event: 63553 at 08-Jan-2026 11:03:21 EST
Begin processing the 54th record. run: 1113 subRun: 1 event: 63554 at 08-Jan-2026 11:03:24 EST
Begin processing the 55th record. run: 1113 subRun: 1 event: 63555 at 08-Jan-2026 11:03:26 EST
Begin processing the 56th record. run: 1113 subRun: 1 event: 63556 at 08-Jan-2026 11:03:29 EST
Begin processing the 57th record. run: 1113 subRun: 1 event: 63557 at 08-Jan-2026 11:03:30 EST
Begin processing the 58th record. run: 1113 subRun: 1 event: 63558 at 08-Jan-2026 11:03:32 EST
Begin processing the 59th record. run: 1113 subRun: 1 event: 63559 at 08-Jan-2026 11:03:34 EST
Begin processing the 60th record. run: 1113 subRun: 1 event: 63560 at 08-Jan-2026 11:03:35 EST
Begin processing the 61st record. run: 1113 subRun: 1 event: 63561 at 08-Jan-2026 11:03:37 EST
Begin processing the 62nd record. run: 1113 subRun: 1 event: 63562 at 08-Jan-2026 11:03:39 EST
Begin processing the 63rd record. run: 1113 subRun: 1 event: 63563 at 08-Jan-2026 11:03:40 EST
Begin processing the 64th record. run: 1113 subRun: 1 event: 63564 at 08-Jan-2026 11:03:43 EST
Begin processing the 65th record. run: 1113 subRun: 1 event: 63565 at 08-Jan-2026 11:03:44 EST
Begin processing the 66th record. run: 1113 subRun: 1 event: 63566 at 08-Jan-2026 11:03:46 EST
Begin processing the 67th record. run: 1113 subRun: 1 event: 63567 at 08-Jan-2026 11:03:48 EST
Begin processing the 68th record. run: 1113 subRun: 1 event: 63568 at 08-Jan-2026 11:03:49 EST
Begin processing the 69th record. run: 1113 subRun: 1 event: 63569 at 08-Jan-2026 11:03:53 EST
Begin processing the 70th record. run: 1113 subRun: 1 event: 63570 at 08-Jan-2026 11:03:55 EST
Begin processing the 71st record. run: 1113 subRun: 1 event: 63571 at 08-Jan-2026 11:03:57 EST
Begin processing the 72nd record. run: 1113 subRun: 1 event: 63572 at 08-Jan-2026 11:03:58 EST
Begin processing the 73rd record. run: 1113 subRun: 1 event: 63573 at 08-Jan-2026 11:04:01 EST
Begin processing the 74th record. run: 1113 subRun: 1 event: 63574 at 08-Jan-2026 11:04:03 EST
Begin processing the 75th record. run: 1113 subRun: 1 event: 63575 at 08-Jan-2026 11:04:05 EST
Begin processing the 76th record. run: 1113 subRun: 1 event: 63576 at 08-Jan-2026 11:04:07 EST
Begin processing the 77th record. run: 1113 subRun: 1 event: 63577 at 08-Jan-2026 11:04:08 EST
Begin processing the 78th record. run: 1113 subRun: 1 event: 63578 at 08-Jan-2026 11:04:11 EST
Begin processing the 79th record. run: 1113 subRun: 1 event: 63579 at 08-Jan-2026 11:04:13 EST
Begin processing the 80th record. run: 1113 subRun: 1 event: 63580 at 08-Jan-2026 11:04:14 EST
Begin processing the 81st record. run: 1113 subRun: 1 event: 63581 at 08-Jan-2026 11:04:16 EST
Begin processing the 82nd record. run: 1113 subRun: 1 event: 63582 at 08-Jan-2026 11:04:17 EST
Begin processing the 83rd record. run: 1113 subRun: 1 event: 63583 at 08-Jan-2026 11:04:19 EST
Begin processing the 84th record. run: 1113 subRun: 1 event: 63584 at 08-Jan-2026 11:04:21 EST
Begin processing the 85th record. run: 1113 subRun: 1 event: 63585 at 08-Jan-2026 11:04:23 EST
Begin processing the 86th record. run: 1113 subRun: 1 event: 63586 at 08-Jan-2026 11:04:26 EST
Begin processing the 87th record. run: 1113 subRun: 1 event: 63587 at 08-Jan-2026 11:04:28 EST
Begin processing the 88th record. run: 1113 subRun: 1 event: 63588 at 08-Jan-2026 11:04:32 EST
Begin processing the 89th record. run: 1113 subRun: 1 event: 63589 at 08-Jan-2026 11:04:34 EST
Begin processing the 90th record. run: 1113 subRun: 1 event: 63590 at 08-Jan-2026 11:04:38 EST
Begin processing the 91st record. run: 1113 subRun: 1 event: 63591 at 08-Jan-2026 11:04:40 EST
Begin processing the 92nd record. run: 1113 subRun: 1 event: 63592 at 08-Jan-2026 11:04:42 EST
Begin processing the 93rd record. run: 1113 subRun: 1 event: 63593 at 08-Jan-2026 11:04:43 EST
Begin processing the 94th record. run: 1113 subRun: 1 event: 63594 at 08-Jan-2026 11:04:57 EST
Begin processing the 95th record. run: 1113 subRun: 1 event: 63595 at 08-Jan-2026 11:04:59 EST
Begin processing the 96th record. run: 1113 subRun: 1 event: 63596 at 08-Jan-2026 11:05:00 EST
Begin processing the 97th record. run: 1113 subRun: 1 event: 63597 at 08-Jan-2026 11:05:03 EST
Begin processing the 98th record. run: 1113 subRun: 1 event: 63598 at 08-Jan-2026 11:05:05 EST
Begin processing the 99th record. run: 1113 subRun: 1 event: 63599 at 08-Jan-2026 11:05:07 EST
Begin processing the 100th record. run: 1113 subRun: 1 event: 63600 at 08-Jan-2026 11:05:09 EST
08-Jan-2026 11:05:12 EST  Closed output file "nu_dune10kt_1x2x6_1113_635_20230827T125342Z_gen_g4_detsim_hitreco__20240223T221959Z_reco2_reco2.root"
08-Jan-2026 11:05:12 EST  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/f4/40/nu_dune10kt_1x2x6_1113_635_20230827T125342Z_gen_g4_detsim_hitreco__20240223T221959Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.104529       2.40671       43.7083       1.56795       4.41886        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0153893     0.0302198     0.061895      0.0302645    0.00949547       100    
reco:pandora:StandardPandora                   0.0605264      2.36286       43.5393       1.53472       4.40431        100    
[art]:TriggerResults:TriggerResultInserter     1.143e-05    2.51234e-05   6.7551e-05    2.4061e-05     1.02e-05        100    
end_path:out1:RootOutput                       3.229e-06    5.91216e-06    1.885e-05     6.385e-06    2.11693e-06      100    
end_path:out1:RootOutput(write)                0.0011065     0.0133032     0.139017     0.00932269     0.0173131       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2220.24 MB
  Peak resident set size usage (VmHWM): 1208.14 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===