Jobsub ID 243184.24@dunegpschedd02.fnal.gov

Jobsub ID	243184.24@dunegpschedd02.fnal.gov
Workflow ID	9970
Stage ID	1
User name	schellma@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-13 15:49:36
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat	2025-11-13 17:09:26
From worker node	Hostname	dunegli-7742183-0-fnpc23040.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-13 17:05:59
Input files	monte-carlo-009970-000008
Jobscript	Exit code	0
	Real time	2m (167s)
	CPU time	0m (33s = 19%)
	Max RSS bytes	607490048 (579 MiB)
Outputting started	2025-11-13 17:08:46
Output files	usertests:prodmarley_nue_flat_es_dune10kt_1x2x2.fcl_trg_mc_2025a_detsim_dune10kt_1x2x2_notpcsigproc.fcl_detsim_v10_06_00d01_triggerana_dune10kt_1x2x2.fcl_s2500_l3500_202511111537_hists_merged_20251112T013820_f7.root
Finished	2025-11-13 17:09:26
Saved logs	justin-logs:243184.24-dunegpschedd02.fnal.gov.logs.tgz
List job events (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

e 4872nd record. run: 8106 subRun: 0 event: 48672 at 13-Nov-2025 17:08:41 UTC
Begin processing the 4873rd record. run: 8106 subRun: 0 event: 48673 at 13-Nov-2025 17:08:41 UTC
Begin processing the 4874th record. run: 8106 subRun: 0 event: 48674 at 13-Nov-2025 17:08:41 UTC
Begin processing the 4875th record. run: 8106 subRun: 0 event: 48675 at 13-Nov-2025 17:08:41 UTC
Begin processing the 4876th record. run: 8106 subRun: 0 event: 48676 at 13-Nov-2025 17:08:42 UTC
Begin processing the 4877th record. run: 8106 subRun: 0 event: 48677 at 13-Nov-2025 17:08:42 UTC
Begin processing the 4878th record. run: 8106 subRun: 0 event: 48678 at 13-Nov-2025 17:08:42 UTC
Begin processing the 4879th record. run: 8106 subRun: 0 event: 48679 at 13-Nov-2025 17:08:42 UTC
Begin processing the 4880th record. run: 8106 subRun: 0 event: 48680 at 13-Nov-2025 17:08:42 UTC
Begin processing the 4881st record. run: 8106 subRun: 0 event: 48681 at 13-Nov-2025 17:08:42 UTC
Begin processing the 4882nd record. run: 8106 subRun: 0 event: 48682 at 13-Nov-2025 17:08:42 UTC
Begin processing the 4883rd record. run: 8106 subRun: 0 event: 48683 at 13-Nov-2025 17:08:42 UTC
Begin processing the 4884th record. run: 8106 subRun: 0 event: 48684 at 13-Nov-2025 17:08:42 UTC
Begin processing the 4885th record. run: 8106 subRun: 0 event: 48685 at 13-Nov-2025 17:08:42 UTC
Begin processing the 4886th record. run: 8106 subRun: 0 event: 48686 at 13-Nov-2025 17:08:43 UTC
Begin processing the 4887th record. run: 8106 subRun: 0 event: 48687 at 13-Nov-2025 17:08:43 UTC
Begin processing the 4888th record. run: 8106 subRun: 0 event: 48688 at 13-Nov-2025 17:08:43 UTC
Begin processing the 4889th record. run: 8106 subRun: 0 event: 48689 at 13-Nov-2025 17:08:43 UTC
Begin processing the 4890th record. run: 8106 subRun: 0 event: 48690 at 13-Nov-2025 17:08:43 UTC
Begin processing the 4891st record. run: 8106 subRun: 0 event: 48691 at 13-Nov-2025 17:08:43 UTC
Begin processing the 4892nd record. run: 8106 subRun: 0 event: 48692 at 13-Nov-2025 17:08:44 UTC
Begin processing the 4893rd record. run: 8106 subRun: 0 event: 48693 at 13-Nov-2025 17:08:44 UTC
Begin processing the 4894th record. run: 8106 subRun: 0 event: 48694 at 13-Nov-2025 17:08:44 UTC
Begin processing the 4895th record. run: 8106 subRun: 0 event: 48695 at 13-Nov-2025 17:08:44 UTC
Begin processing the 4896th record. run: 8106 subRun: 0 event: 48696 at 13-Nov-2025 17:08:44 UTC
Begin processing the 4897th record. run: 8106 subRun: 0 event: 48697 at 13-Nov-2025 17:08:44 UTC
Begin processing the 4898th record. run: 8106 subRun: 0 event: 48698 at 13-Nov-2025 17:08:44 UTC
Begin processing the 4899th record. run: 8106 subRun: 0 event: 48699 at 13-Nov-2025 17:08:44 UTC
Begin processing the 4900th record. run: 8106 subRun: 0 event: 48700 at 13-Nov-2025 17:08:44 UTC
13-Nov-2025 17:08:44 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/23/40/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T164658Z_gen_000974_supernova_g4_detsim.root"
13-Nov-2025 17:08:44 UTC  Initiating request to open input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/11/0a/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T164702Z_gen_000976_supernova_g4_detsim.root"
13-Nov-2025 17:08:45 UTC  Opened input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/11/0a/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T164702Z_gen_000976_supernova_g4_detsim.root"
Begin processing the 4901st record. run: 8106 subRun: 0 event: 48751 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4902nd record. run: 8106 subRun: 0 event: 48752 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4903rd record. run: 8106 subRun: 0 event: 48753 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4904th record. run: 8106 subRun: 0 event: 48754 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4905th record. run: 8106 subRun: 0 event: 48755 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4906th record. run: 8106 subRun: 0 event: 48756 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4907th record. run: 8106 subRun: 0 event: 48757 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4908th record. run: 8106 subRun: 0 event: 48758 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4909th record. run: 8106 subRun: 0 event: 48759 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4910th record. run: 8106 subRun: 0 event: 48760 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4911th record. run: 8106 subRun: 0 event: 48761 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4912th record. run: 8106 subRun: 0 event: 48762 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4913th record. run: 8106 subRun: 0 event: 48763 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4914th record. run: 8106 subRun: 0 event: 48764 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4915th record. run: 8106 subRun: 0 event: 48765 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4916th record. run: 8106 subRun: 0 event: 48766 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4917th record. run: 8106 subRun: 0 event: 48767 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4918th record. run: 8106 subRun: 0 event: 48768 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4919th record. run: 8106 subRun: 0 event: 48769 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4920th record. run: 8106 subRun: 0 event: 48770 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4921st record. run: 8106 subRun: 0 event: 48771 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4922nd record. run: 8106 subRun: 0 event: 48772 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4923rd record. run: 8106 subRun: 0 event: 48773 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4924th record. run: 8106 subRun: 0 event: 48774 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4925th record. run: 8106 subRun: 0 event: 48775 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4926th record. run: 8106 subRun: 0 event: 48776 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4927th record. run: 8106 subRun: 0 event: 48777 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4928th record. run: 8106 subRun: 0 event: 48778 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4929th record. run: 8106 subRun: 0 event: 48779 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4930th record. run: 8106 subRun: 0 event: 48780 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4931st record. run: 8106 subRun: 0 event: 48781 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4932nd record. run: 8106 subRun: 0 event: 48782 at 13-Nov-2025 17:08:45 UTC
Begin processing the 4933rd record. run: 8106 subRun: 0 event: 48783 at 13-Nov-2025 17:08:46 UTC
Begin processing the 4934th record. run: 8106 subRun: 0 event: 48784 at 13-Nov-2025 17:08:46 UTC
Begin processing the 4935th record. run: 8106 subRun: 0 event: 48785 at 13-Nov-2025 17:08:46 UTC
Begin processing the 4936th record. run: 8106 subRun: 0 event: 48786 at 13-Nov-2025 17:08:46 UTC
Begin processing the 4937th record. run: 8106 subRun: 0 event: 48787 at 13-Nov-2025 17:08:46 UTC
Begin processing the 4938th record. run: 8106 subRun: 0 event: 48788 at 13-Nov-2025 17:08:46 UTC
Begin processing the 4939th record. run: 8106 subRun: 0 event: 48789 at 13-Nov-2025 17:08:46 UTC
Begin processing the 4940th record. run: 8106 subRun: 0 event: 48790 at 13-Nov-2025 17:08:46 UTC
Begin processing the 4941st record. run: 8106 subRun: 0 event: 48791 at 13-Nov-2025 17:08:46 UTC
Begin processing the 4942nd record. run: 8106 subRun: 0 event: 48792 at 13-Nov-2025 17:08:46 UTC
Begin processing the 4943rd record. run: 8106 subRun: 0 event: 48793 at 13-Nov-2025 17:08:46 UTC
Begin processing the 4944th record. run: 8106 subRun: 0 event: 48794 at 13-Nov-2025 17:08:46 UTC
Begin processing the 4945th record. run: 8106 subRun: 0 event: 48795 at 13-Nov-2025 17:08:46 UTC
Begin processing the 4946th record. run: 8106 subRun: 0 event: 48796 at 13-Nov-2025 17:08:46 UTC
Begin processing the 4947th record. run: 8106 subRun: 0 event: 48797 at 13-Nov-2025 17:08:46 UTC
Begin processing the 4948th record. run: 8106 subRun: 0 event: 48798 at 13-Nov-2025 17:08:46 UTC
Begin processing the 4949th record. run: 8106 subRun: 0 event: 48799 at 13-Nov-2025 17:08:46 UTC
Begin processing the 4950th record. run: 8106 subRun: 0 event: 48800 at 13-Nov-2025 17:08:46 UTC
13-Nov-2025 17:08:46 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/11/0a/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T164702Z_gen_000976_supernova_g4_detsim.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                            0.000713696   0.00307032     0.495093     0.00132504     0.012912       4950    
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                 5.798e-05    0.00106809     0.173358      6.793e-05    0.00563002      4950    
end_path:triggerAna:TriggerAnaTree    0.000554161   0.00189422     0.494689     0.00108845     0.0116363      4950    
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1300.76 MB
  Peak resident set size usage (VmHWM): 607.49 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.

merged pass1_US_FNAL-FermiGrid_000008.json