Jobsub ID 240948.0@dunegpschedd02.fnal.gov

Jobsub ID	240948.0@dunegpschedd02.fnal.gov
Workflow ID	9903
Stage ID	1
User name	schellma@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-10 15:47:09
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat	2025-11-10 15:49:52
From worker node	Hostname	dunegli-7716034-0-fnpc22027.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-10 15:48:22
Input files	monte-carlo-009903-000001
Jobscript	Exit code	0
	Real time	0m (52s)
	CPU time	0m (22s = 42%)
	Max RSS bytes	607191040 (579 MiB)
Outputting started	2025-11-10 15:49:14
Output files	usertests:prodmarley_nue_flat_es_dune10kt_1x2x2.fcl_trg_mc_2025a_detsim_dune10kt_1x2x2_notpcsigproc.fcl_detsim_v10_06_00d01_triggerana_dune10kt_1x2x2.fcl_s0_l20_hists_merged_20251110T214512.root
Finished	2025-11-10 15:49:52
Saved logs	justin-logs:240948.0-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

essing the 958th record. run: 8106 subRun: 0 event: 224758 at 10-Nov-2025 21:49:13 UTC
Begin processing the 959th record. run: 8106 subRun: 0 event: 224759 at 10-Nov-2025 21:49:13 UTC
Begin processing the 960th record. run: 8106 subRun: 0 event: 224760 at 10-Nov-2025 21:49:13 UTC
Begin processing the 961st record. run: 8106 subRun: 0 event: 224761 at 10-Nov-2025 21:49:13 UTC
Begin processing the 962nd record. run: 8106 subRun: 0 event: 224762 at 10-Nov-2025 21:49:13 UTC
Begin processing the 963rd record. run: 8106 subRun: 0 event: 224763 at 10-Nov-2025 21:49:13 UTC
Begin processing the 964th record. run: 8106 subRun: 0 event: 224764 at 10-Nov-2025 21:49:13 UTC
Begin processing the 965th record. run: 8106 subRun: 0 event: 224765 at 10-Nov-2025 21:49:13 UTC
Begin processing the 966th record. run: 8106 subRun: 0 event: 224766 at 10-Nov-2025 21:49:13 UTC
Begin processing the 967th record. run: 8106 subRun: 0 event: 224767 at 10-Nov-2025 21:49:13 UTC
Begin processing the 968th record. run: 8106 subRun: 0 event: 224768 at 10-Nov-2025 21:49:13 UTC
Begin processing the 969th record. run: 8106 subRun: 0 event: 224769 at 10-Nov-2025 21:49:13 UTC
Begin processing the 970th record. run: 8106 subRun: 0 event: 224770 at 10-Nov-2025 21:49:13 UTC
Begin processing the 971st record. run: 8106 subRun: 0 event: 224771 at 10-Nov-2025 21:49:13 UTC
Begin processing the 972nd record. run: 8106 subRun: 0 event: 224772 at 10-Nov-2025 21:49:13 UTC
Begin processing the 973rd record. run: 8106 subRun: 0 event: 224773 at 10-Nov-2025 21:49:13 UTC
Begin processing the 974th record. run: 8106 subRun: 0 event: 224774 at 10-Nov-2025 21:49:13 UTC
Begin processing the 975th record. run: 8106 subRun: 0 event: 224775 at 10-Nov-2025 21:49:13 UTC
Begin processing the 976th record. run: 8106 subRun: 0 event: 224776 at 10-Nov-2025 21:49:13 UTC
Begin processing the 977th record. run: 8106 subRun: 0 event: 224777 at 10-Nov-2025 21:49:13 UTC
Begin processing the 978th record. run: 8106 subRun: 0 event: 224778 at 10-Nov-2025 21:49:13 UTC
Begin processing the 979th record. run: 8106 subRun: 0 event: 224779 at 10-Nov-2025 21:49:13 UTC
Begin processing the 980th record. run: 8106 subRun: 0 event: 224780 at 10-Nov-2025 21:49:13 UTC
Begin processing the 981st record. run: 8106 subRun: 0 event: 224781 at 10-Nov-2025 21:49:13 UTC
Begin processing the 982nd record. run: 8106 subRun: 0 event: 224782 at 10-Nov-2025 21:49:13 UTC
Begin processing the 983rd record. run: 8106 subRun: 0 event: 224783 at 10-Nov-2025 21:49:13 UTC
Begin processing the 984th record. run: 8106 subRun: 0 event: 224784 at 10-Nov-2025 21:49:13 UTC
Begin processing the 985th record. run: 8106 subRun: 0 event: 224785 at 10-Nov-2025 21:49:13 UTC
Begin processing the 986th record. run: 8106 subRun: 0 event: 224786 at 10-Nov-2025 21:49:13 UTC
Begin processing the 987th record. run: 8106 subRun: 0 event: 224787 at 10-Nov-2025 21:49:13 UTC
Begin processing the 988th record. run: 8106 subRun: 0 event: 224788 at 10-Nov-2025 21:49:13 UTC
Begin processing the 989th record. run: 8106 subRun: 0 event: 224789 at 10-Nov-2025 21:49:13 UTC
Begin processing the 990th record. run: 8106 subRun: 0 event: 224790 at 10-Nov-2025 21:49:13 UTC
Begin processing the 991st record. run: 8106 subRun: 0 event: 224791 at 10-Nov-2025 21:49:13 UTC
Begin processing the 992nd record. run: 8106 subRun: 0 event: 224792 at 10-Nov-2025 21:49:13 UTC
Begin processing the 993rd record. run: 8106 subRun: 0 event: 224793 at 10-Nov-2025 21:49:14 UTC
Begin processing the 994th record. run: 8106 subRun: 0 event: 224794 at 10-Nov-2025 21:49:14 UTC
Begin processing the 995th record. run: 8106 subRun: 0 event: 224795 at 10-Nov-2025 21:49:14 UTC
Begin processing the 996th record. run: 8106 subRun: 0 event: 224796 at 10-Nov-2025 21:49:14 UTC
Begin processing the 997th record. run: 8106 subRun: 0 event: 224797 at 10-Nov-2025 21:49:14 UTC
Begin processing the 998th record. run: 8106 subRun: 0 event: 224798 at 10-Nov-2025 21:49:14 UTC
Begin processing the 999th record. run: 8106 subRun: 0 event: 224799 at 10-Nov-2025 21:49:14 UTC
Begin processing the 1000th record. run: 8106 subRun: 0 event: 224800 at 10-Nov-2025 21:49:14 UTC
10-Nov-2025 21:49:14 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/5b/5e/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T164340Z_gen_004496_supernova_g4_detsim.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                            0.000895877   0.00371483     0.0577619    0.00169363     0.0060244      1000    
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                7.4861e-05    0.00136789     0.0566392     8.962e-05    0.00553987      1000    
end_path:triggerAna:TriggerAnaTree    0.000703673   0.00222014     0.0208607    0.00137332    0.00224062      1000    
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1267.16 MB
  Peak resident set size usage (VmHWM): 607.191 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Merging 20 files into ./prodmarley_nue_flat_es_dune10kt_1x2x2.fcl_trg_mc_2025a_detsim_dune10kt_1x2x2_notpcsigproc.fcl_detsim_v10_06_00d01_triggerana_dune10kt_1x2x2.fcl_s0_l20_hists_merged_20251110T214512.root using method lar
lar -c /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/362c01740f3c2747249e13f4fb8ac86b7a3b7c09/triggerana_dune10kt_1x2x2.fcl -n 10000000 -s root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/c2/90/prodmarley_nue_flat_es_dune10kt_1x2x2_20250826T083554Z_gen_000433_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/31/f9/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T162134Z_gen_000183_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/ea/50/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T163509Z_gen_000520_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/ae/5a/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T163750Z_gen_000585_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/f0/b7/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T164516Z_gen_000843_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/e5/50/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T164636Z_gen_000933_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/83/6f/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165427Z_gen_001234_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/13/ab/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165551Z_gen_001325_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/d3/e7/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T170754Z_gen_002072_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/cd/40/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T171033Z_gen_002281_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/d6/ec/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T171038Z_gen_002292_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/77/98/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T171109Z_gen_002345_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/f7/27/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T172443Z_gen_003065_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/e3/7f/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T173701Z_gen_003770_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/ba/c1/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061509Z_gen_000071_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/ab/db/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T063210Z_gen_000253_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/97/87/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T065320Z_gen_000543_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/5c/5f/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T163202Z_gen_003253_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/a0/cd/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T163809Z_gen_003556_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/5b/5e/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T164340Z_gen_004496_supernova_g4_detsim.root && mv triggerAna.ntuple.root ./prodmarley_nue_flat_es_dune10kt_1x2x2.fcl_trg_mc_2025a_detsim_dune10kt_1x2x2_notpcsigproc.fcl_detsim_v10_06_00d01_triggerana_dune10kt_1x2x2.fcl_s0_l20_hists_merged_20251110T214512.root
merged pass1_US_FNAL-FermiGrid_000001.json