Jobsub ID 240963.10@dunegpschedd02.fnal.gov

Jobsub ID	240963.10@dunegpschedd02.fnal.gov
Workflow ID	9905
Stage ID	1
User name	schellma@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-10 17:03:13
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat	2025-11-10 17:11:11
From worker node	Hostname	dunegli-7718926-0-fnpc23014.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-10 17:07:59
Input files	monte-carlo-009905-000012
Jobscript	Exit code	0
	Real time	2m (156s)
	CPU time	0m (37s = 23%)
	Max RSS bytes	607752192 (579 MiB)
Outputting started	2025-11-10 17:10:36
Output files	usertests:prodmarley_nue_flat_es_dune10kt_1x2x2.fcl_trg_mc_2025a_detsim_dune10kt_1x2x2_notpcsigproc.fcl_detsim_v10_06_00d01_triggerana_dune10kt_1x2x2.fcl_s0_l20000_hists_merged_20251110T222923_f11.root
Finished	2025-11-10 17:11:11
Saved logs	justin-logs:240963.10-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

4872nd record. run: 8106 subRun: 0 event: 34422 at 10-Nov-2025 23:10:30 UTC
Begin processing the 4873rd record. run: 8106 subRun: 0 event: 34423 at 10-Nov-2025 23:10:30 UTC
Begin processing the 4874th record. run: 8106 subRun: 0 event: 34424 at 10-Nov-2025 23:10:30 UTC
Begin processing the 4875th record. run: 8106 subRun: 0 event: 34425 at 10-Nov-2025 23:10:30 UTC
Begin processing the 4876th record. run: 8106 subRun: 0 event: 34426 at 10-Nov-2025 23:10:30 UTC
Begin processing the 4877th record. run: 8106 subRun: 0 event: 34427 at 10-Nov-2025 23:10:30 UTC
Begin processing the 4878th record. run: 8106 subRun: 0 event: 34428 at 10-Nov-2025 23:10:30 UTC
Begin processing the 4879th record. run: 8106 subRun: 0 event: 34429 at 10-Nov-2025 23:10:30 UTC
Begin processing the 4880th record. run: 8106 subRun: 0 event: 34430 at 10-Nov-2025 23:10:30 UTC
Begin processing the 4881st record. run: 8106 subRun: 0 event: 34431 at 10-Nov-2025 23:10:30 UTC
Begin processing the 4882nd record. run: 8106 subRun: 0 event: 34432 at 10-Nov-2025 23:10:30 UTC
Begin processing the 4883rd record. run: 8106 subRun: 0 event: 34433 at 10-Nov-2025 23:10:30 UTC
Begin processing the 4884th record. run: 8106 subRun: 0 event: 34434 at 10-Nov-2025 23:10:30 UTC
Begin processing the 4885th record. run: 8106 subRun: 0 event: 34435 at 10-Nov-2025 23:10:31 UTC
Begin processing the 4886th record. run: 8106 subRun: 0 event: 34436 at 10-Nov-2025 23:10:31 UTC
Begin processing the 4887th record. run: 8106 subRun: 0 event: 34437 at 10-Nov-2025 23:10:31 UTC
Begin processing the 4888th record. run: 8106 subRun: 0 event: 34438 at 10-Nov-2025 23:10:31 UTC
Begin processing the 4889th record. run: 8106 subRun: 0 event: 34439 at 10-Nov-2025 23:10:31 UTC
Begin processing the 4890th record. run: 8106 subRun: 0 event: 34440 at 10-Nov-2025 23:10:31 UTC
Begin processing the 4891st record. run: 8106 subRun: 0 event: 34441 at 10-Nov-2025 23:10:31 UTC
Begin processing the 4892nd record. run: 8106 subRun: 0 event: 34442 at 10-Nov-2025 23:10:31 UTC
Begin processing the 4893rd record. run: 8106 subRun: 0 event: 34443 at 10-Nov-2025 23:10:31 UTC
Begin processing the 4894th record. run: 8106 subRun: 0 event: 34444 at 10-Nov-2025 23:10:31 UTC
Begin processing the 4895th record. run: 8106 subRun: 0 event: 34445 at 10-Nov-2025 23:10:31 UTC
Begin processing the 4896th record. run: 8106 subRun: 0 event: 34446 at 10-Nov-2025 23:10:31 UTC
Begin processing the 4897th record. run: 8106 subRun: 0 event: 34447 at 10-Nov-2025 23:10:31 UTC
Begin processing the 4898th record. run: 8106 subRun: 0 event: 34448 at 10-Nov-2025 23:10:31 UTC
Begin processing the 4899th record. run: 8106 subRun: 0 event: 34449 at 10-Nov-2025 23:10:31 UTC
Begin processing the 4900th record. run: 8106 subRun: 0 event: 34450 at 10-Nov-2025 23:10:31 UTC
10-Nov-2025 23:10:31 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/96/0f/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T164127Z_gen_000689_supernova_g4_detsim.root"
10-Nov-2025 23:10:31 UTC  Initiating request to open input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/f2/e8/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T164127Z_gen_000690_supernova_g4_detsim.root"
10-Nov-2025 23:10:31 UTC  Opened input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/f2/e8/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T164127Z_gen_000690_supernova_g4_detsim.root"
Begin processing the 4901st record. run: 8106 subRun: 0 event: 34451 at 10-Nov-2025 23:10:31 UTC
Begin processing the 4902nd record. run: 8106 subRun: 0 event: 34452 at 10-Nov-2025 23:10:32 UTC
Begin processing the 4903rd record. run: 8106 subRun: 0 event: 34453 at 10-Nov-2025 23:10:32 UTC
Begin processing the 4904th record. run: 8106 subRun: 0 event: 34454 at 10-Nov-2025 23:10:32 UTC
Begin processing the 4905th record. run: 8106 subRun: 0 event: 34455 at 10-Nov-2025 23:10:32 UTC
Begin processing the 4906th record. run: 8106 subRun: 0 event: 34456 at 10-Nov-2025 23:10:32 UTC
Begin processing the 4907th record. run: 8106 subRun: 0 event: 34457 at 10-Nov-2025 23:10:32 UTC
Begin processing the 4908th record. run: 8106 subRun: 0 event: 34458 at 10-Nov-2025 23:10:32 UTC
Begin processing the 4909th record. run: 8106 subRun: 0 event: 34459 at 10-Nov-2025 23:10:32 UTC
Begin processing the 4910th record. run: 8106 subRun: 0 event: 34460 at 10-Nov-2025 23:10:32 UTC
Begin processing the 4911th record. run: 8106 subRun: 0 event: 34461 at 10-Nov-2025 23:10:32 UTC
Begin processing the 4912th record. run: 8106 subRun: 0 event: 34462 at 10-Nov-2025 23:10:32 UTC
Begin processing the 4913th record. run: 8106 subRun: 0 event: 34463 at 10-Nov-2025 23:10:32 UTC
Begin processing the 4914th record. run: 8106 subRun: 0 event: 34464 at 10-Nov-2025 23:10:33 UTC
Begin processing the 4915th record. run: 8106 subRun: 0 event: 34465 at 10-Nov-2025 23:10:33 UTC
Begin processing the 4916th record. run: 8106 subRun: 0 event: 34466 at 10-Nov-2025 23:10:33 UTC
Begin processing the 4917th record. run: 8106 subRun: 0 event: 34467 at 10-Nov-2025 23:10:33 UTC
Begin processing the 4918th record. run: 8106 subRun: 0 event: 34468 at 10-Nov-2025 23:10:33 UTC
Begin processing the 4919th record. run: 8106 subRun: 0 event: 34469 at 10-Nov-2025 23:10:33 UTC
Begin processing the 4920th record. run: 8106 subRun: 0 event: 34470 at 10-Nov-2025 23:10:33 UTC
Begin processing the 4921st record. run: 8106 subRun: 0 event: 34471 at 10-Nov-2025 23:10:33 UTC
Begin processing the 4922nd record. run: 8106 subRun: 0 event: 34472 at 10-Nov-2025 23:10:33 UTC
Begin processing the 4923rd record. run: 8106 subRun: 0 event: 34473 at 10-Nov-2025 23:10:33 UTC
Begin processing the 4924th record. run: 8106 subRun: 0 event: 34474 at 10-Nov-2025 23:10:33 UTC
Begin processing the 4925th record. run: 8106 subRun: 0 event: 34475 at 10-Nov-2025 23:10:33 UTC
Begin processing the 4926th record. run: 8106 subRun: 0 event: 34476 at 10-Nov-2025 23:10:33 UTC
Begin processing the 4927th record. run: 8106 subRun: 0 event: 34477 at 10-Nov-2025 23:10:33 UTC
Begin processing the 4928th record. run: 8106 subRun: 0 event: 34478 at 10-Nov-2025 23:10:33 UTC
Begin processing the 4929th record. run: 8106 subRun: 0 event: 34479 at 10-Nov-2025 23:10:33 UTC
Begin processing the 4930th record. run: 8106 subRun: 0 event: 34480 at 10-Nov-2025 23:10:33 UTC
Begin processing the 4931st record. run: 8106 subRun: 0 event: 34481 at 10-Nov-2025 23:10:33 UTC
Begin processing the 4932nd record. run: 8106 subRun: 0 event: 34482 at 10-Nov-2025 23:10:33 UTC
Begin processing the 4933rd record. run: 8106 subRun: 0 event: 34483 at 10-Nov-2025 23:10:34 UTC
Begin processing the 4934th record. run: 8106 subRun: 0 event: 34484 at 10-Nov-2025 23:10:34 UTC
Begin processing the 4935th record. run: 8106 subRun: 0 event: 34485 at 10-Nov-2025 23:10:34 UTC
Begin processing the 4936th record. run: 8106 subRun: 0 event: 34486 at 10-Nov-2025 23:10:34 UTC
Begin processing the 4937th record. run: 8106 subRun: 0 event: 34487 at 10-Nov-2025 23:10:34 UTC
Begin processing the 4938th record. run: 8106 subRun: 0 event: 34488 at 10-Nov-2025 23:10:34 UTC
Begin processing the 4939th record. run: 8106 subRun: 0 event: 34489 at 10-Nov-2025 23:10:34 UTC
Begin processing the 4940th record. run: 8106 subRun: 0 event: 34490 at 10-Nov-2025 23:10:34 UTC
Begin processing the 4941st record. run: 8106 subRun: 0 event: 34491 at 10-Nov-2025 23:10:34 UTC
Begin processing the 4942nd record. run: 8106 subRun: 0 event: 34492 at 10-Nov-2025 23:10:34 UTC
Begin processing the 4943rd record. run: 8106 subRun: 0 event: 34493 at 10-Nov-2025 23:10:34 UTC
Begin processing the 4944th record. run: 8106 subRun: 0 event: 34494 at 10-Nov-2025 23:10:34 UTC
Begin processing the 4945th record. run: 8106 subRun: 0 event: 34495 at 10-Nov-2025 23:10:34 UTC
Begin processing the 4946th record. run: 8106 subRun: 0 event: 34496 at 10-Nov-2025 23:10:34 UTC
Begin processing the 4947th record. run: 8106 subRun: 0 event: 34497 at 10-Nov-2025 23:10:34 UTC
Begin processing the 4948th record. run: 8106 subRun: 0 event: 34498 at 10-Nov-2025 23:10:34 UTC
Begin processing the 4949th record. run: 8106 subRun: 0 event: 34499 at 10-Nov-2025 23:10:34 UTC
Begin processing the 4950th record. run: 8106 subRun: 0 event: 34500 at 10-Nov-2025 23:10:34 UTC
10-Nov-2025 23:10:34 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/f2/e8/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T164127Z_gen_000690_supernova_g4_detsim.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                            0.000717876   0.00372133     0.541245     0.00147965     0.0166054      4950    
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                5.6769e-05    0.00162365     0.539487     8.5259e-05     0.0127124      4950    
end_path:triggerAna:TriggerAnaTree    0.000598376   0.00196986     0.518753     0.00119092     0.0107161      4950    
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1300.76 MB
  Peak resident set size usage (VmHWM): 607.752 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.

merged pass1_US_FNAL-FermiGrid_000012.json