Jobsub ID 249059.51@dunegpschedd01.fnal.gov

Jobsub ID	249059.51@dunegpschedd01.fnal.gov
Workflow ID	10157
Stage ID	1
User name	schellma@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-13 19:08:04
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2025-11-14 01:14:51
From worker node	Hostname	dunegli-7587009-0-fnpc22029.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-14 00:53:10
Input files	monte-carlo-010157-000044
Jobscript	Exit code	0
	Real time	4m (253s)
	CPU time	0m (45s = 17%)
	Max RSS bytes	606949376 (578 MiB)
Outputting started	2025-11-14 00:57:24
Output files	usertests:prodmarley_nue_flat_es_dune10kt_1x2x2.fcl_trg_mc_2025a_detsim_dune10kt_1x2x2_notpcsigproc.fcl_detsim_v10_06_00d01_triggerana_dune10kt_1x2x2.fcl_hists_merged_20251113T182708_f43.root
Finished	2025-11-14 01:14:51
Saved logs	justin-logs:249059.51-dunegpschedd01.fnal.gov.logs.tgz
List job events (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

un: 8145 subRun: 0 event: 6521 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4872nd record. run: 8145 subRun: 0 event: 6522 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4873rd record. run: 8145 subRun: 0 event: 6523 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4874th record. run: 8145 subRun: 0 event: 6524 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4875th record. run: 8145 subRun: 0 event: 6525 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4876th record. run: 8145 subRun: 0 event: 6526 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4877th record. run: 8145 subRun: 0 event: 6527 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4878th record. run: 8145 subRun: 0 event: 6528 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4879th record. run: 8145 subRun: 0 event: 6529 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4880th record. run: 8145 subRun: 0 event: 6530 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4881st record. run: 8145 subRun: 0 event: 6531 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4882nd record. run: 8145 subRun: 0 event: 6532 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4883rd record. run: 8145 subRun: 0 event: 6533 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4884th record. run: 8145 subRun: 0 event: 6534 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4885th record. run: 8145 subRun: 0 event: 6535 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4886th record. run: 8145 subRun: 0 event: 6536 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4887th record. run: 8145 subRun: 0 event: 6537 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4888th record. run: 8145 subRun: 0 event: 6538 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4889th record. run: 8145 subRun: 0 event: 6539 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4890th record. run: 8145 subRun: 0 event: 6540 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4891st record. run: 8145 subRun: 0 event: 6541 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4892nd record. run: 8145 subRun: 0 event: 6542 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4893rd record. run: 8145 subRun: 0 event: 6543 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4894th record. run: 8145 subRun: 0 event: 6544 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4895th record. run: 8145 subRun: 0 event: 6545 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4896th record. run: 8145 subRun: 0 event: 6546 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4897th record. run: 8145 subRun: 0 event: 6547 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4898th record. run: 8145 subRun: 0 event: 6548 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4899th record. run: 8145 subRun: 0 event: 6549 at 14-Nov-2025 00:57:21 UTC
Begin processing the 4900th record. run: 8145 subRun: 0 event: 6550 at 14-Nov-2025 00:57:21 UTC
14-Nov-2025 00:57:22 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/50/ac/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T062232Z_gen_000131_supernova_g4_detsim.root"
14-Nov-2025 00:57:22 UTC  Initiating request to open input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/c4/54/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T062236Z_gen_000132_supernova_g4_detsim.root"
14-Nov-2025 00:57:22 UTC  Opened input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/c4/54/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T062236Z_gen_000132_supernova_g4_detsim.root"
Begin processing the 4901st record. run: 8145 subRun: 0 event: 6551 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4902nd record. run: 8145 subRun: 0 event: 6552 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4903rd record. run: 8145 subRun: 0 event: 6553 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4904th record. run: 8145 subRun: 0 event: 6554 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4905th record. run: 8145 subRun: 0 event: 6555 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4906th record. run: 8145 subRun: 0 event: 6556 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4907th record. run: 8145 subRun: 0 event: 6557 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4908th record. run: 8145 subRun: 0 event: 6558 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4909th record. run: 8145 subRun: 0 event: 6559 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4910th record. run: 8145 subRun: 0 event: 6560 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4911th record. run: 8145 subRun: 0 event: 6561 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4912th record. run: 8145 subRun: 0 event: 6562 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4913th record. run: 8145 subRun: 0 event: 6563 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4914th record. run: 8145 subRun: 0 event: 6564 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4915th record. run: 8145 subRun: 0 event: 6565 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4916th record. run: 8145 subRun: 0 event: 6566 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4917th record. run: 8145 subRun: 0 event: 6567 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4918th record. run: 8145 subRun: 0 event: 6568 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4919th record. run: 8145 subRun: 0 event: 6569 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4920th record. run: 8145 subRun: 0 event: 6570 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4921st record. run: 8145 subRun: 0 event: 6571 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4922nd record. run: 8145 subRun: 0 event: 6572 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4923rd record. run: 8145 subRun: 0 event: 6573 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4924th record. run: 8145 subRun: 0 event: 6574 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4925th record. run: 8145 subRun: 0 event: 6575 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4926th record. run: 8145 subRun: 0 event: 6576 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4927th record. run: 8145 subRun: 0 event: 6577 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4928th record. run: 8145 subRun: 0 event: 6578 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4929th record. run: 8145 subRun: 0 event: 6579 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4930th record. run: 8145 subRun: 0 event: 6580 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4931st record. run: 8145 subRun: 0 event: 6581 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4932nd record. run: 8145 subRun: 0 event: 6582 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4933rd record. run: 8145 subRun: 0 event: 6583 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4934th record. run: 8145 subRun: 0 event: 6584 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4935th record. run: 8145 subRun: 0 event: 6585 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4936th record. run: 8145 subRun: 0 event: 6586 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4937th record. run: 8145 subRun: 0 event: 6587 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4938th record. run: 8145 subRun: 0 event: 6588 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4939th record. run: 8145 subRun: 0 event: 6589 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4940th record. run: 8145 subRun: 0 event: 6590 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4941st record. run: 8145 subRun: 0 event: 6591 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4942nd record. run: 8145 subRun: 0 event: 6592 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4943rd record. run: 8145 subRun: 0 event: 6593 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4944th record. run: 8145 subRun: 0 event: 6594 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4945th record. run: 8145 subRun: 0 event: 6595 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4946th record. run: 8145 subRun: 0 event: 6596 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4947th record. run: 8145 subRun: 0 event: 6597 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4948th record. run: 8145 subRun: 0 event: 6598 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4949th record. run: 8145 subRun: 0 event: 6599 at 14-Nov-2025 00:57:22 UTC
Begin processing the 4950th record. run: 8145 subRun: 0 event: 6600 at 14-Nov-2025 00:57:23 UTC
14-Nov-2025 00:57:23 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/c4/54/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T062236Z_gen_000132_supernova_g4_detsim.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                            0.000752708    0.0142111      2.0846      0.00216452     0.0491598      4950    
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                6.1727e-05    0.00843591     0.731021     0.00013143     0.0202122      4950    
end_path:triggerAna:TriggerAnaTree    0.000618203   0.00507301      2.08421     0.00133034     0.0426483      4950    
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1300.76 MB
  Peak resident set size usage (VmHWM): 606.949 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.

merged pass1_US_FNAL-FermiGrid_000044.json