Jobsub ID 250840.18@dunegpschedd01.fnal.gov

Jobsub ID	250840.18@dunegpschedd01.fnal.gov
Workflow ID	10202
Stage ID	1
User name	schellma@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-14 21:28:03
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat	2025-11-14 21:51:50
From worker node	Hostname	dunegli-7757042-0-fnpc22034.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-14 21:37:21
Input files	monte-carlo-010202-000018
Jobscript	Exit code	0
	Real time	0m (12s)
	CPU time	0m (9s = 74%)
	Max RSS bytes	618369024 (589 MiB)
Outputting started	2025-11-14 21:37:33
Output files	usertests:prodmarley_nue_flat_es_dune10kt_1x2x2.fcl_trg_mc_2025a_detsim_dune10kt_1x2x2_notpcsigproc.fcl_detsim_v10_06_00d01_triggerana_dune10kt_1x2x2.fcl_v10_12_01d01_s0_l10000_triggerana_0_ntuple_triggerana_0_20251114T202412_c17.root
Finished	2025-11-14 21:51:50
Saved logs	justin-logs:250840.18-dunegpschedd01.fnal.gov.logs.tgz
List job events (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

/fnal.gov/usr/dune/persistent/staging/fardet-hd/00/26/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165518Z_gen_001287_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/df/19/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165518Z_gen_001288_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/88/5a/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165519Z_gen_001289_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/59/e7/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165520Z_gen_001290_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/8a/69/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165523Z_gen_001291_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/e1/bb/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165523Z_gen_001292_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/2b/8d/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165524Z_gen_001293_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/27/33/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165524Z_gen_001294_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/3e/10/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165525Z_gen_001295_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/03/23/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165527Z_gen_001296_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/e4/6e/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165527Z_gen_001297_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/6a/d1/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165528Z_gen_001298_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/e1/e8/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165529Z_gen_001299_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/00/2d/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165529Z_gen_001300_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/9f/1a/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165530Z_gen_001301_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/a1/97/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165531Z_gen_001302_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/cf/1b/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165531Z_gen_001303_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/03/07/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165532Z_gen_001304_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/09/23/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165533Z_gen_001305_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/54/38/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165533Z_gen_001306_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/bb/0d/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165533Z_gen_001307_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/cd/df/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165533Z_gen_001308_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/fd/b6/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165534Z_gen_001309_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/7b/c3/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165534Z_gen_001310_supernova_g4_detsim.root
AcdDigitReader::ctor:     LogLevel: 1
DuneToolManager::getPrivate: ERROR: Tool name is blank
StandardRawDigitExtractService::ctor: Retrieved digit read tool digitReader
StandardRawDigitExtractService::ctor: StandardRawDigitExtractService:
StandardRawDigitExtractService::ctor:         LogLevel: 1
StandardRawDigitExtractService::ctor:    DigitReadTool: digitReader
StandardRawDigitExtractService::ctor:   PedestalOption: 1
StandardRawDigitExtractService::ctor:     FlagStuckOff: 0
StandardRawDigitExtractService::ctor:      FlagStuckOn: 0
StandardRawDigitPrepService::ctor: Fetching extract service.
StandardRawDigitPrepService::ctor: Fetching channel status provider.
StandardRawDigitPrepService::ctor:   Channel status provider: @0x8316fb0
StandardRawDigitPrepService::ctor:   Extract service: @0x8ed7320
StandardRawDigitPrepService::ctor: Fetching deconvolution service.
StandardRawDigitPrepService::ctor:   Deconvolution service: @0x25a6b80
StandardRawDigitPrepService::ctor: Fetching ROI building service.
StandardRawDigitPrepService::ctor:   ROI building service: @0x25a0150
StandardRawDigitPrepService::ctor: Fetching wire building service.
StandardRawDigitPrepService::ctor:   Wire building service: @0x259f440
StandardRawDigitPrepService::ctor: StandardRawDigitPrepService:
StandardRawDigitPrepService::ctor:              LogLevel: 1
StandardRawDigitPrepService::ctor:               SkipBad: 1
StandardRawDigitPrepService::ctor:             SkipNoisy: 0
StandardRawDigitPrepService::ctor:   ChannelStatusOnline: 0
StandardRawDigitPrepService::ctor:          DoMitigation: 0
StandardRawDigitPrepService::ctor:  DoEarlySignalFinding: 0
StandardRawDigitPrepService::ctor:        DoNoiseRemoval: 0
StandardRawDigitPrepService::ctor:       DoDeconvolution: 1
StandardRawDigitPrepService::ctor:  DoPedestalAdjustment: 0
StandardRawDigitPrepService::ctor:                 DoROI: 1
StandardRawDigitPrepService::ctor:               DoWires: 1
StandardRawDigitPrepService::ctor:                DoDump: 0
StandardRawDigitPrepService::ctor:  DoIntermediateStates: 0
StandardRawDigitPrepService::ctor: No display tools.
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
14-Nov-2025 21:37:31 UTC  Initiating request to open input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/0b/b5/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165402Z_gen_001209_supernova_g4_detsim.root"
14-Nov-2025 21:37:32 UTC  Opened input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/0b/b5/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165402Z_gen_001209_supernova_g4_detsim.root"
Begin processing the 1st record. run: 8106 subRun: 0 event: 60401 at 14-Nov-2025 21:37:32 UTC
Begin processing the 2nd record. run: 8106 subRun: 0 event: 60402 at 14-Nov-2025 21:37:32 UTC
Begin processing the 3rd record. run: 8106 subRun: 0 event: 60403 at 14-Nov-2025 21:37:32 UTC
Begin processing the 4th record. run: 8106 subRun: 0 event: 60404 at 14-Nov-2025 21:37:32 UTC
Begin processing the 5th record. run: 8106 subRun: 0 event: 60405 at 14-Nov-2025 21:37:32 UTC
Begin processing the 6th record. run: 8106 subRun: 0 event: 60406 at 14-Nov-2025 21:37:32 UTC
Begin processing the 7th record. run: 8106 subRun: 0 event: 60407 at 14-Nov-2025 21:37:32 UTC
Begin processing the 8th record. run: 8106 subRun: 0 event: 60408 at 14-Nov-2025 21:37:32 UTC
Begin processing the 9th record. run: 8106 subRun: 0 event: 60409 at 14-Nov-2025 21:37:32 UTC
Begin processing the 10th record. run: 8106 subRun: 0 event: 60410 at 14-Nov-2025 21:37:32 UTC
14-Nov-2025 21:37:32 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/0b/b5/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T165402Z_gen_001209_supernova_g4_detsim.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                            0.000918997   0.00355049     0.0190338    0.00170872    0.00523802       10     
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                6.0646e-05    0.00135431     0.0128261    7.25785e-05   0.00382401       10     
end_path:triggerAna:TriggerAnaTree    0.000792175   0.00206708    0.00554435    0.00156613    0.00146958       10     
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1309.92 MB
  Peak resident set size usage (VmHWM): 618.369 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.

Processing output file prodmarley_nue_flat_es_dune10kt_1x2x2.fcl_trg_mc_2025a_detsim_dune10kt_1x2x2_notpcsigproc.fcl_detsim_v10_06_00d01_triggerana_dune10kt_1x2x2.fcl_v10_12_01d01_s0_l10000_triggerana_0_ntuple_triggerana_0_20251114T202412_c17.root
merged pass1_US_FNAL-FermiGrid_000018.json