Jobsub ID 250840.59@dunegpschedd01.fnal.gov

Jobsub ID	250840.59@dunegpschedd01.fnal.gov
Workflow ID	10202
Stage ID	1
User name	schellma@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-14 21:28:03
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2025-11-14 21:50:02
From worker node	Hostname	dunegli-7598657-0-fnpc23007.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-14 21:45:01
Input files	monte-carlo-010202-000056
Jobscript	Exit code	0
	Real time	0m (11s)
	CPU time	0m (9s = 81%)
	Max RSS bytes	615669760 (587 MiB)
Outputting started	2025-11-14 21:45:13
Output files	usertests:prodmarley_nue_flat_es_dune10kt_1x2x2.fcl_trg_mc_2025a_detsim_dune10kt_1x2x2_notpcsigproc.fcl_detsim_v10_06_00d01_triggerana_dune10kt_1x2x2.fcl_v10_12_01d01_s0_l10000_triggerana_0_ntuple_triggerana_0_20251114T202412_c55.root
Finished	2025-11-14 21:50:02
Saved logs	justin-logs:250840.59-dunegpschedd01.fnal.gov.logs.tgz
List job events (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

/usr/dune/persistent/staging/fardet-hd/42/1d/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182938Z_gen_004385_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/30/60/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182938Z_gen_004387_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/12/67/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182938Z_gen_004390_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/76/90/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182938Z_gen_004395_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/0e/d4/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182938Z_gen_004396_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/fc/9e/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182938Z_gen_004397_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/8d/ea/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182938Z_gen_004398_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/c5/64/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182939Z_gen_004399_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/a0/2d/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182939Z_gen_004404_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/0b/be/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182939Z_gen_004406_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/87/b6/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182940Z_gen_004414_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/7e/37/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182940Z_gen_004417_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/1d/ef/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182940Z_gen_004418_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/f5/56/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182940Z_gen_004419_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/44/2d/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182941Z_gen_004420_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/c8/9b/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182941Z_gen_004421_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/57/2e/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182942Z_gen_004425_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/86/bd/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182942Z_gen_004450_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/b6/eb/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182942Z_gen_004461_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/33/12/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182943Z_gen_004488_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/d1/a1/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182943Z_gen_004499_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/b5/58/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182943Z_gen_004500_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/a2/72/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182944Z_gen_004504_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/8b/2c/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182944Z_gen_004507_supernova_g4_detsim.root
AcdDigitReader::ctor:     LogLevel: 1
DuneToolManager::getPrivate: ERROR: Tool name is blank
StandardRawDigitExtractService::ctor: Retrieved digit read tool digitReader
StandardRawDigitExtractService::ctor: StandardRawDigitExtractService:
StandardRawDigitExtractService::ctor:         LogLevel: 1
StandardRawDigitExtractService::ctor:    DigitReadTool: digitReader
StandardRawDigitExtractService::ctor:   PedestalOption: 1
StandardRawDigitExtractService::ctor:     FlagStuckOff: 0
StandardRawDigitExtractService::ctor:      FlagStuckOn: 0
StandardRawDigitPrepService::ctor: Fetching extract service.
StandardRawDigitPrepService::ctor: Fetching channel status provider.
StandardRawDigitPrepService::ctor:   Channel status provider: @0x623e8c0
StandardRawDigitPrepService::ctor:   Extract service: @0x90e02a0
StandardRawDigitPrepService::ctor: Fetching deconvolution service.
StandardRawDigitPrepService::ctor:   Deconvolution service: @0x19713f0
StandardRawDigitPrepService::ctor: Fetching ROI building service.
StandardRawDigitPrepService::ctor:   ROI building service: @0x1969150
StandardRawDigitPrepService::ctor: Fetching wire building service.
StandardRawDigitPrepService::ctor:   Wire building service: @0x36b6b80
StandardRawDigitPrepService::ctor: StandardRawDigitPrepService:
StandardRawDigitPrepService::ctor:              LogLevel: 1
StandardRawDigitPrepService::ctor:               SkipBad: 1
StandardRawDigitPrepService::ctor:             SkipNoisy: 0
StandardRawDigitPrepService::ctor:   ChannelStatusOnline: 0
StandardRawDigitPrepService::ctor:          DoMitigation: 0
StandardRawDigitPrepService::ctor:  DoEarlySignalFinding: 0
StandardRawDigitPrepService::ctor:        DoNoiseRemoval: 0
StandardRawDigitPrepService::ctor:       DoDeconvolution: 1
StandardRawDigitPrepService::ctor:  DoPedestalAdjustment: 0
StandardRawDigitPrepService::ctor:                 DoROI: 1
StandardRawDigitPrepService::ctor:               DoWires: 1
StandardRawDigitPrepService::ctor:                DoDump: 0
StandardRawDigitPrepService::ctor:  DoIntermediateStates: 0
StandardRawDigitPrepService::ctor: No display tools.
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
14-Nov-2025 21:45:11 UTC  Initiating request to open input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/86/fc/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182931Z_gen_004160_supernova_g4_detsim.root"
14-Nov-2025 21:45:12 UTC  Opened input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/86/fc/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182931Z_gen_004160_supernova_g4_detsim.root"
Begin processing the 1st record. run: 8106 subRun: 0 event: 207951 at 14-Nov-2025 21:45:12 UTC
Begin processing the 2nd record. run: 8106 subRun: 0 event: 207952 at 14-Nov-2025 21:45:12 UTC
Begin processing the 3rd record. run: 8106 subRun: 0 event: 207953 at 14-Nov-2025 21:45:12 UTC
Begin processing the 4th record. run: 8106 subRun: 0 event: 207954 at 14-Nov-2025 21:45:12 UTC
Begin processing the 5th record. run: 8106 subRun: 0 event: 207955 at 14-Nov-2025 21:45:12 UTC
Begin processing the 6th record. run: 8106 subRun: 0 event: 207956 at 14-Nov-2025 21:45:12 UTC
Begin processing the 7th record. run: 8106 subRun: 0 event: 207957 at 14-Nov-2025 21:45:12 UTC
Begin processing the 8th record. run: 8106 subRun: 0 event: 207958 at 14-Nov-2025 21:45:12 UTC
Begin processing the 9th record. run: 8106 subRun: 0 event: 207959 at 14-Nov-2025 21:45:12 UTC
Begin processing the 10th record. run: 8106 subRun: 0 event: 207960 at 14-Nov-2025 21:45:12 UTC
14-Nov-2025 21:45:12 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/86/fc/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182931Z_gen_004160_supernova_g4_detsim.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                            0.000961304   0.00507207     0.0146758    0.00490544    0.00370185       10     
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                5.7459e-05     0.0009314     0.0087342    6.13375e-05   0.00260095       10     
end_path:triggerAna:TriggerAnaTree    0.000846426   0.00405441    0.00682918    0.00478459    0.00192629       10     
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1309.84 MB
  Peak resident set size usage (VmHWM): 615.67 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.

Processing output file prodmarley_nue_flat_es_dune10kt_1x2x2.fcl_trg_mc_2025a_detsim_dune10kt_1x2x2_notpcsigproc.fcl_detsim_v10_06_00d01_triggerana_dune10kt_1x2x2.fcl_v10_12_01d01_s0_l10000_triggerana_0_ntuple_triggerana_0_20251114T202412_c55.root
merged pass1_US_FNAL-FermiGrid_000056.json