justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 250840.43@dunegpschedd01.fnal.gov

Jobsub ID250840.43@dunegpschedd01.fnal.gov
Workflow ID10202
Stage ID1
User nameschellma@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-14 21:28:03
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-11-14 21:51:51
From worker nodeHostnamedunegli-7757042-0-fnpc22034.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-14 21:42:42
Input filesmonte-carlo-010202-000043
JobscriptExit code0
Real time0m (20s)
CPU time0m (10s = 49%)
Max RSS bytes611962880 (583 MiB)
Outputting started2025-11-14 21:43:03
Output filesusertests:prodmarley_nue_flat_es_dune10kt_1x2x2.fcl_trg_mc_2025a_detsim_dune10kt_1x2x2_notpcsigproc.fcl_detsim_v10_06_00d01_triggerana_dune10kt_1x2x2.fcl_v10_12_01d01_s0_l10000_triggerana_0_ntuple_triggerana_0_20251114T202412_c42.root
Finished2025-11-14 21:51:51
Saved logsjustin-logs:250840.43-dunegpschedd01.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

/usr/dune/persistent/staging/fardet-hd/78/0b/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061047Z_gen_000049_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/05/8a/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061113Z_gen_000050_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/f6/84/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061115Z_gen_000051_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/36/b6/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061120Z_gen_000052_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/79/87/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061145Z_gen_000053_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/a4/67/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061157Z_gen_000054_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/2e/81/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061207Z_gen_000055_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/d0/7f/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061209Z_gen_000056_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/85/f8/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061217Z_gen_000057_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/14/ea/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061230Z_gen_000058_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/01/8d/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061259Z_gen_000059_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/93/f3/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061315Z_gen_000060_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/d7/5c/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061330Z_gen_000061_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/8b/37/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061334Z_gen_000062_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/2d/cb/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061339Z_gen_000063_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/ca/ef/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061344Z_gen_000064_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/74/76/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061347Z_gen_000065_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/ff/35/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061357Z_gen_000066_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/53/e3/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061407Z_gen_000067_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/36/41/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061427Z_gen_000068_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/09/23/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061502Z_gen_000069_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/3e/a4/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061506Z_gen_000070_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/ba/c1/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061509Z_gen_000071_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/a1/88/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T061550Z_gen_000072_supernova_g4_detsim.root
AcdDigitReader::ctor:     LogLevel: 1
DuneToolManager::getPrivate: ERROR: Tool name is blank
StandardRawDigitExtractService::ctor: Retrieved digit read tool digitReader
StandardRawDigitExtractService::ctor: StandardRawDigitExtractService:
StandardRawDigitExtractService::ctor:         LogLevel: 1
StandardRawDigitExtractService::ctor:    DigitReadTool: digitReader
StandardRawDigitExtractService::ctor:   PedestalOption: 1
StandardRawDigitExtractService::ctor:     FlagStuckOff: 0
StandardRawDigitExtractService::ctor:      FlagStuckOn: 0
StandardRawDigitPrepService::ctor: Fetching extract service.
StandardRawDigitPrepService::ctor: Fetching channel status provider.
StandardRawDigitPrepService::ctor:   Channel status provider: @0x7748120
StandardRawDigitPrepService::ctor:   Extract service: @0x8309710
StandardRawDigitPrepService::ctor: Fetching deconvolution service.
StandardRawDigitPrepService::ctor:   Deconvolution service: @0x19d7b80
StandardRawDigitPrepService::ctor: Fetching ROI building service.
StandardRawDigitPrepService::ctor:   ROI building service: @0x19d1150
StandardRawDigitPrepService::ctor: Fetching wire building service.
StandardRawDigitPrepService::ctor:   Wire building service: @0x19d0440
StandardRawDigitPrepService::ctor: StandardRawDigitPrepService:
StandardRawDigitPrepService::ctor:              LogLevel: 1
StandardRawDigitPrepService::ctor:               SkipBad: 1
StandardRawDigitPrepService::ctor:             SkipNoisy: 0
StandardRawDigitPrepService::ctor:   ChannelStatusOnline: 0
StandardRawDigitPrepService::ctor:          DoMitigation: 0
StandardRawDigitPrepService::ctor:  DoEarlySignalFinding: 0
StandardRawDigitPrepService::ctor:        DoNoiseRemoval: 0
StandardRawDigitPrepService::ctor:       DoDeconvolution: 1
StandardRawDigitPrepService::ctor:  DoPedestalAdjustment: 0
StandardRawDigitPrepService::ctor:                 DoROI: 1
StandardRawDigitPrepService::ctor:               DoWires: 1
StandardRawDigitPrepService::ctor:                DoDump: 0
StandardRawDigitPrepService::ctor:  DoIntermediateStates: 0
StandardRawDigitPrepService::ctor: No display tools.
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
14-Nov-2025 21:43:02 UTC  Initiating request to open input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/5d/ba/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T221721Z_gen_002999_supernova_g4_detsim.root"
14-Nov-2025 21:43:02 UTC  Opened input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/5d/ba/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T221721Z_gen_002999_supernova_g4_detsim.root"
Begin processing the 1st record. run: 8106 subRun: 0 event: 149901 at 14-Nov-2025 21:43:02 UTC
Begin processing the 2nd record. run: 8106 subRun: 0 event: 149902 at 14-Nov-2025 21:43:02 UTC
Begin processing the 3rd record. run: 8106 subRun: 0 event: 149903 at 14-Nov-2025 21:43:02 UTC
Begin processing the 4th record. run: 8106 subRun: 0 event: 149904 at 14-Nov-2025 21:43:02 UTC
Begin processing the 5th record. run: 8106 subRun: 0 event: 149905 at 14-Nov-2025 21:43:02 UTC
Begin processing the 6th record. run: 8106 subRun: 0 event: 149906 at 14-Nov-2025 21:43:02 UTC
Begin processing the 7th record. run: 8106 subRun: 0 event: 149907 at 14-Nov-2025 21:43:02 UTC
Begin processing the 8th record. run: 8106 subRun: 0 event: 149908 at 14-Nov-2025 21:43:02 UTC
Begin processing the 9th record. run: 8106 subRun: 0 event: 149909 at 14-Nov-2025 21:43:03 UTC
Begin processing the 10th record. run: 8106 subRun: 0 event: 149910 at 14-Nov-2025 21:43:03 UTC
14-Nov-2025 21:43:03 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/5d/ba/prodmarley_nue_flat_es_dune10kt_1x2x2_20250926T221721Z_gen_002999_supernova_g4_detsim.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                            0.000775943   0.00248756     0.0143081    0.00109459    0.00395876       10     
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                5.7119e-05    0.00120192     0.0114597    6.1062e-05    0.00341925       10     
end_path:triggerAna:TriggerAnaTree    0.000658389   0.00120467    0.00257694    0.000970802   0.000598098      10     
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1309.9 MB
  Peak resident set size usage (VmHWM): 611.963 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.

Processing output file prodmarley_nue_flat_es_dune10kt_1x2x2.fcl_trg_mc_2025a_detsim_dune10kt_1x2x2_notpcsigproc.fcl_detsim_v10_06_00d01_triggerana_dune10kt_1x2x2.fcl_v10_12_01d01_s0_l10000_triggerana_0_ntuple_triggerana_0_20251114T202412_c42.root
merged pass1_US_FNAL-FermiGrid_000043.json
justIN time: 2026-02-09 13:55:01 UTC       justIN version: 01.06.00