justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 250840.55@dunegpschedd01.fnal.gov

Jobsub ID250840.55@dunegpschedd01.fnal.gov
Workflow ID10202
Stage ID1
User nameschellma@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-14 21:28:03
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-11-14 21:50:03
From worker nodeHostnamedunegli-7757042-0-fnpc22034.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-14 21:44:53
Input filesmonte-carlo-010202-000054
JobscriptExit code0
Real time0m (11s)
CPU time0m (9s = 81%)
Max RSS bytes614608896 (586 MiB)
Outputting started2025-11-14 21:45:05
Output filesusertests:prodmarley_nue_flat_es_dune10kt_1x2x2.fcl_trg_mc_2025a_detsim_dune10kt_1x2x2_notpcsigproc.fcl_detsim_v10_06_00d01_triggerana_dune10kt_1x2x2.fcl_v10_12_01d01_s0_l10000_triggerana_0_ntuple_triggerana_0_20251114T202412_c53.root
Finished2025-11-14 21:50:03
Saved logsjustin-logs:250840.55-dunegpschedd01.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

usr/dune/persistent/staging/fardet-hd/93/a0/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T175931Z_gen_003206_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/fa/6e/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T175931Z_gen_003347_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/bd/2b/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T175931Z_gen_003375_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/ef/1b/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T175931Z_gen_003581_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/0f/2d/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T175931Z_gen_003628_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/50/66/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T175931Z_gen_003773_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/ce/64/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T175931Z_gen_003834_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/8b/89/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T175931Z_gen_003836_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/99/e2/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T175931Z_gen_003838_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/57/c7/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T175931Z_gen_003859_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/98/78/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T175931Z_gen_003871_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/16/98/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T175931Z_gen_003875_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/03/9a/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T175931Z_gen_003913_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/c5/59/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T175931Z_gen_003987_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/fd/49/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T175931Z_gen_004476_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/16/50/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T175931Z_gen_004477_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/d8/98/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T175931Z_gen_004478_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/6e/a9/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182843Z_gen_004012_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/ca/41/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182849Z_gen_004024_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/e0/1f/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182849Z_gen_004028_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/67/bd/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182850Z_gen_003051_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/d1/2f/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182851Z_gen_004031_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/54/a6/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182853Z_gen_004479_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/58/59/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T182855Z_gen_004480_supernova_g4_detsim.root
AcdDigitReader::ctor:     LogLevel: 1
DuneToolManager::getPrivate: ERROR: Tool name is blank
StandardRawDigitExtractService::ctor: Retrieved digit read tool digitReader
StandardRawDigitExtractService::ctor: StandardRawDigitExtractService:
StandardRawDigitExtractService::ctor:         LogLevel: 1
StandardRawDigitExtractService::ctor:    DigitReadTool: digitReader
StandardRawDigitExtractService::ctor:   PedestalOption: 1
StandardRawDigitExtractService::ctor:     FlagStuckOff: 0
StandardRawDigitExtractService::ctor:      FlagStuckOn: 0
StandardRawDigitPrepService::ctor: Fetching extract service.
StandardRawDigitPrepService::ctor: Fetching channel status provider.
StandardRawDigitPrepService::ctor:   Channel status provider: @0x7b8ff70
StandardRawDigitPrepService::ctor:   Extract service: @0x86f37f0
StandardRawDigitPrepService::ctor: Fetching deconvolution service.
StandardRawDigitPrepService::ctor:   Deconvolution service: @0x1e1fb80
StandardRawDigitPrepService::ctor: Fetching ROI building service.
StandardRawDigitPrepService::ctor:   ROI building service: @0x1e19150
StandardRawDigitPrepService::ctor: Fetching wire building service.
StandardRawDigitPrepService::ctor:   Wire building service: @0x1e18440
StandardRawDigitPrepService::ctor: StandardRawDigitPrepService:
StandardRawDigitPrepService::ctor:              LogLevel: 1
StandardRawDigitPrepService::ctor:               SkipBad: 1
StandardRawDigitPrepService::ctor:             SkipNoisy: 0
StandardRawDigitPrepService::ctor:   ChannelStatusOnline: 0
StandardRawDigitPrepService::ctor:          DoMitigation: 0
StandardRawDigitPrepService::ctor:  DoEarlySignalFinding: 0
StandardRawDigitPrepService::ctor:        DoNoiseRemoval: 0
StandardRawDigitPrepService::ctor:       DoDeconvolution: 1
StandardRawDigitPrepService::ctor:  DoPedestalAdjustment: 0
StandardRawDigitPrepService::ctor:                 DoROI: 1
StandardRawDigitPrepService::ctor:               DoWires: 1
StandardRawDigitPrepService::ctor:                DoDump: 0
StandardRawDigitPrepService::ctor:  DoIntermediateStates: 0
StandardRawDigitPrepService::ctor: No display tools.
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
14-Nov-2025 21:45:03 UTC  Initiating request to open input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/a0/70/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T165123Z_gen_004362_supernova_g4_detsim.root"
14-Nov-2025 21:45:04 UTC  Opened input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/a0/70/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T165123Z_gen_004362_supernova_g4_detsim.root"
Begin processing the 1st record. run: 8106 subRun: 0 event: 218051 at 14-Nov-2025 21:45:04 UTC
Begin processing the 2nd record. run: 8106 subRun: 0 event: 218052 at 14-Nov-2025 21:45:04 UTC
Begin processing the 3rd record. run: 8106 subRun: 0 event: 218053 at 14-Nov-2025 21:45:04 UTC
Begin processing the 4th record. run: 8106 subRun: 0 event: 218054 at 14-Nov-2025 21:45:04 UTC
Begin processing the 5th record. run: 8106 subRun: 0 event: 218055 at 14-Nov-2025 21:45:04 UTC
Begin processing the 6th record. run: 8106 subRun: 0 event: 218056 at 14-Nov-2025 21:45:04 UTC
Begin processing the 7th record. run: 8106 subRun: 0 event: 218057 at 14-Nov-2025 21:45:04 UTC
Begin processing the 8th record. run: 8106 subRun: 0 event: 218058 at 14-Nov-2025 21:45:04 UTC
Begin processing the 9th record. run: 8106 subRun: 0 event: 218059 at 14-Nov-2025 21:45:04 UTC
Begin processing the 10th record. run: 8106 subRun: 0 event: 218060 at 14-Nov-2025 21:45:04 UTC
14-Nov-2025 21:45:04 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/a0/70/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T165123Z_gen_004362_supernova_g4_detsim.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                            0.000893758   0.00307414     0.0128677    0.00157235    0.00367923       10     
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                5.9424e-05    0.000992831   0.00932281    6.1823e-05    0.00277668       10     
end_path:triggerAna:TriggerAnaTree    0.000750826   0.00199294    0.00674951    0.00143571    0.00175066       10     
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1309.89 MB
  Peak resident set size usage (VmHWM): 614.609 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.

Processing output file prodmarley_nue_flat_es_dune10kt_1x2x2.fcl_trg_mc_2025a_detsim_dune10kt_1x2x2_notpcsigproc.fcl_detsim_v10_06_00d01_triggerana_dune10kt_1x2x2.fcl_v10_12_01d01_s0_l10000_triggerana_0_ntuple_triggerana_0_20251114T202412_c53.root
merged pass1_US_FNAL-FermiGrid_000054.json
justIN time: 2026-02-09 13:55:01 UTC       justIN version: 01.06.00