justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 250840.45@dunegpschedd01.fnal.gov

Jobsub ID250840.45@dunegpschedd01.fnal.gov
Workflow ID10202
Stage ID1
User nameschellma@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-14 21:28:03
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-11-14 21:58:22
From worker nodeHostnamedunegli-7757042-0-fnpc22034.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-14 21:43:32
Input filesmonte-carlo-010202-000047
JobscriptExit code0
Real time0m (12s)
CPU time0m (9s = 74%)
Max RSS bytes616554496 (587 MiB)
Outputting started2025-11-14 21:43:45
Output filesusertests:prodmarley_nue_flat_es_dune10kt_1x2x2.fcl_trg_mc_2025a_detsim_dune10kt_1x2x2_notpcsigproc.fcl_detsim_v10_06_00d01_triggerana_dune10kt_1x2x2.fcl_v10_12_01d01_s0_l10000_triggerana_0_ntuple_triggerana_0_20251114T202412_c46.root
Finished2025-11-14 21:58:22
Saved logsjustin-logs:250840.45-dunegpschedd01.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

/fnal.gov/usr/dune/persistent/staging/fardet-hd/52/b3/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T064528Z_gen_000449_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/00/20/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T064537Z_gen_000450_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/8c/8f/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T064545Z_gen_000451_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/0f/f5/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T064551Z_gen_000452_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/51/14/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T064556Z_gen_000453_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/6c/da/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T064604Z_gen_000454_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/b0/2a/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T064605Z_gen_000455_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/71/24/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T064609Z_gen_000456_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/cd/07/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T064609Z_gen_000457_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/8b/13/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T064617Z_gen_000458_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/5d/99/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T064628Z_gen_000459_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/d9/c3/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T064629Z_gen_000460_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/31/f3/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T064636Z_gen_000461_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/2d/17/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T064650Z_gen_000462_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/7e/48/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T064703Z_gen_000463_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/26/d4/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T064707Z_gen_000464_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/33/cd/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T064722Z_gen_000465_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/31/e1/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T064722Z_gen_000466_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/37/50/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T064727Z_gen_000467_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/44/75/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T064734Z_gen_000468_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/b9/98/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T064735Z_gen_000469_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/21/12/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T064735Z_gen_000470_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/bc/22/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T064735Z_gen_000471_supernova_g4_detsim.root root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/84/de/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T064739Z_gen_000472_supernova_g4_detsim.root
AcdDigitReader::ctor:     LogLevel: 1
DuneToolManager::getPrivate: ERROR: Tool name is blank
StandardRawDigitExtractService::ctor: Retrieved digit read tool digitReader
StandardRawDigitExtractService::ctor: StandardRawDigitExtractService:
StandardRawDigitExtractService::ctor:         LogLevel: 1
StandardRawDigitExtractService::ctor:    DigitReadTool: digitReader
StandardRawDigitExtractService::ctor:   PedestalOption: 1
StandardRawDigitExtractService::ctor:     FlagStuckOff: 0
StandardRawDigitExtractService::ctor:      FlagStuckOn: 0
StandardRawDigitPrepService::ctor: Fetching extract service.
StandardRawDigitPrepService::ctor: Fetching channel status provider.
StandardRawDigitPrepService::ctor:   Channel status provider: @0x7f5f340
StandardRawDigitPrepService::ctor:   Extract service: @0x7fdf1a0
StandardRawDigitPrepService::ctor: Fetching deconvolution service.
StandardRawDigitPrepService::ctor:   Deconvolution service: @0x21f1b80
StandardRawDigitPrepService::ctor: Fetching ROI building service.
StandardRawDigitPrepService::ctor:   ROI building service: @0x21eb150
StandardRawDigitPrepService::ctor: Fetching wire building service.
StandardRawDigitPrepService::ctor:   Wire building service: @0x21ea440
StandardRawDigitPrepService::ctor: StandardRawDigitPrepService:
StandardRawDigitPrepService::ctor:              LogLevel: 1
StandardRawDigitPrepService::ctor:               SkipBad: 1
StandardRawDigitPrepService::ctor:             SkipNoisy: 0
StandardRawDigitPrepService::ctor:   ChannelStatusOnline: 0
StandardRawDigitPrepService::ctor:          DoMitigation: 0
StandardRawDigitPrepService::ctor:  DoEarlySignalFinding: 0
StandardRawDigitPrepService::ctor:        DoNoiseRemoval: 0
StandardRawDigitPrepService::ctor:       DoDeconvolution: 1
StandardRawDigitPrepService::ctor:  DoPedestalAdjustment: 0
StandardRawDigitPrepService::ctor:                 DoROI: 1
StandardRawDigitPrepService::ctor:               DoWires: 1
StandardRawDigitPrepService::ctor:                DoDump: 0
StandardRawDigitPrepService::ctor:  DoIntermediateStates: 0
StandardRawDigitPrepService::ctor: No display tools.
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
14-Nov-2025 21:43:42 UTC  Initiating request to open input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/cf/30/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T063941Z_gen_000373_supernova_g4_detsim.root"
14-Nov-2025 21:43:43 UTC  Opened input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/cf/30/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T063941Z_gen_000373_supernova_g4_detsim.root"
Begin processing the 1st record. run: 8145 subRun: 0 event: 18601 at 14-Nov-2025 21:43:43 UTC
Begin processing the 2nd record. run: 8145 subRun: 0 event: 18602 at 14-Nov-2025 21:43:43 UTC
Begin processing the 3rd record. run: 8145 subRun: 0 event: 18603 at 14-Nov-2025 21:43:43 UTC
Begin processing the 4th record. run: 8145 subRun: 0 event: 18604 at 14-Nov-2025 21:43:43 UTC
Begin processing the 5th record. run: 8145 subRun: 0 event: 18605 at 14-Nov-2025 21:43:43 UTC
Begin processing the 6th record. run: 8145 subRun: 0 event: 18606 at 14-Nov-2025 21:43:43 UTC
Begin processing the 7th record. run: 8145 subRun: 0 event: 18607 at 14-Nov-2025 21:43:43 UTC
Begin processing the 8th record. run: 8145 subRun: 0 event: 18608 at 14-Nov-2025 21:43:44 UTC
Begin processing the 9th record. run: 8145 subRun: 0 event: 18609 at 14-Nov-2025 21:43:44 UTC
Begin processing the 10th record. run: 8145 subRun: 0 event: 18610 at 14-Nov-2025 21:43:44 UTC
14-Nov-2025 21:43:44 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/cf/30/prodmarley_nue_flat_es_dune10kt_1x2x2_20250927T063941Z_gen_000373_supernova_g4_detsim.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                            0.000775302   0.00284651     0.0178347    0.00112181    0.00500959       10     
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                6.0676e-05    0.00143989     0.0137361    7.0154e-05    0.00409877       10     
end_path:triggerAna:TriggerAnaTree    0.000649312   0.00131064    0.00370464    0.000970355   0.000880139      10     
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1309.92 MB
  Peak resident set size usage (VmHWM): 616.554 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.

Processing output file prodmarley_nue_flat_es_dune10kt_1x2x2.fcl_trg_mc_2025a_detsim_dune10kt_1x2x2_notpcsigproc.fcl_detsim_v10_06_00d01_triggerana_dune10kt_1x2x2.fcl_v10_12_01d01_s0_l10000_triggerana_0_ntuple_triggerana_0_20251114T202412_c46.root
merged pass1_US_FNAL-FermiGrid_000047.json
justIN time: 2026-02-09 13:55:01 UTC       justIN version: 01.06.00