justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 248639.5@dunegpschedd02.fnal.gov

Jobsub ID248639.5@dunegpschedd02.fnal.gov
Workflow ID10386
Stage ID1
User nameschellma@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-19 22:36:11
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce513
Last heartbeat2025-11-19 23:02:14
From worker nodeHostnameb9p25p1954.cern.ch
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job stateaborted
Started2025-11-19 22:36:57
Input filesmonte-carlo-010386-000013
Outputting started2025-11-19 22:40:47
Output files
Finished2025-11-19 23:02:14
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0kt_1x2x6_20251002T235233Z_gen_003705_g4_detsim_20251115T185856Z_reco.root"
19-Nov-2025 23:40:32 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/04/32/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T235340Z_gen_003710_g4_detsim_20251115T192038Z_reco.root"
19-Nov-2025 23:40:32 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/04/32/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T235340Z_gen_003710_g4_detsim_20251115T192038Z_reco.root"
Begin processing the 951st record. run: 8428 subRun: 0 event: 37091 at 19-Nov-2025 23:40:33 CET
Begin processing the 952nd record. run: 8428 subRun: 0 event: 37092 at 19-Nov-2025 23:40:33 CET
Begin processing the 953rd record. run: 8428 subRun: 0 event: 37093 at 19-Nov-2025 23:40:33 CET
Begin processing the 954th record. run: 8428 subRun: 0 event: 37094 at 19-Nov-2025 23:40:33 CET
Begin processing the 955th record. run: 8428 subRun: 0 event: 37095 at 19-Nov-2025 23:40:33 CET
Begin processing the 956th record. run: 8428 subRun: 0 event: 37096 at 19-Nov-2025 23:40:33 CET
Begin processing the 957th record. run: 8428 subRun: 0 event: 37097 at 19-Nov-2025 23:40:34 CET
Begin processing the 958th record. run: 8428 subRun: 0 event: 37098 at 19-Nov-2025 23:40:34 CET
Begin processing the 959th record. run: 8428 subRun: 0 event: 37099 at 19-Nov-2025 23:40:34 CET
Begin processing the 960th record. run: 8428 subRun: 0 event: 37100 at 19-Nov-2025 23:40:34 CET
19-Nov-2025 23:40:34 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/04/32/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T235340Z_gen_003710_g4_detsim_20251115T192038Z_reco.root"
19-Nov-2025 23:40:34 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/c5/b9/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T235358Z_gen_003712_g4_detsim_20251115T192414Z_reco.root"
19-Nov-2025 23:40:34 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/c5/b9/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T235358Z_gen_003712_g4_detsim_20251115T192414Z_reco.root"
Begin processing the 961st record. run: 8428 subRun: 0 event: 37111 at 19-Nov-2025 23:40:35 CET
Begin processing the 962nd record. run: 8428 subRun: 0 event: 37112 at 19-Nov-2025 23:40:35 CET
Begin processing the 963rd record. run: 8428 subRun: 0 event: 37113 at 19-Nov-2025 23:40:35 CET
Begin processing the 964th record. run: 8428 subRun: 0 event: 37114 at 19-Nov-2025 23:40:35 CET
Begin processing the 965th record. run: 8428 subRun: 0 event: 37115 at 19-Nov-2025 23:40:35 CET
Begin processing the 966th record. run: 8428 subRun: 0 event: 37116 at 19-Nov-2025 23:40:35 CET
Begin processing the 967th record. run: 8428 subRun: 0 event: 37117 at 19-Nov-2025 23:40:36 CET
Begin processing the 968th record. run: 8428 subRun: 0 event: 37118 at 19-Nov-2025 23:40:36 CET
Begin processing the 969th record. run: 8428 subRun: 0 event: 37119 at 19-Nov-2025 23:40:36 CET
Begin processing the 970th record. run: 8428 subRun: 0 event: 37120 at 19-Nov-2025 23:40:36 CET
19-Nov-2025 23:40:36 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/c5/b9/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T235358Z_gen_003712_g4_detsim_20251115T192414Z_reco.root"
19-Nov-2025 23:40:36 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/be/8d/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T235404Z_gen_003713_g4_detsim_20251115T193513Z_reco.root"
19-Nov-2025 23:40:36 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/be/8d/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T235404Z_gen_003713_g4_detsim_20251115T193513Z_reco.root"
Begin processing the 971st record. run: 8428 subRun: 0 event: 37121 at 19-Nov-2025 23:40:37 CET
Begin processing the 972nd record. run: 8428 subRun: 0 event: 37122 at 19-Nov-2025 23:40:37 CET
Begin processing the 973rd record. run: 8428 subRun: 0 event: 37123 at 19-Nov-2025 23:40:37 CET
Begin processing the 974th record. run: 8428 subRun: 0 event: 37124 at 19-Nov-2025 23:40:37 CET
Begin processing the 975th record. run: 8428 subRun: 0 event: 37125 at 19-Nov-2025 23:40:37 CET
Begin processing the 976th record. run: 8428 subRun: 0 event: 37126 at 19-Nov-2025 23:40:37 CET
Begin processing the 977th record. run: 8428 subRun: 0 event: 37127 at 19-Nov-2025 23:40:38 CET
Begin processing the 978th record. run: 8428 subRun: 0 event: 37128 at 19-Nov-2025 23:40:38 CET
Begin processing the 979th record. run: 8428 subRun: 0 event: 37129 at 19-Nov-2025 23:40:38 CET
Begin processing the 980th record. run: 8428 subRun: 0 event: 37130 at 19-Nov-2025 23:40:38 CET
19-Nov-2025 23:40:38 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/be/8d/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T235404Z_gen_003713_g4_detsim_20251115T193513Z_reco.root"
19-Nov-2025 23:40:38 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/d4/7e/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T235417Z_gen_003718_g4_detsim_20251115T191414Z_reco.root"
19-Nov-2025 23:40:38 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/d4/7e/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T235417Z_gen_003718_g4_detsim_20251115T191414Z_reco.root"
Begin processing the 981st record. run: 8428 subRun: 0 event: 37171 at 19-Nov-2025 23:40:38 CET
Begin processing the 982nd record. run: 8428 subRun: 0 event: 37172 at 19-Nov-2025 23:40:39 CET
Begin processing the 983rd record. run: 8428 subRun: 0 event: 37173 at 19-Nov-2025 23:40:39 CET
Begin processing the 984th record. run: 8428 subRun: 0 event: 37174 at 19-Nov-2025 23:40:39 CET
Begin processing the 985th record. run: 8428 subRun: 0 event: 37175 at 19-Nov-2025 23:40:39 CET
Begin processing the 986th record. run: 8428 subRun: 0 event: 37176 at 19-Nov-2025 23:40:39 CET
Begin processing the 987th record. run: 8428 subRun: 0 event: 37177 at 19-Nov-2025 23:40:40 CET
Begin processing the 988th record. run: 8428 subRun: 0 event: 37178 at 19-Nov-2025 23:40:40 CET
Begin processing the 989th record. run: 8428 subRun: 0 event: 37179 at 19-Nov-2025 23:40:40 CET
Begin processing the 990th record. run: 8428 subRun: 0 event: 37180 at 19-Nov-2025 23:40:40 CET
19-Nov-2025 23:40:41 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/d4/7e/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T235417Z_gen_003718_g4_detsim_20251115T191414Z_reco.root"
19-Nov-2025 23:40:41 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/72/15/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T235429Z_gen_003721_g4_detsim_20251115T185651Z_reco.root"
19-Nov-2025 23:40:41 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/72/15/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T235429Z_gen_003721_g4_detsim_20251115T185651Z_reco.root"
Begin processing the 991st record. run: 8428 subRun: 0 event: 37201 at 19-Nov-2025 23:40:41 CET
Begin processing the 992nd record. run: 8428 subRun: 0 event: 37202 at 19-Nov-2025 23:40:41 CET
Begin processing the 993rd record. run: 8428 subRun: 0 event: 37203 at 19-Nov-2025 23:40:42 CET
Begin processing the 994th record. run: 8428 subRun: 0 event: 37204 at 19-Nov-2025 23:40:42 CET
Begin processing the 995th record. run: 8428 subRun: 0 event: 37205 at 19-Nov-2025 23:40:42 CET
Begin processing the 996th record. run: 8428 subRun: 0 event: 37206 at 19-Nov-2025 23:40:42 CET
Begin processing the 997th record. run: 8428 subRun: 0 event: 37207 at 19-Nov-2025 23:40:42 CET
Begin processing the 998th record. run: 8428 subRun: 0 event: 37208 at 19-Nov-2025 23:40:43 CET
Begin processing the 999th record. run: 8428 subRun: 0 event: 37209 at 19-Nov-2025 23:40:43 CET
Begin processing the 1000th record. run: 8428 subRun: 0 event: 37210 at 19-Nov-2025 23:40:43 CET
19-Nov-2025 23:40:43 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/72/15/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T235429Z_gen_003721_g4_detsim_20251115T185651Z_reco.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                             0.048106      0.0918132     0.887222      0.0791327     0.0870711      1000    
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                 0.0028715     0.0050385     0.0338814    0.00409624    0.00317629      1000    
end_path:triggerAna:TriggerAnaTree     0.0439799     0.0864325     0.883332      0.0736766     0.0868682      1000    
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1746.55 MB
  Peak resident set size usage (VmHWM): 983.441 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.

Processing output file prod_eminus_1-500MeV_dune10kt_1x2x6__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__s2000__l2000__ntuple__EMINUS_20251119T212954_c12.root
merged pass1_CERN_000013.json
justIN time: 2026-02-09 06:19:58 UTC       justIN version: 01.06.00