justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 250939.15@dunegpschedd02.fnal.gov

Jobsub ID250939.15@dunegpschedd02.fnal.gov
Workflow ID10636
Stage ID1
User nameschellma@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-24 22:25:37
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce509
Last heartbeat2025-11-24 22:56:18
From worker nodeHostnameb9p12p6137.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-24 22:36:16
Input filesmonte-carlo-010636-000014
JobscriptExit code0
Real time18m (1128s)
CPU time5m (337s = 29%)
Max RSS bytes1199017984 (1143 MiB)
Outputting started2025-11-24 22:55:05
Output filesfardet-hd:prodgenie_nu_dune10kt_1x2x6__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__ntuple__NU_prod_s004000_l002000_20251124T215601_c13.root
Finished2025-11-24 22:56:17
Saved logsjustin-logs:250939.15-dunegpschedd02.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

:38 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/b4/07/prodgenie_nu_dune10kt_1x2x6_20251003T210539Z_gen_006892_g4_detsim_20251116T113543Z_reco.root"
24-Nov-2025 23:54:38 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/15/5c/prodgenie_nu_dune10kt_1x2x6_20251003T210621Z_gen_006924_g4_detsim_20251116T142754Z_reco.root"
24-Nov-2025 23:54:38 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/15/5c/prodgenie_nu_dune10kt_1x2x6_20251003T210621Z_gen_006924_g4_detsim_20251116T142754Z_reco.root"
Begin processing the 951st record. run: 8525 subRun: 0 event: 69231 at 24-Nov-2025 23:54:39 CET
Begin processing the 952nd record. run: 8525 subRun: 0 event: 69232 at 24-Nov-2025 23:54:39 CET
Begin processing the 953rd record. run: 8525 subRun: 0 event: 69233 at 24-Nov-2025 23:54:39 CET
Begin processing the 954th record. run: 8525 subRun: 0 event: 69234 at 24-Nov-2025 23:54:40 CET
Begin processing the 955th record. run: 8525 subRun: 0 event: 69235 at 24-Nov-2025 23:54:40 CET
Begin processing the 956th record. run: 8525 subRun: 0 event: 69236 at 24-Nov-2025 23:54:40 CET
Begin processing the 957th record. run: 8525 subRun: 0 event: 69237 at 24-Nov-2025 23:54:41 CET
Begin processing the 958th record. run: 8525 subRun: 0 event: 69238 at 24-Nov-2025 23:54:42 CET
Begin processing the 959th record. run: 8525 subRun: 0 event: 69239 at 24-Nov-2025 23:54:42 CET
Begin processing the 960th record. run: 8525 subRun: 0 event: 69240 at 24-Nov-2025 23:54:43 CET
24-Nov-2025 23:54:44 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/15/5c/prodgenie_nu_dune10kt_1x2x6_20251003T210621Z_gen_006924_g4_detsim_20251116T142754Z_reco.root"
24-Nov-2025 23:54:44 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/1a/9e/prodgenie_nu_dune10kt_1x2x6_20251003T210630Z_gen_006928_g4_detsim_20251116T112536Z_reco.root"
24-Nov-2025 23:54:44 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/1a/9e/prodgenie_nu_dune10kt_1x2x6_20251003T210630Z_gen_006928_g4_detsim_20251116T112536Z_reco.root"
Begin processing the 961st record. run: 8525 subRun: 0 event: 69271 at 24-Nov-2025 23:54:44 CET
Begin processing the 962nd record. run: 8525 subRun: 0 event: 69272 at 24-Nov-2025 23:54:44 CET
Begin processing the 963rd record. run: 8525 subRun: 0 event: 69273 at 24-Nov-2025 23:54:45 CET
Begin processing the 964th record. run: 8525 subRun: 0 event: 69274 at 24-Nov-2025 23:54:45 CET
Begin processing the 965th record. run: 8525 subRun: 0 event: 69275 at 24-Nov-2025 23:54:45 CET
Begin processing the 966th record. run: 8525 subRun: 0 event: 69276 at 24-Nov-2025 23:54:46 CET
Begin processing the 967th record. run: 8525 subRun: 0 event: 69277 at 24-Nov-2025 23:54:46 CET
Begin processing the 968th record. run: 8525 subRun: 0 event: 69278 at 24-Nov-2025 23:54:46 CET
Begin processing the 969th record. run: 8525 subRun: 0 event: 69279 at 24-Nov-2025 23:54:46 CET
Begin processing the 970th record. run: 8525 subRun: 0 event: 69280 at 24-Nov-2025 23:54:46 CET
24-Nov-2025 23:54:47 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/1a/9e/prodgenie_nu_dune10kt_1x2x6_20251003T210630Z_gen_006928_g4_detsim_20251116T112536Z_reco.root"
24-Nov-2025 23:54:47 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/ce/80/prodgenie_nu_dune10kt_1x2x6_20251003T210633Z_gen_006933_g4_detsim_20251106T161801Z_reco.root"
24-Nov-2025 23:54:47 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/ce/80/prodgenie_nu_dune10kt_1x2x6_20251003T210633Z_gen_006933_g4_detsim_20251106T161801Z_reco.root"
Begin processing the 971st record. run: 8525 subRun: 0 event: 69321 at 24-Nov-2025 23:54:47 CET
Begin processing the 972nd record. run: 8525 subRun: 0 event: 69322 at 24-Nov-2025 23:54:48 CET
Begin processing the 973rd record. run: 8525 subRun: 0 event: 69323 at 24-Nov-2025 23:54:48 CET
Begin processing the 974th record. run: 8525 subRun: 0 event: 69324 at 24-Nov-2025 23:54:48 CET
Begin processing the 975th record. run: 8525 subRun: 0 event: 69325 at 24-Nov-2025 23:54:49 CET
Begin processing the 976th record. run: 8525 subRun: 0 event: 69326 at 24-Nov-2025 23:54:50 CET
Begin processing the 977th record. run: 8525 subRun: 0 event: 69327 at 24-Nov-2025 23:54:50 CET
Begin processing the 978th record. run: 8525 subRun: 0 event: 69328 at 24-Nov-2025 23:54:50 CET
Begin processing the 979th record. run: 8525 subRun: 0 event: 69329 at 24-Nov-2025 23:54:51 CET
Begin processing the 980th record. run: 8525 subRun: 0 event: 69330 at 24-Nov-2025 23:54:51 CET
24-Nov-2025 23:54:51 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/ce/80/prodgenie_nu_dune10kt_1x2x6_20251003T210633Z_gen_006933_g4_detsim_20251106T161801Z_reco.root"
24-Nov-2025 23:54:51 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/e8/4a/prodgenie_nu_dune10kt_1x2x6_20251003T210635Z_gen_006934_g4_detsim_20251116T113627Z_reco.root"
24-Nov-2025 23:54:51 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/e8/4a/prodgenie_nu_dune10kt_1x2x6_20251003T210635Z_gen_006934_g4_detsim_20251116T113627Z_reco.root"
Begin processing the 981st record. run: 8525 subRun: 0 event: 69331 at 24-Nov-2025 23:54:51 CET
Begin processing the 982nd record. run: 8525 subRun: 0 event: 69332 at 24-Nov-2025 23:54:52 CET
Begin processing the 983rd record. run: 8525 subRun: 0 event: 69333 at 24-Nov-2025 23:54:52 CET
Begin processing the 984th record. run: 8525 subRun: 0 event: 69334 at 24-Nov-2025 23:54:52 CET
Begin processing the 985th record. run: 8525 subRun: 0 event: 69335 at 24-Nov-2025 23:54:53 CET
Begin processing the 986th record. run: 8525 subRun: 0 event: 69336 at 24-Nov-2025 23:54:53 CET
Begin processing the 987th record. run: 8525 subRun: 0 event: 69337 at 24-Nov-2025 23:54:54 CET
Begin processing the 988th record. run: 8525 subRun: 0 event: 69338 at 24-Nov-2025 23:54:54 CET
Begin processing the 989th record. run: 8525 subRun: 0 event: 69339 at 24-Nov-2025 23:54:55 CET
Begin processing the 990th record. run: 8525 subRun: 0 event: 69340 at 24-Nov-2025 23:54:55 CET
24-Nov-2025 23:54:55 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/e8/4a/prodgenie_nu_dune10kt_1x2x6_20251003T210635Z_gen_006934_g4_detsim_20251116T113627Z_reco.root"
24-Nov-2025 23:54:55 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/8d/64/prodgenie_nu_dune10kt_1x2x6_20251003T210638Z_gen_006937_g4_detsim_20251116T104605Z_reco.root"
24-Nov-2025 23:54:55 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/8d/64/prodgenie_nu_dune10kt_1x2x6_20251003T210638Z_gen_006937_g4_detsim_20251116T104605Z_reco.root"
Begin processing the 991st record. run: 8525 subRun: 0 event: 69361 at 24-Nov-2025 23:54:56 CET
Begin processing the 992nd record. run: 8525 subRun: 0 event: 69362 at 24-Nov-2025 23:54:56 CET
Begin processing the 993rd record. run: 8525 subRun: 0 event: 69363 at 24-Nov-2025 23:54:57 CET
Begin processing the 994th record. run: 8525 subRun: 0 event: 69364 at 24-Nov-2025 23:54:58 CET
Begin processing the 995th record. run: 8525 subRun: 0 event: 69365 at 24-Nov-2025 23:54:58 CET
Begin processing the 996th record. run: 8525 subRun: 0 event: 69366 at 24-Nov-2025 23:54:59 CET
Begin processing the 997th record. run: 8525 subRun: 0 event: 69367 at 24-Nov-2025 23:54:59 CET
Begin processing the 998th record. run: 8525 subRun: 0 event: 69368 at 24-Nov-2025 23:54:59 CET
Begin processing the 999th record. run: 8525 subRun: 0 event: 69369 at 24-Nov-2025 23:55:00 CET
Begin processing the 1000th record. run: 8525 subRun: 0 event: 69370 at 24-Nov-2025 23:55:00 CET
24-Nov-2025 23:55:01 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/8d/64/prodgenie_nu_dune10kt_1x2x6_20251003T210638Z_gen_006937_g4_detsim_20251116T104605Z_reco.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                             0.0474324     0.249734       2.37655      0.136126      0.326533       1000    
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                0.00310306    0.00613514     0.0500953    0.00437575    0.00538404      1000    
end_path:triggerAna:TriggerAnaTree     0.0433714     0.243079       2.3474       0.130598      0.326109       1000    
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1965.49 MB
  Peak resident set size usage (VmHWM): 1199.02 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.

Processing output file prodgenie_nu_dune10kt_1x2x6__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__ntuple__NU_prod_s004000_l002000_20251124T215601_c13.root
merged pass1_CERN_000014.json
justIN time: 2026-02-08 15:35:25 UTC       justIN version: 01.06.00