justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 250938.2@dunegpschedd02.fnal.gov

Jobsub ID250938.2@dunegpschedd02.fnal.gov
Workflow ID10634
Stage ID1
User nameschellma@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-24 22:25:36
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce509
Last heartbeat2025-11-24 22:54:55
From worker nodeHostnameb9p02p5024.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-24 22:26:47
Input filesmonte-carlo-010634-000005
JobscriptExit code0
Real time27m (1620s)
CPU time5m (349s = 21%)
Max RSS bytes1238970368 (1181 MiB)
Outputting started2025-11-24 22:53:48
Output filesfardet-hd:prodgenie_nu_dune10kt_1x2x6__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__ntuple__NU_prod_l002000_20251124T215527_c4.root
Finished2025-11-24 22:54:55
Saved logsjustin-logs:250938.2-dunegpschedd02.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

025 23:52:50 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/4a/e9/prodgenie_nu_dune10kt_1x2x6_20251003T192932Z_gen_001511_g4_detsim_20251116T112949Z_reco.root"
24-Nov-2025 23:52:50 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/d8/13/prodgenie_nu_dune10kt_1x2x6_20251003T192932Z_gen_001512_g4_detsim_20251116T104325Z_reco.root"
24-Nov-2025 23:53:20 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/d8/13/prodgenie_nu_dune10kt_1x2x6_20251003T192932Z_gen_001512_g4_detsim_20251116T104325Z_reco.root"
Begin processing the 951st record. run: 8525 subRun: 0 event: 15111 at 24-Nov-2025 23:53:20 CET
Begin processing the 952nd record. run: 8525 subRun: 0 event: 15112 at 24-Nov-2025 23:53:21 CET
Begin processing the 953rd record. run: 8525 subRun: 0 event: 15113 at 24-Nov-2025 23:53:21 CET
Begin processing the 954th record. run: 8525 subRun: 0 event: 15114 at 24-Nov-2025 23:53:21 CET
Begin processing the 955th record. run: 8525 subRun: 0 event: 15115 at 24-Nov-2025 23:53:22 CET
Begin processing the 956th record. run: 8525 subRun: 0 event: 15116 at 24-Nov-2025 23:53:22 CET
Begin processing the 957th record. run: 8525 subRun: 0 event: 15117 at 24-Nov-2025 23:53:22 CET
Begin processing the 958th record. run: 8525 subRun: 0 event: 15118 at 24-Nov-2025 23:53:23 CET
Begin processing the 959th record. run: 8525 subRun: 0 event: 15119 at 24-Nov-2025 23:53:24 CET
Begin processing the 960th record. run: 8525 subRun: 0 event: 15120 at 24-Nov-2025 23:53:25 CET
24-Nov-2025 23:53:25 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/d8/13/prodgenie_nu_dune10kt_1x2x6_20251003T192932Z_gen_001512_g4_detsim_20251116T104325Z_reco.root"
24-Nov-2025 23:53:25 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/90/64/prodgenie_nu_dune10kt_1x2x6_20251003T192933Z_gen_001513_g4_detsim_20251116T113733Z_reco.root"
24-Nov-2025 23:53:25 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/90/64/prodgenie_nu_dune10kt_1x2x6_20251003T192933Z_gen_001513_g4_detsim_20251116T113733Z_reco.root"
Begin processing the 961st record. run: 8525 subRun: 0 event: 15121 at 24-Nov-2025 23:53:25 CET
Begin processing the 962nd record. run: 8525 subRun: 0 event: 15122 at 24-Nov-2025 23:53:28 CET
Begin processing the 963rd record. run: 8525 subRun: 0 event: 15123 at 24-Nov-2025 23:53:28 CET
Begin processing the 964th record. run: 8525 subRun: 0 event: 15124 at 24-Nov-2025 23:53:29 CET
Begin processing the 965th record. run: 8525 subRun: 0 event: 15125 at 24-Nov-2025 23:53:29 CET
Begin processing the 966th record. run: 8525 subRun: 0 event: 15126 at 24-Nov-2025 23:53:29 CET
Begin processing the 967th record. run: 8525 subRun: 0 event: 15127 at 24-Nov-2025 23:53:30 CET
Begin processing the 968th record. run: 8525 subRun: 0 event: 15128 at 24-Nov-2025 23:53:30 CET
Begin processing the 969th record. run: 8525 subRun: 0 event: 15129 at 24-Nov-2025 23:53:30 CET
Begin processing the 970th record. run: 8525 subRun: 0 event: 15130 at 24-Nov-2025 23:53:31 CET
24-Nov-2025 23:53:31 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/90/64/prodgenie_nu_dune10kt_1x2x6_20251003T192933Z_gen_001513_g4_detsim_20251116T113733Z_reco.root"
24-Nov-2025 23:53:31 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/49/3d/prodgenie_nu_dune10kt_1x2x6_20251003T192936Z_gen_001527_g4_detsim_20251116T172703Z_reco.root"
24-Nov-2025 23:53:31 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/49/3d/prodgenie_nu_dune10kt_1x2x6_20251003T192936Z_gen_001527_g4_detsim_20251116T172703Z_reco.root"
Begin processing the 971st record. run: 8525 subRun: 0 event: 15261 at 24-Nov-2025 23:53:32 CET
Begin processing the 972nd record. run: 8525 subRun: 0 event: 15262 at 24-Nov-2025 23:53:33 CET
Begin processing the 973rd record. run: 8525 subRun: 0 event: 15263 at 24-Nov-2025 23:53:33 CET
Begin processing the 974th record. run: 8525 subRun: 0 event: 15264 at 24-Nov-2025 23:53:33 CET
Begin processing the 975th record. run: 8525 subRun: 0 event: 15265 at 24-Nov-2025 23:53:34 CET
Begin processing the 976th record. run: 8525 subRun: 0 event: 15266 at 24-Nov-2025 23:53:34 CET
Begin processing the 977th record. run: 8525 subRun: 0 event: 15267 at 24-Nov-2025 23:53:34 CET
Begin processing the 978th record. run: 8525 subRun: 0 event: 15268 at 24-Nov-2025 23:53:35 CET
Begin processing the 979th record. run: 8525 subRun: 0 event: 15269 at 24-Nov-2025 23:53:35 CET
Begin processing the 980th record. run: 8525 subRun: 0 event: 15270 at 24-Nov-2025 23:53:35 CET
24-Nov-2025 23:53:35 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/49/3d/prodgenie_nu_dune10kt_1x2x6_20251003T192936Z_gen_001527_g4_detsim_20251116T172703Z_reco.root"
24-Nov-2025 23:53:35 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/80/9f/prodgenie_nu_dune10kt_1x2x6_20251003T192937Z_gen_001529_g4_detsim_20251116T114851Z_reco.root"
24-Nov-2025 23:53:35 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/80/9f/prodgenie_nu_dune10kt_1x2x6_20251003T192937Z_gen_001529_g4_detsim_20251116T114851Z_reco.root"
Begin processing the 981st record. run: 8525 subRun: 0 event: 15281 at 24-Nov-2025 23:53:36 CET
Begin processing the 982nd record. run: 8525 subRun: 0 event: 15282 at 24-Nov-2025 23:53:36 CET
Begin processing the 983rd record. run: 8525 subRun: 0 event: 15283 at 24-Nov-2025 23:53:37 CET
Begin processing the 984th record. run: 8525 subRun: 0 event: 15284 at 24-Nov-2025 23:53:37 CET
Begin processing the 985th record. run: 8525 subRun: 0 event: 15285 at 24-Nov-2025 23:53:37 CET
Begin processing the 986th record. run: 8525 subRun: 0 event: 15286 at 24-Nov-2025 23:53:37 CET
Begin processing the 987th record. run: 8525 subRun: 0 event: 15287 at 24-Nov-2025 23:53:38 CET
Begin processing the 988th record. run: 8525 subRun: 0 event: 15288 at 24-Nov-2025 23:53:38 CET
Begin processing the 989th record. run: 8525 subRun: 0 event: 15289 at 24-Nov-2025 23:53:38 CET
Begin processing the 990th record. run: 8525 subRun: 0 event: 15290 at 24-Nov-2025 23:53:39 CET
24-Nov-2025 23:53:40 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/80/9f/prodgenie_nu_dune10kt_1x2x6_20251003T192937Z_gen_001529_g4_detsim_20251116T114851Z_reco.root"
24-Nov-2025 23:53:40 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/2e/9c/prodgenie_nu_dune10kt_1x2x6_20251003T192941Z_gen_001539_g4_detsim_20251116T112818Z_reco.root"
24-Nov-2025 23:53:40 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/2e/9c/prodgenie_nu_dune10kt_1x2x6_20251003T192941Z_gen_001539_g4_detsim_20251116T112818Z_reco.root"
Begin processing the 991st record. run: 8525 subRun: 0 event: 15381 at 24-Nov-2025 23:53:40 CET
Begin processing the 992nd record. run: 8525 subRun: 0 event: 15382 at 24-Nov-2025 23:53:40 CET
Begin processing the 993rd record. run: 8525 subRun: 0 event: 15383 at 24-Nov-2025 23:53:41 CET
Begin processing the 994th record. run: 8525 subRun: 0 event: 15384 at 24-Nov-2025 23:53:41 CET
Begin processing the 995th record. run: 8525 subRun: 0 event: 15385 at 24-Nov-2025 23:53:41 CET
Begin processing the 996th record. run: 8525 subRun: 0 event: 15386 at 24-Nov-2025 23:53:42 CET
Begin processing the 997th record. run: 8525 subRun: 0 event: 15387 at 24-Nov-2025 23:53:42 CET
Begin processing the 998th record. run: 8525 subRun: 0 event: 15388 at 24-Nov-2025 23:53:42 CET
Begin processing the 999th record. run: 8525 subRun: 0 event: 15389 at 24-Nov-2025 23:53:43 CET
Begin processing the 1000th record. run: 8525 subRun: 0 event: 15390 at 24-Nov-2025 23:53:43 CET
24-Nov-2025 23:53:43 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/2e/9c/prodgenie_nu_dune10kt_1x2x6_20251003T192941Z_gen_001539_g4_detsim_20251116T112818Z_reco.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                             0.0481625     0.257243       3.65948       0.13581      0.364372       1000    
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                0.00307523    0.00585373     0.0461862    0.00415478     0.0049105      1000    
end_path:triggerAna:TriggerAnaTree     0.0435872     0.250849       3.65535      0.130339      0.364114       1000    
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1986.58 MB
  Peak resident set size usage (VmHWM): 1238.97 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.

Processing output file prodgenie_nu_dune10kt_1x2x6__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__ntuple__NU_prod_l002000_20251124T215527_c4.root
merged pass1_CERN_000005.json
justIN time: 2026-02-08 15:32:23 UTC       justIN version: 01.06.00