justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 250975.20@dunegpschedd02.fnal.gov

Jobsub ID250975.20@dunegpschedd02.fnal.gov
Workflow ID10647
Stage ID1
User nameschellma@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-24 23:13:39
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce506
Last heartbeat2025-11-24 23:46:21
From worker nodeHostnameb9p10p3694.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-24 23:41:55
Input filesmonte-carlo-010647-000020
JobscriptExit code0
Real time2m (175s)
CPU time0m (59s = 33%)
Max RSS bytes671510528 (640 MiB)
Outputting started2025-11-24 23:44:51
Output filesfardet-hd:prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__ntuple__CAVE-NEUTRON_prod_s008000_l002000_20251124T222815_c19.root
Finished2025-11-24 23:46:21
Saved logsjustin-logs:250975.20-dunegpschedd02.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

2x6_20251002T082027Z_gen_009979_supernova_g4_detsim_20251115T175423Z_reco.root"
25-Nov-2025 00:44:44 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/01/c0/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T082027Z_gen_009979_supernova_g4_detsim_20251115T175423Z_reco.root"
Begin processing the 920th record. run: 8378 subRun: 0 event: 99780252 at 25-Nov-2025 00:44:44 CET
Begin processing the 921st record. run: 8378 subRun: 0 event: 99780359 at 25-Nov-2025 00:44:44 CET
Begin processing the 922nd record. run: 8378 subRun: 0 event: 99781551 at 25-Nov-2025 00:44:44 CET
Begin processing the 923rd record. run: 8378 subRun: 0 event: 99781902 at 25-Nov-2025 00:44:44 CET
Begin processing the 924th record. run: 8378 subRun: 0 event: 99782543 at 25-Nov-2025 00:44:44 CET
Begin processing the 925th record. run: 8378 subRun: 0 event: 99782686 at 25-Nov-2025 00:44:44 CET
Begin processing the 926th record. run: 8378 subRun: 0 event: 99782930 at 25-Nov-2025 00:44:44 CET
Begin processing the 927th record. run: 8378 subRun: 0 event: 99784125 at 25-Nov-2025 00:44:45 CET
Begin processing the 928th record. run: 8378 subRun: 0 event: 99785066 at 25-Nov-2025 00:44:45 CET
Begin processing the 929th record. run: 8378 subRun: 0 event: 99785859 at 25-Nov-2025 00:44:45 CET
Begin processing the 930th record. run: 8378 subRun: 0 event: 99789908 at 25-Nov-2025 00:44:45 CET
25-Nov-2025 00:44:45 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/01/c0/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T082027Z_gen_009979_supernova_g4_detsim_20251115T175423Z_reco.root"
25-Nov-2025 00:44:45 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/56/39/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T082030Z_gen_009988_supernova_g4_detsim_20251115T173811Z_reco.root"
25-Nov-2025 00:44:45 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/56/39/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T082030Z_gen_009988_supernova_g4_detsim_20251115T173811Z_reco.root"
Begin processing the 931st record. run: 8378 subRun: 0 event: 99870069 at 25-Nov-2025 00:44:45 CET
Begin processing the 932nd record. run: 8378 subRun: 0 event: 99870131 at 25-Nov-2025 00:44:45 CET
Begin processing the 933rd record. run: 8378 subRun: 0 event: 99871035 at 25-Nov-2025 00:44:45 CET
Begin processing the 934th record. run: 8378 subRun: 0 event: 99872198 at 25-Nov-2025 00:44:46 CET
Begin processing the 935th record. run: 8378 subRun: 0 event: 99872543 at 25-Nov-2025 00:44:46 CET
Begin processing the 936th record. run: 8378 subRun: 0 event: 99873891 at 25-Nov-2025 00:44:46 CET
Begin processing the 937th record. run: 8378 subRun: 0 event: 99874519 at 25-Nov-2025 00:44:46 CET
Begin processing the 938th record. run: 8378 subRun: 0 event: 99877629 at 25-Nov-2025 00:44:46 CET
Begin processing the 939th record. run: 8378 subRun: 0 event: 99878013 at 25-Nov-2025 00:44:46 CET
Begin processing the 940th record. run: 8378 subRun: 0 event: 99878085 at 25-Nov-2025 00:44:46 CET
Begin processing the 941st record. run: 8378 subRun: 0 event: 99878125 at 25-Nov-2025 00:44:46 CET
Begin processing the 942nd record. run: 8378 subRun: 0 event: 99878173 at 25-Nov-2025 00:44:46 CET
Begin processing the 943rd record. run: 8378 subRun: 0 event: 99878626 at 25-Nov-2025 00:44:47 CET
Begin processing the 944th record. run: 8378 subRun: 0 event: 99879059 at 25-Nov-2025 00:44:47 CET
25-Nov-2025 00:44:47 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/56/39/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T082030Z_gen_009988_supernova_g4_detsim_20251115T173811Z_reco.root"
25-Nov-2025 00:44:47 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/be/7f/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T082036Z_gen_009991_supernova_g4_detsim_20251115T171527Z_reco.root"
25-Nov-2025 00:44:47 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/be/7f/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T082036Z_gen_009991_supernova_g4_detsim_20251115T171527Z_reco.root"
Begin processing the 945th record. run: 8378 subRun: 0 event: 99900173 at 25-Nov-2025 00:44:47 CET
Begin processing the 946th record. run: 8378 subRun: 0 event: 99900252 at 25-Nov-2025 00:44:47 CET
Begin processing the 947th record. run: 8378 subRun: 0 event: 99900359 at 25-Nov-2025 00:44:47 CET
Begin processing the 948th record. run: 8378 subRun: 0 event: 99905859 at 25-Nov-2025 00:44:47 CET
Begin processing the 949th record. run: 8378 subRun: 0 event: 99908173 at 25-Nov-2025 00:44:48 CET
Begin processing the 950th record. run: 8378 subRun: 0 event: 99909460 at 25-Nov-2025 00:44:48 CET
25-Nov-2025 00:44:48 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/be/7f/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T082036Z_gen_009991_supernova_g4_detsim_20251115T171527Z_reco.root"
25-Nov-2025 00:44:48 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/fe/29/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T082040Z_gen_009995_supernova_g4_detsim_20251115T194100Z_reco.root"
25-Nov-2025 00:44:48 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/fe/29/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T082040Z_gen_009995_supernova_g4_detsim_20251115T194100Z_reco.root"
Begin processing the 951st record. run: 8378 subRun: 0 event: 99940252 at 25-Nov-2025 00:44:48 CET
Begin processing the 952nd record. run: 8378 subRun: 0 event: 99940359 at 25-Nov-2025 00:44:48 CET
Begin processing the 953rd record. run: 8378 subRun: 0 event: 99941964 at 25-Nov-2025 00:44:48 CET
Begin processing the 954th record. run: 8378 subRun: 0 event: 99942686 at 25-Nov-2025 00:44:48 CET
Begin processing the 955th record. run: 8378 subRun: 0 event: 99942930 at 25-Nov-2025 00:44:48 CET
Begin processing the 956th record. run: 8378 subRun: 0 event: 99943891 at 25-Nov-2025 00:44:49 CET
Begin processing the 957th record. run: 8378 subRun: 0 event: 99944519 at 25-Nov-2025 00:44:49 CET
Begin processing the 958th record. run: 8378 subRun: 0 event: 99945859 at 25-Nov-2025 00:44:49 CET
Begin processing the 959th record. run: 8378 subRun: 0 event: 99949212 at 25-Nov-2025 00:44:49 CET
Begin processing the 960th record. run: 8378 subRun: 0 event: 99949346 at 25-Nov-2025 00:44:49 CET
25-Nov-2025 00:44:49 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/fe/29/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T082040Z_gen_009995_supernova_g4_detsim_20251115T194100Z_reco.root"
25-Nov-2025 00:44:49 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/7c/92/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T083748Z_gen_009948_supernova_g4_detsim_20251115T172139Z_reco.root"
25-Nov-2025 00:44:49 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/7c/92/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T083748Z_gen_009948_supernova_g4_detsim_20251115T172139Z_reco.root"
Begin processing the 961st record. run: 8378 subRun: 0 event: 99471035 at 25-Nov-2025 00:44:49 CET
Begin processing the 962nd record. run: 8378 subRun: 0 event: 99471582 at 25-Nov-2025 00:44:49 CET
Begin processing the 963rd record. run: 8378 subRun: 0 event: 99473891 at 25-Nov-2025 00:44:50 CET
Begin processing the 964th record. run: 8378 subRun: 0 event: 99474081 at 25-Nov-2025 00:44:50 CET
25-Nov-2025 00:44:50 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/7c/92/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T083748Z_gen_009948_supernova_g4_detsim_20251115T172139Z_reco.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                             0.044021      0.0622443     0.217372      0.0595786     0.0168467       964    
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                0.00290158     0.0039807     0.0336511    0.00351625    0.00223941       964    
end_path:triggerAna:TriggerAnaTree     0.0403174     0.0578728     0.199755      0.055541      0.0154029       964    
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1350.24 MB
  Peak resident set size usage (VmHWM): 620.175 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.

Processing output file prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__ntuple__CAVE-NEUTRON_prod_s008000_l002000_20251124T222815_c19.root
merged pass1_CERN_000020.json
justIN time: 2026-02-08 15:33:36 UTC       justIN version: 01.06.00