justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 250818.19@dunegpschedd02.fnal.gov

Jobsub ID250818.19@dunegpschedd02.fnal.gov
Workflow ID10613
Stage ID1
User nameschellma@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-24 20:21:32
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce512
Last heartbeat2025-11-24 20:38:47
From worker nodeHostnameb9p12p2959.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-24 20:34:33
Input filesmonte-carlo-010613-000017
JobscriptExit code0
Real time3m (190s)
CPU time1m (68s = 35%)
Max RSS bytes903614464 (861 MiB)
Outputting started2025-11-24 20:37:44
Output filesfardet-hd:prod_p_1-500MeV_dune10kt_1x2x6__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__ntuple__PROTON_prod_l002000_20251124T201421_c16.root
Finished2025-11-24 20:38:47
Saved logsjustin-logs:250818.19-dunegpschedd02.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/6b/aa/prod_p_1-500MeV_dune10kt_1x2x6_20251003T101812Z_gen_005230_g4_detsim_20251116T083610Z_reco.root"
24-Nov-2025 21:37:32 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/c0/17/prod_p_1-500MeV_dune10kt_1x2x6_20251003T101817Z_gen_005242_g4_detsim_20251116T081245Z_reco.root"
24-Nov-2025 21:37:32 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/c0/17/prod_p_1-500MeV_dune10kt_1x2x6_20251003T101817Z_gen_005242_g4_detsim_20251116T081245Z_reco.root"
Begin processing the 951st record. run: 8497 subRun: 0 event: 52411 at 24-Nov-2025 21:37:33 CET
Begin processing the 952nd record. run: 8497 subRun: 0 event: 52412 at 24-Nov-2025 21:37:33 CET
Begin processing the 953rd record. run: 8497 subRun: 0 event: 52413 at 24-Nov-2025 21:37:33 CET
Begin processing the 954th record. run: 8497 subRun: 0 event: 52414 at 24-Nov-2025 21:37:33 CET
Begin processing the 955th record. run: 8497 subRun: 0 event: 52415 at 24-Nov-2025 21:37:33 CET
Begin processing the 956th record. run: 8497 subRun: 0 event: 52416 at 24-Nov-2025 21:37:33 CET
Begin processing the 957th record. run: 8497 subRun: 0 event: 52417 at 24-Nov-2025 21:37:34 CET
Begin processing the 958th record. run: 8497 subRun: 0 event: 52418 at 24-Nov-2025 21:37:34 CET
Begin processing the 959th record. run: 8497 subRun: 0 event: 52419 at 24-Nov-2025 21:37:34 CET
Begin processing the 960th record. run: 8497 subRun: 0 event: 52420 at 24-Nov-2025 21:37:34 CET
24-Nov-2025 21:37:34 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/c0/17/prod_p_1-500MeV_dune10kt_1x2x6_20251003T101817Z_gen_005242_g4_detsim_20251116T081245Z_reco.root"
24-Nov-2025 21:37:34 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/54/da/prod_p_1-500MeV_dune10kt_1x2x6_20251003T101831Z_gen_005266_g4_detsim_20251116T080814Z_reco.root"
24-Nov-2025 21:37:34 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/54/da/prod_p_1-500MeV_dune10kt_1x2x6_20251003T101831Z_gen_005266_g4_detsim_20251116T080814Z_reco.root"
Begin processing the 961st record. run: 8497 subRun: 0 event: 52651 at 24-Nov-2025 21:37:34 CET
Begin processing the 962nd record. run: 8497 subRun: 0 event: 52652 at 24-Nov-2025 21:37:35 CET
Begin processing the 963rd record. run: 8497 subRun: 0 event: 52653 at 24-Nov-2025 21:37:35 CET
Begin processing the 964th record. run: 8497 subRun: 0 event: 52654 at 24-Nov-2025 21:37:35 CET
Begin processing the 965th record. run: 8497 subRun: 0 event: 52655 at 24-Nov-2025 21:37:35 CET
Begin processing the 966th record. run: 8497 subRun: 0 event: 52656 at 24-Nov-2025 21:37:35 CET
Begin processing the 967th record. run: 8497 subRun: 0 event: 52657 at 24-Nov-2025 21:37:35 CET
Begin processing the 968th record. run: 8497 subRun: 0 event: 52658 at 24-Nov-2025 21:37:35 CET
Begin processing the 969th record. run: 8497 subRun: 0 event: 52659 at 24-Nov-2025 21:37:36 CET
Begin processing the 970th record. run: 8497 subRun: 0 event: 52660 at 24-Nov-2025 21:37:36 CET
24-Nov-2025 21:37:36 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/54/da/prod_p_1-500MeV_dune10kt_1x2x6_20251003T101831Z_gen_005266_g4_detsim_20251116T080814Z_reco.root"
24-Nov-2025 21:37:36 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/90/d9/prod_p_1-500MeV_dune10kt_1x2x6_20251003T101838Z_gen_005272_g4_detsim_20251116T081222Z_reco.root"
24-Nov-2025 21:37:36 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/90/d9/prod_p_1-500MeV_dune10kt_1x2x6_20251003T101838Z_gen_005272_g4_detsim_20251116T081222Z_reco.root"
Begin processing the 971st record. run: 8497 subRun: 0 event: 52711 at 24-Nov-2025 21:37:36 CET
Begin processing the 972nd record. run: 8497 subRun: 0 event: 52712 at 24-Nov-2025 21:37:36 CET
Begin processing the 973rd record. run: 8497 subRun: 0 event: 52713 at 24-Nov-2025 21:37:37 CET
Begin processing the 974th record. run: 8497 subRun: 0 event: 52714 at 24-Nov-2025 21:37:37 CET
Begin processing the 975th record. run: 8497 subRun: 0 event: 52715 at 24-Nov-2025 21:37:37 CET
Begin processing the 976th record. run: 8497 subRun: 0 event: 52716 at 24-Nov-2025 21:37:37 CET
Begin processing the 977th record. run: 8497 subRun: 0 event: 52717 at 24-Nov-2025 21:37:37 CET
Begin processing the 978th record. run: 8497 subRun: 0 event: 52718 at 24-Nov-2025 21:37:37 CET
Begin processing the 979th record. run: 8497 subRun: 0 event: 52719 at 24-Nov-2025 21:37:37 CET
Begin processing the 980th record. run: 8497 subRun: 0 event: 52720 at 24-Nov-2025 21:37:38 CET
24-Nov-2025 21:37:38 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/90/d9/prod_p_1-500MeV_dune10kt_1x2x6_20251003T101838Z_gen_005272_g4_detsim_20251116T081222Z_reco.root"
24-Nov-2025 21:37:38 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/1b/92/prod_p_1-500MeV_dune10kt_1x2x6_20251003T101839Z_gen_005274_g4_detsim_20251116T082107Z_reco.root"
24-Nov-2025 21:37:38 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/1b/92/prod_p_1-500MeV_dune10kt_1x2x6_20251003T101839Z_gen_005274_g4_detsim_20251116T082107Z_reco.root"
Begin processing the 981st record. run: 8497 subRun: 0 event: 52731 at 24-Nov-2025 21:37:38 CET
Begin processing the 982nd record. run: 8497 subRun: 0 event: 52732 at 24-Nov-2025 21:37:38 CET
Begin processing the 983rd record. run: 8497 subRun: 0 event: 52733 at 24-Nov-2025 21:37:38 CET
Begin processing the 984th record. run: 8497 subRun: 0 event: 52734 at 24-Nov-2025 21:37:39 CET
Begin processing the 985th record. run: 8497 subRun: 0 event: 52735 at 24-Nov-2025 21:37:39 CET
Begin processing the 986th record. run: 8497 subRun: 0 event: 52736 at 24-Nov-2025 21:37:39 CET
Begin processing the 987th record. run: 8497 subRun: 0 event: 52737 at 24-Nov-2025 21:37:39 CET
Begin processing the 988th record. run: 8497 subRun: 0 event: 52738 at 24-Nov-2025 21:37:39 CET
Begin processing the 989th record. run: 8497 subRun: 0 event: 52739 at 24-Nov-2025 21:37:39 CET
Begin processing the 990th record. run: 8497 subRun: 0 event: 52740 at 24-Nov-2025 21:37:39 CET
24-Nov-2025 21:37:40 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/1b/92/prod_p_1-500MeV_dune10kt_1x2x6_20251003T101839Z_gen_005274_g4_detsim_20251116T082107Z_reco.root"
24-Nov-2025 21:37:40 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/3b/e8/prod_p_1-500MeV_dune10kt_1x2x6_20251003T101848Z_gen_005282_g4_detsim_20251106T155115Z_reco.root"
24-Nov-2025 21:37:40 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/3b/e8/prod_p_1-500MeV_dune10kt_1x2x6_20251003T101848Z_gen_005282_g4_detsim_20251106T155115Z_reco.root"
Begin processing the 991st record. run: 8497 subRun: 0 event: 52811 at 24-Nov-2025 21:37:40 CET
Begin processing the 992nd record. run: 8497 subRun: 0 event: 52812 at 24-Nov-2025 21:37:40 CET
Begin processing the 993rd record. run: 8497 subRun: 0 event: 52813 at 24-Nov-2025 21:37:40 CET
Begin processing the 994th record. run: 8497 subRun: 0 event: 52814 at 24-Nov-2025 21:37:40 CET
Begin processing the 995th record. run: 8497 subRun: 0 event: 52815 at 24-Nov-2025 21:37:40 CET
Begin processing the 996th record. run: 8497 subRun: 0 event: 52816 at 24-Nov-2025 21:37:41 CET
Begin processing the 997th record. run: 8497 subRun: 0 event: 52817 at 24-Nov-2025 21:37:41 CET
Begin processing the 998th record. run: 8497 subRun: 0 event: 52818 at 24-Nov-2025 21:37:41 CET
Begin processing the 999th record. run: 8497 subRun: 0 event: 52819 at 24-Nov-2025 21:37:41 CET
Begin processing the 1000th record. run: 8497 subRun: 0 event: 52820 at 24-Nov-2025 21:37:41 CET
24-Nov-2025 21:37:41 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/3b/e8/prod_p_1-500MeV_dune10kt_1x2x6_20251003T101848Z_gen_005282_g4_detsim_20251106T155115Z_reco.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                             0.0440465     0.0639842      0.69201      0.0608724     0.0231061      1000    
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                0.00299057    0.00489575     0.0450635    0.00358753    0.00380635      1000    
end_path:triggerAna:TriggerAnaTree     0.0406586     0.0587276     0.688194        0.056       0.0224857      1000    
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1609.04 MB
  Peak resident set size usage (VmHWM): 830.755 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.

Processing output file prod_p_1-500MeV_dune10kt_1x2x6__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__ntuple__PROTON_prod_l002000_20251124T201421_c16.root
merged pass1_CERN_000017.json
justIN time: 2026-02-08 16:54:44 UTC       justIN version: 01.06.00