justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 250975.18@dunegpschedd02.fnal.gov

Jobsub ID250975.18@dunegpschedd02.fnal.gov
Workflow ID10647
Stage ID1
User nameschellma@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-24 23:13:39
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2025-11-24 23:46:22
From worker nodeHostnameb9p04p6496.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-24 23:41:51
Input filesmonte-carlo-010647-000019
JobscriptExit code0
Real time2m (177s)
CPU time1m (61s = 34%)
Max RSS bytes649285632 (619 MiB)
Outputting started2025-11-24 23:44:49
Output filesfardet-hd:prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__ntuple__CAVE-NEUTRON_prod_s008000_l002000_20251124T222815_c18.root
Finished2025-11-24 23:46:22
Saved logsjustin-logs:250975.18-dunegpschedd02.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

n: 0 event: 94375066 at 25-Nov-2025 00:44:41 CET
Begin processing the 942nd record. run: 8378 subRun: 0 event: 94375365 at 25-Nov-2025 00:44:41 CET
Begin processing the 943rd record. run: 8378 subRun: 0 event: 94375700 at 25-Nov-2025 00:44:41 CET
Begin processing the 944th record. run: 8378 subRun: 0 event: 94378085 at 25-Nov-2025 00:44:41 CET
Begin processing the 945th record. run: 8378 subRun: 0 event: 94378173 at 25-Nov-2025 00:44:41 CET
Begin processing the 946th record. run: 8378 subRun: 0 event: 94378626 at 25-Nov-2025 00:44:41 CET
Begin processing the 947th record. run: 8378 subRun: 0 event: 94379059 at 25-Nov-2025 00:44:41 CET
Begin processing the 948th record. run: 8378 subRun: 0 event: 94379212 at 25-Nov-2025 00:44:41 CET
25-Nov-2025 00:44:41 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/0e/56/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075234Z_gen_009438_supernova_g4_detsim_20251115T194614Z_reco.root"
25-Nov-2025 00:44:41 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/e4/2f/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075234Z_gen_009440_supernova_g4_detsim_20251115T174151Z_reco.root"
25-Nov-2025 00:44:42 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/e4/2f/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075234Z_gen_009440_supernova_g4_detsim_20251115T174151Z_reco.root"
Begin processing the 949th record. run: 8378 subRun: 0 event: 94390069 at 25-Nov-2025 00:44:42 CET
Begin processing the 950th record. run: 8378 subRun: 0 event: 94390252 at 25-Nov-2025 00:44:42 CET
Begin processing the 951st record. run: 8378 subRun: 0 event: 94390359 at 25-Nov-2025 00:44:42 CET
Begin processing the 952nd record. run: 8378 subRun: 0 event: 94391582 at 25-Nov-2025 00:44:42 CET
Begin processing the 953rd record. run: 8378 subRun: 0 event: 94391616 at 25-Nov-2025 00:44:42 CET
Begin processing the 954th record. run: 8378 subRun: 0 event: 94394125 at 25-Nov-2025 00:44:42 CET
Begin processing the 955th record. run: 8378 subRun: 0 event: 94395700 at 25-Nov-2025 00:44:42 CET
Begin processing the 956th record. run: 8378 subRun: 0 event: 94399212 at 25-Nov-2025 00:44:43 CET
Begin processing the 957th record. run: 8378 subRun: 0 event: 94399346 at 25-Nov-2025 00:44:43 CET
Begin processing the 958th record. run: 8378 subRun: 0 event: 94399908 at 25-Nov-2025 00:44:43 CET
25-Nov-2025 00:44:43 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/e4/2f/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075234Z_gen_009440_supernova_g4_detsim_20251115T174151Z_reco.root"
25-Nov-2025 00:44:43 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/c7/c2/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075234Z_gen_009441_supernova_g4_detsim_20251115T173622Z_reco.root"
25-Nov-2025 00:44:43 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/c7/c2/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075234Z_gen_009441_supernova_g4_detsim_20251115T173622Z_reco.root"
Begin processing the 959th record. run: 8378 subRun: 0 event: 94401551 at 25-Nov-2025 00:44:43 CET
Begin processing the 960th record. run: 8378 subRun: 0 event: 94401616 at 25-Nov-2025 00:44:43 CET
Begin processing the 961st record. run: 8378 subRun: 0 event: 94402198 at 25-Nov-2025 00:44:43 CET
Begin processing the 962nd record. run: 8378 subRun: 0 event: 94403575 at 25-Nov-2025 00:44:43 CET
Begin processing the 963rd record. run: 8378 subRun: 0 event: 94404081 at 25-Nov-2025 00:44:44 CET
Begin processing the 964th record. run: 8378 subRun: 0 event: 94404725 at 25-Nov-2025 00:44:44 CET
Begin processing the 965th record. run: 8378 subRun: 0 event: 94405859 at 25-Nov-2025 00:44:44 CET
Begin processing the 966th record. run: 8378 subRun: 0 event: 94407119 at 25-Nov-2025 00:44:44 CET
Begin processing the 967th record. run: 8378 subRun: 0 event: 94407670 at 25-Nov-2025 00:44:44 CET
Begin processing the 968th record. run: 8378 subRun: 0 event: 94408173 at 25-Nov-2025 00:44:44 CET
Begin processing the 969th record. run: 8378 subRun: 0 event: 94408658 at 25-Nov-2025 00:44:44 CET
Begin processing the 970th record. run: 8378 subRun: 0 event: 94409908 at 25-Nov-2025 00:44:45 CET
25-Nov-2025 00:44:45 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/c7/c2/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075234Z_gen_009441_supernova_g4_detsim_20251115T173622Z_reco.root"
25-Nov-2025 00:44:45 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/ce/41/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075235Z_gen_009443_supernova_g4_detsim_20251115T180036Z_reco.root"
25-Nov-2025 00:44:45 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/ce/41/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075235Z_gen_009443_supernova_g4_detsim_20251115T180036Z_reco.root"
Begin processing the 971st record. run: 8378 subRun: 0 event: 94421035 at 25-Nov-2025 00:44:45 CET
Begin processing the 972nd record. run: 8378 subRun: 0 event: 94421582 at 25-Nov-2025 00:44:45 CET
Begin processing the 973rd record. run: 8378 subRun: 0 event: 94421902 at 25-Nov-2025 00:44:46 CET
Begin processing the 974th record. run: 8378 subRun: 0 event: 94422198 at 25-Nov-2025 00:44:46 CET
Begin processing the 975th record. run: 8378 subRun: 0 event: 94422686 at 25-Nov-2025 00:44:46 CET
Begin processing the 976th record. run: 8378 subRun: 0 event: 94422930 at 25-Nov-2025 00:44:46 CET
Begin processing the 977th record. run: 8378 subRun: 0 event: 94423891 at 25-Nov-2025 00:44:46 CET
Begin processing the 978th record. run: 8378 subRun: 0 event: 94425365 at 25-Nov-2025 00:44:46 CET
Begin processing the 979th record. run: 8378 subRun: 0 event: 94425700 at 25-Nov-2025 00:44:46 CET
Begin processing the 980th record. run: 8378 subRun: 0 event: 94425859 at 25-Nov-2025 00:44:46 CET
Begin processing the 981st record. run: 8378 subRun: 0 event: 94428013 at 25-Nov-2025 00:44:46 CET
25-Nov-2025 00:44:47 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/ce/41/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075235Z_gen_009443_supernova_g4_detsim_20251115T180036Z_reco.root"
25-Nov-2025 00:44:47 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/d1/ff/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075235Z_gen_009444_supernova_g4_detsim_20251115T175352Z_reco.root"
25-Nov-2025 00:44:47 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/d1/ff/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075235Z_gen_009444_supernova_g4_detsim_20251115T175352Z_reco.root"
Begin processing the 982nd record. run: 8378 subRun: 0 event: 94430131 at 25-Nov-2025 00:44:47 CET
Begin processing the 983rd record. run: 8378 subRun: 0 event: 94430359 at 25-Nov-2025 00:44:47 CET
Begin processing the 984th record. run: 8378 subRun: 0 event: 94431964 at 25-Nov-2025 00:44:47 CET
Begin processing the 985th record. run: 8378 subRun: 0 event: 94433575 at 25-Nov-2025 00:44:47 CET
Begin processing the 986th record. run: 8378 subRun: 0 event: 94433891 at 25-Nov-2025 00:44:47 CET
Begin processing the 987th record. run: 8378 subRun: 0 event: 94439059 at 25-Nov-2025 00:44:47 CET
Begin processing the 988th record. run: 8378 subRun: 0 event: 94439212 at 25-Nov-2025 00:44:48 CET
Begin processing the 989th record. run: 8378 subRun: 0 event: 94439346 at 25-Nov-2025 00:44:48 CET
25-Nov-2025 00:44:48 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/d1/ff/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075235Z_gen_009444_supernova_g4_detsim_20251115T175352Z_reco.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                             0.0448929     0.0627109     0.726889      0.0587659     0.0271124       989    
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                0.00287019    0.00396694     0.0271552     0.0034181    0.00229048       989    
end_path:triggerAna:TriggerAnaTree     0.0414269     0.0583103     0.723089      0.0546921     0.0262483       989    
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1437.8 MB
  Peak resident set size usage (VmHWM): 640.897 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.

Processing output file prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__ntuple__CAVE-NEUTRON_prod_s008000_l002000_20251124T222815_c18.root
merged pass1_CERN_000019.json
justIN time: 2026-02-08 15:33:51 UTC       justIN version: 01.06.00