justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 250974.18@dunegpschedd02.fnal.gov

Jobsub ID250974.18@dunegpschedd02.fnal.gov
Workflow ID10645
Stage ID1
User nameschellma@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-24 23:13:39
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce504
Last heartbeat2025-11-24 23:40:45
From worker nodeHostnameb9p02p3136.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-24 23:36:35
Input filesmonte-carlo-010645-000019
JobscriptExit code0
Real time3m (185s)
CPU time0m (58s = 31%)
Max RSS bytes639459328 (609 MiB)
Outputting started2025-11-24 23:39:41
Output filesfardet-hd:prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__ntuple__CAVE-NEUTRON_prod_s004000_l002000_20251124T222729_c18.root
Finished2025-11-24 23:40:45
Saved logsjustin-logs:250974.18-dunegpschedd02.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

_dune10kt_1x2x6_20251002T075225Z_gen_009422_supernova_g4_detsim_20251115T190128Z_reco.root"
25-Nov-2025 00:39:33 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/d2/ce/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075226Z_gen_009424_supernova_g4_detsim_20251115T173032Z_reco.root"
25-Nov-2025 00:39:33 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/d2/ce/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075226Z_gen_009424_supernova_g4_detsim_20251115T173032Z_reco.root"
Begin processing the 896th record. run: 8378 subRun: 0 event: 94230359 at 25-Nov-2025 00:39:33 CET
Begin processing the 897th record. run: 8378 subRun: 0 event: 94234725 at 25-Nov-2025 00:39:33 CET
Begin processing the 898th record. run: 8378 subRun: 0 event: 94235810 at 25-Nov-2025 00:39:33 CET
Begin processing the 899th record. run: 8378 subRun: 0 event: 94237119 at 25-Nov-2025 00:39:33 CET
Begin processing the 900th record. run: 8378 subRun: 0 event: 94237670 at 25-Nov-2025 00:39:34 CET
Begin processing the 901st record. run: 8378 subRun: 0 event: 94238626 at 25-Nov-2025 00:39:34 CET
Begin processing the 902nd record. run: 8378 subRun: 0 event: 94239059 at 25-Nov-2025 00:39:34 CET
Begin processing the 903rd record. run: 8378 subRun: 0 event: 94239212 at 25-Nov-2025 00:39:34 CET
Begin processing the 904th record. run: 8378 subRun: 0 event: 94239908 at 25-Nov-2025 00:39:34 CET
25-Nov-2025 00:39:34 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/d2/ce/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075226Z_gen_009424_supernova_g4_detsim_20251115T173032Z_reco.root"
25-Nov-2025 00:39:34 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/32/37/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075227Z_gen_009425_supernova_g4_detsim_20251115T165800Z_reco.root"
25-Nov-2025 00:39:34 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/32/37/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075227Z_gen_009425_supernova_g4_detsim_20251115T165800Z_reco.root"
Begin processing the 905th record. run: 8378 subRun: 0 event: 94240252 at 25-Nov-2025 00:39:35 CET
Begin processing the 906th record. run: 8378 subRun: 0 event: 94240359 at 25-Nov-2025 00:39:35 CET
Begin processing the 907th record. run: 8378 subRun: 0 event: 94241035 at 25-Nov-2025 00:39:35 CET
Begin processing the 908th record. run: 8378 subRun: 0 event: 94242198 at 25-Nov-2025 00:39:35 CET
Begin processing the 909th record. run: 8378 subRun: 0 event: 94242686 at 25-Nov-2025 00:39:35 CET
Begin processing the 910th record. run: 8378 subRun: 0 event: 94245700 at 25-Nov-2025 00:39:35 CET
Begin processing the 911th record. run: 8378 subRun: 0 event: 94246045 at 25-Nov-2025 00:39:35 CET
Begin processing the 912th record. run: 8378 subRun: 0 event: 94247629 at 25-Nov-2025 00:39:35 CET
Begin processing the 913th record. run: 8378 subRun: 0 event: 94247670 at 25-Nov-2025 00:39:36 CET
Begin processing the 914th record. run: 8378 subRun: 0 event: 94248085 at 25-Nov-2025 00:39:36 CET
Begin processing the 915th record. run: 8378 subRun: 0 event: 94248658 at 25-Nov-2025 00:39:36 CET
25-Nov-2025 00:39:36 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/32/37/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075227Z_gen_009425_supernova_g4_detsim_20251115T165800Z_reco.root"
25-Nov-2025 00:39:36 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/0e/93/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075228Z_gen_009428_supernova_g4_detsim_20251115T172212Z_reco.root"
25-Nov-2025 00:39:36 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/0e/93/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075228Z_gen_009428_supernova_g4_detsim_20251115T172212Z_reco.root"
Begin processing the 916th record. run: 8378 subRun: 0 event: 94270173 at 25-Nov-2025 00:39:36 CET
Begin processing the 917th record. run: 8378 subRun: 0 event: 94270252 at 25-Nov-2025 00:39:36 CET
Begin processing the 918th record. run: 8378 subRun: 0 event: 94270359 at 25-Nov-2025 00:39:37 CET
Begin processing the 919th record. run: 8378 subRun: 0 event: 94271035 at 25-Nov-2025 00:39:37 CET
Begin processing the 920th record. run: 8378 subRun: 0 event: 94272930 at 25-Nov-2025 00:39:37 CET
Begin processing the 921st record. run: 8378 subRun: 0 event: 94274725 at 25-Nov-2025 00:39:37 CET
Begin processing the 922nd record. run: 8378 subRun: 0 event: 94277489 at 25-Nov-2025 00:39:37 CET
Begin processing the 923rd record. run: 8378 subRun: 0 event: 94278013 at 25-Nov-2025 00:39:37 CET
Begin processing the 924th record. run: 8378 subRun: 0 event: 94279346 at 25-Nov-2025 00:39:37 CET
25-Nov-2025 00:39:37 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/0e/93/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075228Z_gen_009428_supernova_g4_detsim_20251115T172212Z_reco.root"
25-Nov-2025 00:39:37 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/ac/e8/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075229Z_gen_009429_supernova_g4_detsim_20251115T194120Z_reco.root"
25-Nov-2025 00:39:37 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/ac/e8/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075229Z_gen_009429_supernova_g4_detsim_20251115T194120Z_reco.root"
Begin processing the 925th record. run: 8378 subRun: 0 event: 94280131 at 25-Nov-2025 00:39:38 CET
Begin processing the 926th record. run: 8378 subRun: 0 event: 94280252 at 25-Nov-2025 00:39:38 CET
Begin processing the 927th record. run: 8378 subRun: 0 event: 94280359 at 25-Nov-2025 00:39:38 CET
Begin processing the 928th record. run: 8378 subRun: 0 event: 94283891 at 25-Nov-2025 00:39:38 CET
Begin processing the 929th record. run: 8378 subRun: 0 event: 94285365 at 25-Nov-2025 00:39:38 CET
Begin processing the 930th record. run: 8378 subRun: 0 event: 94287119 at 25-Nov-2025 00:39:38 CET
Begin processing the 931st record. run: 8378 subRun: 0 event: 94287629 at 25-Nov-2025 00:39:38 CET
25-Nov-2025 00:39:38 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/ac/e8/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075229Z_gen_009429_supernova_g4_detsim_20251115T194120Z_reco.root"
25-Nov-2025 00:39:38 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/de/13/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075233Z_gen_009437_supernova_g4_detsim_20251115T194317Z_reco.root"
25-Nov-2025 00:39:39 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/de/13/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075233Z_gen_009437_supernova_g4_detsim_20251115T194317Z_reco.root"
Begin processing the 932nd record. run: 8378 subRun: 0 event: 94360069 at 25-Nov-2025 00:39:39 CET
Begin processing the 933rd record. run: 8378 subRun: 0 event: 94360252 at 25-Nov-2025 00:39:39 CET
Begin processing the 934th record. run: 8378 subRun: 0 event: 94360359 at 25-Nov-2025 00:39:39 CET
Begin processing the 935th record. run: 8378 subRun: 0 event: 94367119 at 25-Nov-2025 00:39:39 CET
Begin processing the 936th record. run: 8378 subRun: 0 event: 94369212 at 25-Nov-2025 00:39:39 CET
Begin processing the 937th record. run: 8378 subRun: 0 event: 94369346 at 25-Nov-2025 00:39:39 CET
25-Nov-2025 00:39:39 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/de/13/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T075233Z_gen_009437_supernova_g4_detsim_20251115T194317Z_reco.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                             0.0451877     0.0630729     0.154418      0.0626844    0.00847537       937    
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                0.00291046    0.00395964     0.0226347    0.00401924    0.000869309      937    
end_path:triggerAna:TriggerAnaTree     0.0418802     0.0587551     0.150626      0.0582001    0.00825591       937    
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1347.65 MB
  Peak resident set size usage (VmHWM): 609.747 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.

Processing output file prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__ntuple__CAVE-NEUTRON_prod_s004000_l002000_20251124T222729_c18.root
merged pass1_CERN_000019.json
justIN time: 2026-02-08 15:34:28 UTC       justIN version: 01.06.00