justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 250973.3@dunegpschedd02.fnal.gov

Jobsub ID250973.3@dunegpschedd02.fnal.gov
Workflow ID10643
Stage ID1
User nameschellma@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-24 23:13:38
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce504
Last heartbeat2025-11-24 23:28:07
From worker nodeHostnameb9p02p3136.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-24 23:24:15
Input filesmonte-carlo-010643-000003
JobscriptExit code0
Real time2m (165s)
CPU time0m (51s = 30%)
Max RSS bytes611946496 (583 MiB)
Outputting started2025-11-24 23:27:02
Output filesfardet-hd:prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__ntuple__CAVE-NEUTRON_prod_s010000_l002000_20251124T222837_c2.root
Finished2025-11-24 23:28:07
Saved logsjustin-logs:250973.3-dunegpschedd02.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

_supernova_g4_detsim_20251105T222220Z_reco.root"
Begin processing the 764th record. run: 8378 subRun: 0 event: 98360069 at 25-Nov-2025 00:26:53 CET
Begin processing the 765th record. run: 8378 subRun: 0 event: 98360131 at 25-Nov-2025 00:26:54 CET
Begin processing the 766th record. run: 8378 subRun: 0 event: 98360252 at 25-Nov-2025 00:26:54 CET
Begin processing the 767th record. run: 8378 subRun: 0 event: 98361582 at 25-Nov-2025 00:26:54 CET
Begin processing the 768th record. run: 8378 subRun: 0 event: 98361902 at 25-Nov-2025 00:26:54 CET
Begin processing the 769th record. run: 8378 subRun: 0 event: 98361964 at 25-Nov-2025 00:26:54 CET
Begin processing the 770th record. run: 8378 subRun: 0 event: 98362686 at 25-Nov-2025 00:26:54 CET
Begin processing the 771st record. run: 8378 subRun: 0 event: 98364519 at 25-Nov-2025 00:26:54 CET
Begin processing the 772nd record. run: 8378 subRun: 0 event: 98365810 at 25-Nov-2025 00:26:55 CET
Begin processing the 773rd record. run: 8378 subRun: 0 event: 98366045 at 25-Nov-2025 00:26:55 CET
Begin processing the 774th record. run: 8378 subRun: 0 event: 98367119 at 25-Nov-2025 00:26:55 CET
Begin processing the 775th record. run: 8378 subRun: 0 event: 98367489 at 25-Nov-2025 00:26:55 CET
Begin processing the 776th record. run: 8378 subRun: 0 event: 98368085 at 25-Nov-2025 00:26:55 CET
25-Nov-2025 00:26:55 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/5b/34/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T081642Z_gen_009837_supernova_g4_detsim_20251105T222220Z_reco.root"
25-Nov-2025 00:26:55 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/b3/32/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T081705Z_gen_009892_supernova_g4_detsim_20251115T181201Z_reco.root"
25-Nov-2025 00:26:55 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/b3/32/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T081705Z_gen_009892_supernova_g4_detsim_20251115T181201Z_reco.root"
Begin processing the 777th record. run: 8378 subRun: 0 event: 98910252 at 25-Nov-2025 00:26:55 CET
Begin processing the 778th record. run: 8378 subRun: 0 event: 98911616 at 25-Nov-2025 00:26:56 CET
Begin processing the 779th record. run: 8378 subRun: 0 event: 98912686 at 25-Nov-2025 00:26:56 CET
Begin processing the 780th record. run: 8378 subRun: 0 event: 98914519 at 25-Nov-2025 00:26:56 CET
Begin processing the 781st record. run: 8378 subRun: 0 event: 98914725 at 25-Nov-2025 00:26:56 CET
Begin processing the 782nd record. run: 8378 subRun: 0 event: 98915066 at 25-Nov-2025 00:26:56 CET
Begin processing the 783rd record. run: 8378 subRun: 0 event: 98915365 at 25-Nov-2025 00:26:56 CET
Begin processing the 784th record. run: 8378 subRun: 0 event: 98917489 at 25-Nov-2025 00:26:56 CET
Begin processing the 785th record. run: 8378 subRun: 0 event: 98917629 at 25-Nov-2025 00:26:56 CET
Begin processing the 786th record. run: 8378 subRun: 0 event: 98918013 at 25-Nov-2025 00:26:56 CET
Begin processing the 787th record. run: 8378 subRun: 0 event: 98918125 at 25-Nov-2025 00:26:57 CET
Begin processing the 788th record. run: 8378 subRun: 0 event: 98918626 at 25-Nov-2025 00:26:57 CET
Begin processing the 789th record. run: 8378 subRun: 0 event: 98918658 at 25-Nov-2025 00:26:57 CET
Begin processing the 790th record. run: 8378 subRun: 0 event: 98919212 at 25-Nov-2025 00:26:57 CET
25-Nov-2025 00:26:57 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/b3/32/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T081705Z_gen_009892_supernova_g4_detsim_20251115T181201Z_reco.root"
25-Nov-2025 00:26:57 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/3c/30/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T082028Z_gen_009984_supernova_g4_detsim_20251115T174645Z_reco.root"
25-Nov-2025 00:26:57 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/3c/30/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T082028Z_gen_009984_supernova_g4_detsim_20251115T174645Z_reco.root"
Begin processing the 791st record. run: 8378 subRun: 0 event: 99830173 at 25-Nov-2025 00:26:57 CET
Begin processing the 792nd record. run: 8378 subRun: 0 event: 99830359 at 25-Nov-2025 00:26:57 CET
Begin processing the 793rd record. run: 8378 subRun: 0 event: 99831902 at 25-Nov-2025 00:26:58 CET
Begin processing the 794th record. run: 8378 subRun: 0 event: 99832198 at 25-Nov-2025 00:26:58 CET
Begin processing the 795th record. run: 8378 subRun: 0 event: 99832543 at 25-Nov-2025 00:26:58 CET
Begin processing the 796th record. run: 8378 subRun: 0 event: 99833891 at 25-Nov-2025 00:26:58 CET
Begin processing the 797th record. run: 8378 subRun: 0 event: 99837119 at 25-Nov-2025 00:26:58 CET
Begin processing the 798th record. run: 8378 subRun: 0 event: 99838085 at 25-Nov-2025 00:26:58 CET
Begin processing the 799th record. run: 8378 subRun: 0 event: 99838125 at 25-Nov-2025 00:26:58 CET
25-Nov-2025 00:26:58 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/3c/30/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T082028Z_gen_009984_supernova_g4_detsim_20251115T174645Z_reco.root"
25-Nov-2025 00:26:58 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/e3/ed/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T082040Z_gen_009997_supernova_g4_detsim_20251115T195002Z_reco.root"
25-Nov-2025 00:26:58 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/e3/ed/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T082040Z_gen_009997_supernova_g4_detsim_20251115T195002Z_reco.root"
Begin processing the 800th record. run: 8378 subRun: 0 event: 99961035 at 25-Nov-2025 00:26:59 CET
Begin processing the 801st record. run: 8378 subRun: 0 event: 99961582 at 25-Nov-2025 00:26:59 CET
Begin processing the 802nd record. run: 8378 subRun: 0 event: 99963575 at 25-Nov-2025 00:26:59 CET
Begin processing the 803rd record. run: 8378 subRun: 0 event: 99967489 at 25-Nov-2025 00:26:59 CET
Begin processing the 804th record. run: 8378 subRun: 0 event: 99967629 at 25-Nov-2025 00:26:59 CET
Begin processing the 805th record. run: 8378 subRun: 0 event: 99969212 at 25-Nov-2025 00:26:59 CET
25-Nov-2025 00:26:59 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/e3/ed/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T082040Z_gen_009997_supernova_g4_detsim_20251115T195002Z_reco.root"
25-Nov-2025 00:26:59 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/0b/57/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T082045Z_gen_010000_supernova_g4_detsim_20251115T173026Z_reco.root"
25-Nov-2025 00:27:00 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/0b/57/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T082045Z_gen_010000_supernova_g4_detsim_20251115T173026Z_reco.root"
Begin processing the 806th record. run: 8378 subRun: 0 event: 99990359 at 25-Nov-2025 00:27:00 CET
Begin processing the 807th record. run: 8378 subRun: 0 event: 99992198 at 25-Nov-2025 00:27:00 CET
Begin processing the 808th record. run: 8378 subRun: 0 event: 99994125 at 25-Nov-2025 00:27:00 CET
Begin processing the 809th record. run: 8378 subRun: 0 event: 99994519 at 25-Nov-2025 00:27:00 CET
Begin processing the 810th record. run: 8378 subRun: 0 event: 99995700 at 25-Nov-2025 00:27:00 CET
Begin processing the 811th record. run: 8378 subRun: 0 event: 99995859 at 25-Nov-2025 00:27:00 CET
25-Nov-2025 00:27:01 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/0b/57/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T082045Z_gen_010000_supernova_g4_detsim_20251115T173026Z_reco.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                             0.0447639     0.0625098     0.179707      0.0614544     0.0113292       811    
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                0.00287841    0.00383149     0.0258524     0.0039296    0.00114786       811    
end_path:triggerAna:TriggerAnaTree     0.0414745     0.0582936     0.174696      0.0571129     0.0109138       811    
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1342.28 MB
  Peak resident set size usage (VmHWM): 611.946 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.

Processing output file prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__ntuple__CAVE-NEUTRON_prod_s010000_l002000_20251124T222837_c2.root
merged pass1_CERN_000003.json
justIN time: 2026-02-08 15:32:49 UTC       justIN version: 01.06.00