justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 254736.57@dunegpschedd02.fnal.gov

Jobsub ID254736.57@dunegpschedd02.fnal.gov
Workflow ID10863
Stage ID1
User nameschellma@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-28 15:20:07
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce508
Last heartbeat2025-11-28 15:43:06
From worker nodeHostnameb9p22p8993.cern.ch
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-28 15:23:02
Input filesmonte-carlo-010863-000026
JobscriptExit code0
Real time18m (1119s)
CPU time14m (853s = 76%)
Max RSS bytes1395875840 (1331 MiB)
Outputting started2025-11-28 15:41:43
Output filesfardet-hd:prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__ntuple__LATERAL_prod_s046000_l002000_20251127T173559_c25.root
Finished2025-11-28 15:43:06
Saved logsjustin-logs:254736.57-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Z_gen_006537_supernova_g4_detsim_20251115T110629Z_reco.root"
Begin processing the 451st record. run: 8278 subRun: 0 event: 65361 at 28-Nov-2025 16:39:46 CET
Begin processing the 452nd record. run: 8278 subRun: 0 event: 65362 at 28-Nov-2025 16:39:49 CET
Begin processing the 453rd record. run: 8278 subRun: 0 event: 65363 at 28-Nov-2025 16:39:52 CET
Begin processing the 454th record. run: 8278 subRun: 0 event: 65364 at 28-Nov-2025 16:39:55 CET
Begin processing the 455th record. run: 8278 subRun: 0 event: 65365 at 28-Nov-2025 16:39:56 CET
Begin processing the 456th record. run: 8278 subRun: 0 event: 65366 at 28-Nov-2025 16:39:58 CET
Begin processing the 457th record. run: 8278 subRun: 0 event: 65367 at 28-Nov-2025 16:40:00 CET
Begin processing the 458th record. run: 8278 subRun: 0 event: 65368 at 28-Nov-2025 16:40:02 CET
Begin processing the 459th record. run: 8278 subRun: 0 event: 65369 at 28-Nov-2025 16:40:04 CET
Begin processing the 460th record. run: 8278 subRun: 0 event: 65370 at 28-Nov-2025 16:40:06 CET
28-Nov-2025 16:40:09 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/e0/18/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T120537Z_gen_006537_supernova_g4_detsim_20251115T110629Z_reco.root"
28-Nov-2025 16:40:09 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/1e/99/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T120548Z_gen_003769_supernova_g4_detsim_20251115T131347Z_reco.root"
28-Nov-2025 16:40:09 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/1e/99/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T120548Z_gen_003769_supernova_g4_detsim_20251115T131347Z_reco.root"
Begin processing the 461st record. run: 8291 subRun: 0 event: 37681 at 28-Nov-2025 16:40:10 CET
Begin processing the 462nd record. run: 8291 subRun: 0 event: 37682 at 28-Nov-2025 16:40:12 CET
Begin processing the 463rd record. run: 8291 subRun: 0 event: 37683 at 28-Nov-2025 16:40:14 CET
Begin processing the 464th record. run: 8291 subRun: 0 event: 37684 at 28-Nov-2025 16:40:16 CET
Begin processing the 465th record. run: 8291 subRun: 0 event: 37685 at 28-Nov-2025 16:40:18 CET
Begin processing the 466th record. run: 8291 subRun: 0 event: 37686 at 28-Nov-2025 16:40:20 CET
Begin processing the 467th record. run: 8291 subRun: 0 event: 37687 at 28-Nov-2025 16:40:23 CET
Begin processing the 468th record. run: 8291 subRun: 0 event: 37688 at 28-Nov-2025 16:40:25 CET
Begin processing the 469th record. run: 8291 subRun: 0 event: 37689 at 28-Nov-2025 16:40:27 CET
Begin processing the 470th record. run: 8291 subRun: 0 event: 37690 at 28-Nov-2025 16:40:30 CET
28-Nov-2025 16:40:32 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/1e/99/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T120548Z_gen_003769_supernova_g4_detsim_20251115T131347Z_reco.root"
28-Nov-2025 16:40:32 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/ca/f8/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T120553Z_gen_006567_supernova_g4_detsim_20251115T133156Z_reco.root"
28-Nov-2025 16:40:32 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/ca/f8/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T120553Z_gen_006567_supernova_g4_detsim_20251115T133156Z_reco.root"
Begin processing the 471st record. run: 8278 subRun: 0 event: 65661 at 28-Nov-2025 16:40:33 CET
Begin processing the 472nd record. run: 8278 subRun: 0 event: 65662 at 28-Nov-2025 16:40:34 CET
Begin processing the 473rd record. run: 8278 subRun: 0 event: 65663 at 28-Nov-2025 16:40:36 CET
Begin processing the 474th record. run: 8278 subRun: 0 event: 65664 at 28-Nov-2025 16:40:38 CET
Begin processing the 475th record. run: 8278 subRun: 0 event: 65665 at 28-Nov-2025 16:40:40 CET
Begin processing the 476th record. run: 8278 subRun: 0 event: 65666 at 28-Nov-2025 16:40:42 CET
Begin processing the 477th record. run: 8278 subRun: 0 event: 65667 at 28-Nov-2025 16:40:44 CET
Begin processing the 478th record. run: 8278 subRun: 0 event: 65668 at 28-Nov-2025 16:40:45 CET
Begin processing the 479th record. run: 8278 subRun: 0 event: 65669 at 28-Nov-2025 16:40:47 CET
Begin processing the 480th record. run: 8278 subRun: 0 event: 65670 at 28-Nov-2025 16:40:52 CET
28-Nov-2025 16:40:54 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/ca/f8/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T120553Z_gen_006567_supernova_g4_detsim_20251115T133156Z_reco.root"
28-Nov-2025 16:40:54 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/c8/ff/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T120607Z_gen_006589_supernova_g4_detsim_20251115T083129Z_reco.root"
28-Nov-2025 16:40:54 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/c8/ff/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T120607Z_gen_006589_supernova_g4_detsim_20251115T083129Z_reco.root"
Begin processing the 481st record. run: 8278 subRun: 0 event: 65881 at 28-Nov-2025 16:40:55 CET
Begin processing the 482nd record. run: 8278 subRun: 0 event: 65882 at 28-Nov-2025 16:40:56 CET
Begin processing the 483rd record. run: 8278 subRun: 0 event: 65883 at 28-Nov-2025 16:40:58 CET
Begin processing the 484th record. run: 8278 subRun: 0 event: 65884 at 28-Nov-2025 16:41:00 CET
Begin processing the 485th record. run: 8278 subRun: 0 event: 65885 at 28-Nov-2025 16:41:02 CET
Begin processing the 486th record. run: 8278 subRun: 0 event: 65886 at 28-Nov-2025 16:41:03 CET
Begin processing the 487th record. run: 8278 subRun: 0 event: 65887 at 28-Nov-2025 16:41:06 CET
Begin processing the 488th record. run: 8278 subRun: 0 event: 65888 at 28-Nov-2025 16:41:07 CET
Begin processing the 489th record. run: 8278 subRun: 0 event: 65889 at 28-Nov-2025 16:41:10 CET
Begin processing the 490th record. run: 8278 subRun: 0 event: 65890 at 28-Nov-2025 16:41:13 CET
28-Nov-2025 16:41:14 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/c8/ff/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T120607Z_gen_006589_supernova_g4_detsim_20251115T083129Z_reco.root"
28-Nov-2025 16:41:14 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/a3/d9/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T120616Z_gen_006599_supernova_g4_detsim_20251106T101249Z_reco.root"
28-Nov-2025 16:41:14 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/a3/d9/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T120616Z_gen_006599_supernova_g4_detsim_20251106T101249Z_reco.root"
Begin processing the 491st record. run: 8278 subRun: 0 event: 65981 at 28-Nov-2025 16:41:15 CET
Begin processing the 492nd record. run: 8278 subRun: 0 event: 65982 at 28-Nov-2025 16:41:17 CET
Begin processing the 493rd record. run: 8278 subRun: 0 event: 65983 at 28-Nov-2025 16:41:20 CET
Begin processing the 494th record. run: 8278 subRun: 0 event: 65984 at 28-Nov-2025 16:41:21 CET
Begin processing the 495th record. run: 8278 subRun: 0 event: 65985 at 28-Nov-2025 16:41:24 CET
Begin processing the 496th record. run: 8278 subRun: 0 event: 65986 at 28-Nov-2025 16:41:25 CET
Begin processing the 497th record. run: 8278 subRun: 0 event: 65987 at 28-Nov-2025 16:41:27 CET
Begin processing the 498th record. run: 8278 subRun: 0 event: 65988 at 28-Nov-2025 16:41:30 CET
Begin processing the 499th record. run: 8278 subRun: 0 event: 65989 at 28-Nov-2025 16:41:32 CET
Begin processing the 500th record. run: 8278 subRun: 0 event: 65990 at 28-Nov-2025 16:41:33 CET
28-Nov-2025 16:41:36 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/a3/d9/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T120616Z_gen_006599_supernova_g4_detsim_20251106T101249Z_reco.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                             0.776562       1.52017       3.89098       1.26556      0.646825        500    
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                0.00308404    0.00640068     0.0697653    0.00514126     0.004894        500    
end_path:triggerAna:TriggerAnaTree     0.771442       1.51339       3.88526       1.24402      0.646888        500    
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2144.45 MB
  Peak resident set size usage (VmHWM): 1395.88 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.

Processing output file prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__ntuple__LATERAL_prod_s046000_l002000_20251127T173559_c25.root
merged pass1_CERN_000026.json
justIN time: 2025-12-22 04:44:32 UTC       justIN version: 01.05.03