justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 260469.14@dunegpschedd01.fnal.gov

Jobsub ID260469.14@dunegpschedd01.fnal.gov
Workflow ID10859
Stage ID1
User nameschellma@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-28 15:20:03
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce509
Last heartbeat2025-11-28 15:49:16
From worker nodeHostnameb9p19p8505.cern.ch
cpuinfoIntel(R) Xeon(R) Silver 4216 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-28 15:21:15
Input filesmonte-carlo-010859-000028
JobscriptExit code0
Real time26m (1574s)
CPU time20m (1223s = 77%)
Max RSS bytes1401270272 (1336 MiB)
Outputting started2025-11-28 15:47:31
Output filesfardet-hd:prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__ntuple__LATERAL_prod_s038000_l002000_20251127T173401_c27.root
Finished2025-11-28 15:49:16
Saved logsjustin-logs:260469.14-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Z_gen_004203_supernova_g4_detsim_20251115T084610Z_reco.root"
Begin processing the 451st record. run: 8291 subRun: 0 event: 42021 at 28-Nov-2025 16:44:33 CET
Begin processing the 452nd record. run: 8291 subRun: 0 event: 42022 at 28-Nov-2025 16:44:38 CET
Begin processing the 453rd record. run: 8291 subRun: 0 event: 42023 at 28-Nov-2025 16:44:42 CET
Begin processing the 454th record. run: 8291 subRun: 0 event: 42024 at 28-Nov-2025 16:44:45 CET
Begin processing the 455th record. run: 8291 subRun: 0 event: 42025 at 28-Nov-2025 16:44:47 CET
Begin processing the 456th record. run: 8291 subRun: 0 event: 42026 at 28-Nov-2025 16:44:49 CET
Begin processing the 457th record. run: 8291 subRun: 0 event: 42027 at 28-Nov-2025 16:44:54 CET
Begin processing the 458th record. run: 8291 subRun: 0 event: 42028 at 28-Nov-2025 16:44:56 CET
Begin processing the 459th record. run: 8291 subRun: 0 event: 42029 at 28-Nov-2025 16:44:57 CET
Begin processing the 460th record. run: 8291 subRun: 0 event: 42030 at 28-Nov-2025 16:45:00 CET
28-Nov-2025 16:45:04 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/0f/13/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T165531Z_gen_004203_supernova_g4_detsim_20251115T084610Z_reco.root"
28-Nov-2025 16:45:04 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/1e/8f/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T165532Z_gen_004209_supernova_g4_detsim_20251115T082009Z_reco.root"
28-Nov-2025 16:45:04 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/1e/8f/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T165532Z_gen_004209_supernova_g4_detsim_20251115T082009Z_reco.root"
Begin processing the 461st record. run: 8291 subRun: 0 event: 42081 at 28-Nov-2025 16:45:05 CET
Begin processing the 462nd record. run: 8291 subRun: 0 event: 42082 at 28-Nov-2025 16:45:07 CET
Begin processing the 463rd record. run: 8291 subRun: 0 event: 42083 at 28-Nov-2025 16:45:10 CET
Begin processing the 464th record. run: 8291 subRun: 0 event: 42084 at 28-Nov-2025 16:45:12 CET
Begin processing the 465th record. run: 8291 subRun: 0 event: 42085 at 28-Nov-2025 16:45:14 CET
Begin processing the 466th record. run: 8291 subRun: 0 event: 42086 at 28-Nov-2025 16:45:18 CET
Begin processing the 467th record. run: 8291 subRun: 0 event: 42087 at 28-Nov-2025 16:45:22 CET
Begin processing the 468th record. run: 8291 subRun: 0 event: 42088 at 28-Nov-2025 16:45:25 CET
Begin processing the 469th record. run: 8291 subRun: 0 event: 42089 at 28-Nov-2025 16:45:27 CET
Begin processing the 470th record. run: 8291 subRun: 0 event: 42090 at 28-Nov-2025 16:45:32 CET
28-Nov-2025 16:45:35 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/1e/8f/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T165532Z_gen_004209_supernova_g4_detsim_20251115T082009Z_reco.root"
28-Nov-2025 16:45:35 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/e8/ba/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T165544Z_gen_005736_supernova_g4_detsim_20251115T123620Z_reco.root"
28-Nov-2025 16:45:35 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/e8/ba/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T165544Z_gen_005736_supernova_g4_detsim_20251115T123620Z_reco.root"
Begin processing the 471st record. run: 8291 subRun: 0 event: 57351 at 28-Nov-2025 16:45:36 CET
Begin processing the 472nd record. run: 8291 subRun: 0 event: 57352 at 28-Nov-2025 16:45:39 CET
Begin processing the 473rd record. run: 8291 subRun: 0 event: 57353 at 28-Nov-2025 16:45:41 CET
Begin processing the 474th record. run: 8291 subRun: 0 event: 57354 at 28-Nov-2025 16:45:44 CET
Begin processing the 475th record. run: 8291 subRun: 0 event: 57355 at 28-Nov-2025 16:45:47 CET
Begin processing the 476th record. run: 8291 subRun: 0 event: 57356 at 28-Nov-2025 16:45:49 CET
Begin processing the 477th record. run: 8291 subRun: 0 event: 57357 at 28-Nov-2025 16:45:52 CET
Begin processing the 478th record. run: 8291 subRun: 0 event: 57358 at 28-Nov-2025 16:45:55 CET
Begin processing the 479th record. run: 8291 subRun: 0 event: 57359 at 28-Nov-2025 16:45:57 CET
Begin processing the 480th record. run: 8291 subRun: 0 event: 57360 at 28-Nov-2025 16:46:05 CET
28-Nov-2025 16:46:08 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/e8/ba/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T165544Z_gen_005736_supernova_g4_detsim_20251115T123620Z_reco.root"
28-Nov-2025 16:46:08 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/bf/7e/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T183048Z_gen_009106_supernova_g4_detsim_20251115T123620Z_reco.root"
28-Nov-2025 16:46:08 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/bf/7e/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T183048Z_gen_009106_supernova_g4_detsim_20251115T123620Z_reco.root"
Begin processing the 481st record. run: 8278 subRun: 0 event: 91051 at 28-Nov-2025 16:46:08 CET
Begin processing the 482nd record. run: 8278 subRun: 0 event: 91052 at 28-Nov-2025 16:46:11 CET
Begin processing the 483rd record. run: 8278 subRun: 0 event: 91053 at 28-Nov-2025 16:46:14 CET
Begin processing the 484th record. run: 8278 subRun: 0 event: 91054 at 28-Nov-2025 16:46:16 CET
Begin processing the 485th record. run: 8278 subRun: 0 event: 91055 at 28-Nov-2025 16:46:19 CET
Begin processing the 486th record. run: 8278 subRun: 0 event: 91056 at 28-Nov-2025 16:46:21 CET
Begin processing the 487th record. run: 8278 subRun: 0 event: 91057 at 28-Nov-2025 16:46:23 CET
Begin processing the 488th record. run: 8278 subRun: 0 event: 91058 at 28-Nov-2025 16:46:26 CET
Begin processing the 489th record. run: 8278 subRun: 0 event: 91059 at 28-Nov-2025 16:46:31 CET
Begin processing the 490th record. run: 8278 subRun: 0 event: 91060 at 28-Nov-2025 16:46:33 CET
28-Nov-2025 16:46:36 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/bf/7e/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T183048Z_gen_009106_supernova_g4_detsim_20251115T123620Z_reco.root"
28-Nov-2025 16:46:36 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/68/cd/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T183108Z_gen_009107_supernova_g4_detsim_20251115T123118Z_reco.root"
28-Nov-2025 16:46:36 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/68/cd/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T183108Z_gen_009107_supernova_g4_detsim_20251115T123118Z_reco.root"
Begin processing the 491st record. run: 8278 subRun: 0 event: 91061 at 28-Nov-2025 16:46:36 CET
Begin processing the 492nd record. run: 8278 subRun: 0 event: 91062 at 28-Nov-2025 16:46:39 CET
Begin processing the 493rd record. run: 8278 subRun: 0 event: 91063 at 28-Nov-2025 16:46:43 CET
Begin processing the 494th record. run: 8278 subRun: 0 event: 91064 at 28-Nov-2025 16:46:46 CET
Begin processing the 495th record. run: 8278 subRun: 0 event: 91065 at 28-Nov-2025 16:46:48 CET
Begin processing the 496th record. run: 8278 subRun: 0 event: 91066 at 28-Nov-2025 16:46:51 CET
Begin processing the 497th record. run: 8278 subRun: 0 event: 91067 at 28-Nov-2025 16:46:53 CET
Begin processing the 498th record. run: 8278 subRun: 0 event: 91068 at 28-Nov-2025 16:47:03 CET
Begin processing the 499th record. run: 8278 subRun: 0 event: 91069 at 28-Nov-2025 16:47:07 CET
Begin processing the 500th record. run: 8278 subRun: 0 event: 91070 at 28-Nov-2025 16:47:10 CET
28-Nov-2025 16:47:11 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/68/cd/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250930T183108Z_gen_009107_supernova_g4_detsim_20251115T123118Z_reco.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                             0.938119       2.18808       16.3274       1.74848       1.30318        500    
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                 0.0033661    0.00678011     0.0395309    0.00546455    0.00436465       500    
end_path:triggerAna:TriggerAnaTree     0.933226       2.18096       16.322        1.74121       1.3033         500    
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2154.02 MB
  Peak resident set size usage (VmHWM): 1401.27 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.

Processing output file prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__ntuple__LATERAL_prod_s038000_l002000_20251127T173401_c27.root
merged pass1_CERN_000028.json
justIN time: 2025-12-22 04:44:50 UTC       justIN version: 01.05.03