justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 254736.40@dunegpschedd02.fnal.gov

Jobsub ID254736.40@dunegpschedd02.fnal.gov
Workflow ID10863
Stage ID1
User nameschellma@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-28 15:20:07
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce508
Last heartbeat2025-11-28 15:43:04
From worker nodeHostnameb9p22p8993.cern.ch
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-28 15:22:44
Input filesmonte-carlo-010863-000003
JobscriptExit code0
Real time18m (1135s)
CPU time14m (851s = 74%)
Max RSS bytes1402200064 (1337 MiB)
Outputting started2025-11-28 15:41:41
Output filesfardet-hd:prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__ntuple__LATERAL_prod_s046000_l002000_20251127T173559_c2.root
Finished2025-11-28 15:43:04
Saved logsjustin-logs:254736.40-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

601Z_gen_003925_supernova_g4_detsim_20251115T133557Z_reco.root"
Begin processing the 451st record. run: 1860 subRun: 0 event: 39241 at 28-Nov-2025 16:39:42 CET
Begin processing the 452nd record. run: 1860 subRun: 0 event: 39242 at 28-Nov-2025 16:39:46 CET
Begin processing the 453rd record. run: 1860 subRun: 0 event: 39243 at 28-Nov-2025 16:39:48 CET
Begin processing the 454th record. run: 1860 subRun: 0 event: 39244 at 28-Nov-2025 16:39:50 CET
Begin processing the 455th record. run: 1860 subRun: 0 event: 39245 at 28-Nov-2025 16:39:52 CET
Begin processing the 456th record. run: 1860 subRun: 0 event: 39246 at 28-Nov-2025 16:39:54 CET
Begin processing the 457th record. run: 1860 subRun: 0 event: 39247 at 28-Nov-2025 16:39:55 CET
Begin processing the 458th record. run: 1860 subRun: 0 event: 39248 at 28-Nov-2025 16:39:57 CET
Begin processing the 459th record. run: 1860 subRun: 0 event: 39249 at 28-Nov-2025 16:39:59 CET
Begin processing the 460th record. run: 1860 subRun: 0 event: 39250 at 28-Nov-2025 16:40:01 CET
28-Nov-2025 16:40:05 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/3b/ce/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250826T162601Z_gen_003925_supernova_g4_detsim_20251115T133557Z_reco.root"
28-Nov-2025 16:40:05 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/8f/a6/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250826T162651Z_gen_003985_supernova_g4_detsim_20251115T094238Z_reco.root"
28-Nov-2025 16:40:05 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/8f/a6/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250826T162651Z_gen_003985_supernova_g4_detsim_20251115T094238Z_reco.root"
Begin processing the 461st record. run: 1860 subRun: 0 event: 39841 at 28-Nov-2025 16:40:05 CET
Begin processing the 462nd record. run: 1860 subRun: 0 event: 39842 at 28-Nov-2025 16:40:07 CET
Begin processing the 463rd record. run: 1860 subRun: 0 event: 39843 at 28-Nov-2025 16:40:10 CET
Begin processing the 464th record. run: 1860 subRun: 0 event: 39844 at 28-Nov-2025 16:40:11 CET
Begin processing the 465th record. run: 1860 subRun: 0 event: 39845 at 28-Nov-2025 16:40:13 CET
Begin processing the 466th record. run: 1860 subRun: 0 event: 39846 at 28-Nov-2025 16:40:15 CET
Begin processing the 467th record. run: 1860 subRun: 0 event: 39847 at 28-Nov-2025 16:40:19 CET
Begin processing the 468th record. run: 1860 subRun: 0 event: 39848 at 28-Nov-2025 16:40:21 CET
Begin processing the 469th record. run: 1860 subRun: 0 event: 39849 at 28-Nov-2025 16:40:23 CET
Begin processing the 470th record. run: 1860 subRun: 0 event: 39850 at 28-Nov-2025 16:40:26 CET
28-Nov-2025 16:40:28 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/8f/a6/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250826T162651Z_gen_003985_supernova_g4_detsim_20251115T094238Z_reco.root"
28-Nov-2025 16:40:28 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/f6/81/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250826T162728Z_gen_004029_supernova_g4_detsim_20251115T071455Z_reco.root"
28-Nov-2025 16:40:28 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/f6/81/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250826T162728Z_gen_004029_supernova_g4_detsim_20251115T071455Z_reco.root"
Begin processing the 471st record. run: 1860 subRun: 0 event: 40281 at 28-Nov-2025 16:40:29 CET
Begin processing the 472nd record. run: 1860 subRun: 0 event: 40282 at 28-Nov-2025 16:40:30 CET
Begin processing the 473rd record. run: 1860 subRun: 0 event: 40283 at 28-Nov-2025 16:40:32 CET
Begin processing the 474th record. run: 1860 subRun: 0 event: 40284 at 28-Nov-2025 16:40:35 CET
Begin processing the 475th record. run: 1860 subRun: 0 event: 40285 at 28-Nov-2025 16:40:36 CET
Begin processing the 476th record. run: 1860 subRun: 0 event: 40286 at 28-Nov-2025 16:40:38 CET
Begin processing the 477th record. run: 1860 subRun: 0 event: 40287 at 28-Nov-2025 16:40:40 CET
Begin processing the 478th record. run: 1860 subRun: 0 event: 40288 at 28-Nov-2025 16:40:41 CET
Begin processing the 479th record. run: 1860 subRun: 0 event: 40289 at 28-Nov-2025 16:40:43 CET
Begin processing the 480th record. run: 1860 subRun: 0 event: 40290 at 28-Nov-2025 16:40:48 CET
28-Nov-2025 16:40:50 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/f6/81/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250826T162728Z_gen_004029_supernova_g4_detsim_20251115T071455Z_reco.root"
28-Nov-2025 16:40:50 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/75/85/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250826T162742Z_gen_004041_supernova_g4_detsim_20251115T071405Z_reco.root"
28-Nov-2025 16:40:50 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/75/85/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250826T162742Z_gen_004041_supernova_g4_detsim_20251115T071405Z_reco.root"
Begin processing the 481st record. run: 1860 subRun: 0 event: 40401 at 28-Nov-2025 16:40:51 CET
Begin processing the 482nd record. run: 1860 subRun: 0 event: 40402 at 28-Nov-2025 16:40:53 CET
Begin processing the 483rd record. run: 1860 subRun: 0 event: 40403 at 28-Nov-2025 16:40:55 CET
Begin processing the 484th record. run: 1860 subRun: 0 event: 40404 at 28-Nov-2025 16:40:56 CET
Begin processing the 485th record. run: 1860 subRun: 0 event: 40405 at 28-Nov-2025 16:40:59 CET
Begin processing the 486th record. run: 1860 subRun: 0 event: 40406 at 28-Nov-2025 16:41:00 CET
Begin processing the 487th record. run: 1860 subRun: 0 event: 40407 at 28-Nov-2025 16:41:02 CET
Begin processing the 488th record. run: 1860 subRun: 0 event: 40408 at 28-Nov-2025 16:41:04 CET
Begin processing the 489th record. run: 1860 subRun: 0 event: 40409 at 28-Nov-2025 16:41:07 CET
Begin processing the 490th record. run: 1860 subRun: 0 event: 40410 at 28-Nov-2025 16:41:09 CET
28-Nov-2025 16:41:11 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/75/85/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250826T162742Z_gen_004041_supernova_g4_detsim_20251115T071405Z_reco.root"
28-Nov-2025 16:41:11 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/28/f2/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250826T162743Z_gen_004042_supernova_g4_detsim_20251105T185803Z_reco.root"
28-Nov-2025 16:41:11 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/28/f2/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250826T162743Z_gen_004042_supernova_g4_detsim_20251105T185803Z_reco.root"
Begin processing the 491st record. run: 1860 subRun: 0 event: 40411 at 28-Nov-2025 16:41:12 CET
Begin processing the 492nd record. run: 1860 subRun: 0 event: 40412 at 28-Nov-2025 16:41:14 CET
Begin processing the 493rd record. run: 1860 subRun: 0 event: 40413 at 28-Nov-2025 16:41:18 CET
Begin processing the 494th record. run: 1860 subRun: 0 event: 40414 at 28-Nov-2025 16:41:19 CET
Begin processing the 495th record. run: 1860 subRun: 0 event: 40415 at 28-Nov-2025 16:41:21 CET
Begin processing the 496th record. run: 1860 subRun: 0 event: 40416 at 28-Nov-2025 16:41:23 CET
Begin processing the 497th record. run: 1860 subRun: 0 event: 40417 at 28-Nov-2025 16:41:25 CET
Begin processing the 498th record. run: 1860 subRun: 0 event: 40418 at 28-Nov-2025 16:41:28 CET
Begin processing the 499th record. run: 1860 subRun: 0 event: 40419 at 28-Nov-2025 16:41:31 CET
Begin processing the 500th record. run: 1860 subRun: 0 event: 40420 at 28-Nov-2025 16:41:32 CET
28-Nov-2025 16:41:34 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/28/f2/prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250826T162743Z_gen_004042_supernova_g4_detsim_20251105T185803Z_reco.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                             0.780136       1.54033       4.95001       1.29961      0.660286        500    
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                0.00337268    0.00686571     0.0553744    0.00534203    0.00495685       500    
end_path:triggerAna:TriggerAnaTree      0.77479       1.5331        4.94343       1.28927      0.660149        500    
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2146.6 MB
  Peak resident set size usage (VmHWM): 1402.2 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.

Processing output file prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__ntuple__LATERAL_prod_s046000_l002000_20251127T173559_c2.root
merged pass1_CERN_000003.json
justIN time: 2025-12-22 04:45:13 UTC       justIN version: 01.05.03