justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 250939.4@dunegpschedd02.fnal.gov

Jobsub ID250939.4@dunegpschedd02.fnal.gov
Workflow ID10636
Stage ID1
User nameschellma@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-24 22:25:37
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce509
Last heartbeat2025-11-24 22:56:34
From worker nodeHostnameb9p12p6137.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-24 22:34:26
Input filesmonte-carlo-010636-000003
JobscriptExit code0
Real time20m (1257s)
CPU time5m (349s = 27%)
Max RSS bytes1295097856 (1235 MiB)
Outputting started2025-11-24 22:55:23
Output filesfardet-hd:prodgenie_nu_dune10kt_1x2x6__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__ntuple__NU_prod_s004000_l002000_20251124T215601_c2.root
Finished2025-11-24 22:56:34
Saved logsjustin-logs:250939.4-dunegpschedd02.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

: 4210 at 24-Nov-2025 23:54:53 CET
24-Nov-2025 23:54:54 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/b5/b4/prodgenie_nu_dune10kt_1x2x6_20251003T181230Z_gen_000421_g4_detsim_20251106T161313Z_reco.root"
24-Nov-2025 23:54:54 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/cc/f5/prodgenie_nu_dune10kt_1x2x6_20251003T181234Z_gen_000428_g4_detsim_20251116T142141Z_reco.root"
24-Nov-2025 23:54:54 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/cc/f5/prodgenie_nu_dune10kt_1x2x6_20251003T181234Z_gen_000428_g4_detsim_20251116T142141Z_reco.root"
Begin processing the 951st record. run: 8525 subRun: 0 event: 4271 at 24-Nov-2025 23:54:54 CET
Begin processing the 952nd record. run: 8525 subRun: 0 event: 4272 at 24-Nov-2025 23:54:55 CET
Begin processing the 953rd record. run: 8525 subRun: 0 event: 4273 at 24-Nov-2025 23:54:55 CET
Begin processing the 954th record. run: 8525 subRun: 0 event: 4274 at 24-Nov-2025 23:54:55 CET
Begin processing the 955th record. run: 8525 subRun: 0 event: 4275 at 24-Nov-2025 23:54:55 CET
Begin processing the 956th record. run: 8525 subRun: 0 event: 4276 at 24-Nov-2025 23:54:56 CET
Begin processing the 957th record. run: 8525 subRun: 0 event: 4277 at 24-Nov-2025 23:54:57 CET
Begin processing the 958th record. run: 8525 subRun: 0 event: 4278 at 24-Nov-2025 23:54:58 CET
Begin processing the 959th record. run: 8525 subRun: 0 event: 4279 at 24-Nov-2025 23:54:58 CET
Begin processing the 960th record. run: 8525 subRun: 0 event: 4280 at 24-Nov-2025 23:54:59 CET
24-Nov-2025 23:55:00 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/cc/f5/prodgenie_nu_dune10kt_1x2x6_20251003T181234Z_gen_000428_g4_detsim_20251116T142141Z_reco.root"
24-Nov-2025 23:55:00 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/e5/5e/prodgenie_nu_dune10kt_1x2x6_20251003T181234Z_gen_000432_g4_detsim_20251116T113045Z_reco.root"
24-Nov-2025 23:55:00 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/e5/5e/prodgenie_nu_dune10kt_1x2x6_20251003T181234Z_gen_000432_g4_detsim_20251116T113045Z_reco.root"
Begin processing the 961st record. run: 8525 subRun: 0 event: 4311 at 24-Nov-2025 23:55:00 CET
Begin processing the 962nd record. run: 8525 subRun: 0 event: 4312 at 24-Nov-2025 23:55:01 CET
Begin processing the 963rd record. run: 8525 subRun: 0 event: 4313 at 24-Nov-2025 23:55:01 CET
Begin processing the 964th record. run: 8525 subRun: 0 event: 4314 at 24-Nov-2025 23:55:01 CET
Begin processing the 965th record. run: 8525 subRun: 0 event: 4315 at 24-Nov-2025 23:55:01 CET
Begin processing the 966th record. run: 8525 subRun: 0 event: 4316 at 24-Nov-2025 23:55:03 CET
Begin processing the 967th record. run: 8525 subRun: 0 event: 4317 at 24-Nov-2025 23:55:03 CET
Begin processing the 968th record. run: 8525 subRun: 0 event: 4318 at 24-Nov-2025 23:55:03 CET
Begin processing the 969th record. run: 8525 subRun: 0 event: 4319 at 24-Nov-2025 23:55:04 CET
Begin processing the 970th record. run: 8525 subRun: 0 event: 4320 at 24-Nov-2025 23:55:04 CET
24-Nov-2025 23:55:04 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/e5/5e/prodgenie_nu_dune10kt_1x2x6_20251003T181234Z_gen_000432_g4_detsim_20251116T113045Z_reco.root"
24-Nov-2025 23:55:04 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/ca/f6/prodgenie_nu_dune10kt_1x2x6_20251003T181235Z_gen_000434_g4_detsim_20251116T104240Z_reco.root"
24-Nov-2025 23:55:05 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/ca/f6/prodgenie_nu_dune10kt_1x2x6_20251003T181235Z_gen_000434_g4_detsim_20251116T104240Z_reco.root"
Begin processing the 971st record. run: 8525 subRun: 0 event: 4331 at 24-Nov-2025 23:55:05 CET
Begin processing the 972nd record. run: 8525 subRun: 0 event: 4332 at 24-Nov-2025 23:55:05 CET
Begin processing the 973rd record. run: 8525 subRun: 0 event: 4333 at 24-Nov-2025 23:55:05 CET
Begin processing the 974th record. run: 8525 subRun: 0 event: 4334 at 24-Nov-2025 23:55:06 CET
Begin processing the 975th record. run: 8525 subRun: 0 event: 4335 at 24-Nov-2025 23:55:06 CET
Begin processing the 976th record. run: 8525 subRun: 0 event: 4336 at 24-Nov-2025 23:55:07 CET
Begin processing the 977th record. run: 8525 subRun: 0 event: 4337 at 24-Nov-2025 23:55:07 CET
Begin processing the 978th record. run: 8525 subRun: 0 event: 4338 at 24-Nov-2025 23:55:08 CET
Begin processing the 979th record. run: 8525 subRun: 0 event: 4339 at 24-Nov-2025 23:55:08 CET
Begin processing the 980th record. run: 8525 subRun: 0 event: 4340 at 24-Nov-2025 23:55:08 CET
24-Nov-2025 23:55:08 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/ca/f6/prodgenie_nu_dune10kt_1x2x6_20251003T181235Z_gen_000434_g4_detsim_20251116T104240Z_reco.root"
24-Nov-2025 23:55:08 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/b2/0d/prodgenie_nu_dune10kt_1x2x6_20251003T181236Z_gen_000436_g4_detsim_20251116T104546Z_reco.root"
24-Nov-2025 23:55:09 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/b2/0d/prodgenie_nu_dune10kt_1x2x6_20251003T181236Z_gen_000436_g4_detsim_20251116T104546Z_reco.root"
Begin processing the 981st record. run: 8525 subRun: 0 event: 4351 at 24-Nov-2025 23:55:09 CET
Begin processing the 982nd record. run: 8525 subRun: 0 event: 4352 at 24-Nov-2025 23:55:09 CET
Begin processing the 983rd record. run: 8525 subRun: 0 event: 4353 at 24-Nov-2025 23:55:09 CET
Begin processing the 984th record. run: 8525 subRun: 0 event: 4354 at 24-Nov-2025 23:55:10 CET
Begin processing the 985th record. run: 8525 subRun: 0 event: 4355 at 24-Nov-2025 23:55:10 CET
Begin processing the 986th record. run: 8525 subRun: 0 event: 4356 at 24-Nov-2025 23:55:10 CET
Begin processing the 987th record. run: 8525 subRun: 0 event: 4357 at 24-Nov-2025 23:55:10 CET
Begin processing the 988th record. run: 8525 subRun: 0 event: 4358 at 24-Nov-2025 23:55:11 CET
Begin processing the 989th record. run: 8525 subRun: 0 event: 4359 at 24-Nov-2025 23:55:11 CET
Begin processing the 990th record. run: 8525 subRun: 0 event: 4360 at 24-Nov-2025 23:55:11 CET
24-Nov-2025 23:55:11 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/b2/0d/prodgenie_nu_dune10kt_1x2x6_20251003T181236Z_gen_000436_g4_detsim_20251116T104546Z_reco.root"
24-Nov-2025 23:55:11 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/0e/8e/prodgenie_nu_dune10kt_1x2x6_20251003T181236Z_gen_000437_g4_detsim_20251116T103741Z_reco.root"
24-Nov-2025 23:55:11 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/0e/8e/prodgenie_nu_dune10kt_1x2x6_20251003T181236Z_gen_000437_g4_detsim_20251116T103741Z_reco.root"
Begin processing the 991st record. run: 8525 subRun: 0 event: 4361 at 24-Nov-2025 23:55:12 CET
Begin processing the 992nd record. run: 8525 subRun: 0 event: 4362 at 24-Nov-2025 23:55:13 CET
Begin processing the 993rd record. run: 8525 subRun: 0 event: 4363 at 24-Nov-2025 23:55:15 CET
Begin processing the 994th record. run: 8525 subRun: 0 event: 4364 at 24-Nov-2025 23:55:16 CET
Begin processing the 995th record. run: 8525 subRun: 0 event: 4365 at 24-Nov-2025 23:55:17 CET
Begin processing the 996th record. run: 8525 subRun: 0 event: 4366 at 24-Nov-2025 23:55:18 CET
Begin processing the 997th record. run: 8525 subRun: 0 event: 4367 at 24-Nov-2025 23:55:18 CET
Begin processing the 998th record. run: 8525 subRun: 0 event: 4368 at 24-Nov-2025 23:55:19 CET
Begin processing the 999th record. run: 8525 subRun: 0 event: 4369 at 24-Nov-2025 23:55:19 CET
Begin processing the 1000th record. run: 8525 subRun: 0 event: 4370 at 24-Nov-2025 23:55:19 CET
24-Nov-2025 23:55:20 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/0e/8e/prodgenie_nu_dune10kt_1x2x6_20251003T181236Z_gen_000437_g4_detsim_20251116T103741Z_reco.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                             0.0472302     0.258766       2.77453       0.14086      0.337582       1000    
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                0.00308345    0.00597098     0.057003     0.00419793    0.00523912      1000    
end_path:triggerAna:TriggerAnaTree     0.0421546     0.252332       2.77013      0.133863      0.337611       1000    
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2052.13 MB
  Peak resident set size usage (VmHWM): 1295.1 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.

Processing output file prodgenie_nu_dune10kt_1x2x6__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__ntuple__NU_prod_s004000_l002000_20251124T215601_c2.root
merged pass1_CERN_000003.json
justIN time: 2026-02-08 15:33:52 UTC       justIN version: 01.06.00