Jobsub ID 248598.7@dunegpschedd02.fnal.gov

Jobsub ID	248598.7@dunegpschedd02.fnal.gov
Workflow ID	10384
Stage ID	1
User name	schellma@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-19 21:12:20
Site	CERN
Entry	CMSHTPC_T2_CH_CERN_ce508
Last heartbeat	2025-11-19 22:52:34
From worker node	Hostname	b9p22p5796.cern.ch
	cpuinfo	AMD EPYC 7302 16-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	343800 (95 hours)
	GPU
	Inner Apptainer?	True
Job state	aborted
Started	2025-11-19 22:31:49
Input files	monte-carlo-010384-000003
Outputting started	2025-11-19 22:36:00
Output files	usertests:prod_eminus_1-500MeV_dune10kt_1x2x6__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__s6000__l2000__ntuple__EMINUS_20251119T210211_c2.root
Finished	2025-11-19 22:52:34
List job events Cached HTCondor job logs
Jobscript log (last 10,000 characters)

e10kt_1x2x6_20251002T234451Z_gen_003502_g4_detsim_20251115T202937Z_reco.root"
19-Nov-2025 23:35:42 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/5d/f8/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T234454Z_gen_003511_g4_detsim_20251115T190324Z_reco.root"
19-Nov-2025 23:35:42 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/5d/f8/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T234454Z_gen_003511_g4_detsim_20251115T190324Z_reco.root"
Begin processing the 911th record. run: 8428 subRun: 0 event: 35101 at 19-Nov-2025 23:35:42 CET
Begin processing the 912th record. run: 8428 subRun: 0 event: 35102 at 19-Nov-2025 23:35:43 CET
Begin processing the 913th record. run: 8428 subRun: 0 event: 35103 at 19-Nov-2025 23:35:43 CET
Begin processing the 914th record. run: 8428 subRun: 0 event: 35104 at 19-Nov-2025 23:35:43 CET
Begin processing the 915th record. run: 8428 subRun: 0 event: 35105 at 19-Nov-2025 23:35:43 CET
Begin processing the 916th record. run: 8428 subRun: 0 event: 35106 at 19-Nov-2025 23:35:43 CET
Begin processing the 917th record. run: 8428 subRun: 0 event: 35107 at 19-Nov-2025 23:35:43 CET
Begin processing the 918th record. run: 8428 subRun: 0 event: 35108 at 19-Nov-2025 23:35:43 CET
Begin processing the 919th record. run: 8428 subRun: 0 event: 35109 at 19-Nov-2025 23:35:44 CET
Begin processing the 920th record. run: 8428 subRun: 0 event: 35110 at 19-Nov-2025 23:35:44 CET
19-Nov-2025 23:35:44 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/5d/f8/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T234454Z_gen_003511_g4_detsim_20251115T190324Z_reco.root"
19-Nov-2025 23:35:44 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/85/97/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T234454Z_gen_003512_g4_detsim_20251115T190404Z_reco.root"
19-Nov-2025 23:35:44 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/85/97/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T234454Z_gen_003512_g4_detsim_20251115T190404Z_reco.root"
Begin processing the 921st record. run: 8428 subRun: 0 event: 35111 at 19-Nov-2025 23:35:44 CET
Begin processing the 922nd record. run: 8428 subRun: 0 event: 35112 at 19-Nov-2025 23:35:44 CET
Begin processing the 923rd record. run: 8428 subRun: 0 event: 35113 at 19-Nov-2025 23:35:44 CET
Begin processing the 924th record. run: 8428 subRun: 0 event: 35114 at 19-Nov-2025 23:35:44 CET
Begin processing the 925th record. run: 8428 subRun: 0 event: 35115 at 19-Nov-2025 23:35:45 CET
Begin processing the 926th record. run: 8428 subRun: 0 event: 35116 at 19-Nov-2025 23:35:45 CET
Begin processing the 927th record. run: 8428 subRun: 0 event: 35117 at 19-Nov-2025 23:35:45 CET
Begin processing the 928th record. run: 8428 subRun: 0 event: 35118 at 19-Nov-2025 23:35:45 CET
Begin processing the 929th record. run: 8428 subRun: 0 event: 35119 at 19-Nov-2025 23:35:45 CET
Begin processing the 930th record. run: 8428 subRun: 0 event: 35120 at 19-Nov-2025 23:35:45 CET
19-Nov-2025 23:35:45 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/85/97/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T234454Z_gen_003512_g4_detsim_20251115T190404Z_reco.root"
19-Nov-2025 23:35:45 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/fd/c8/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T234455Z_gen_003516_g4_detsim_20251115T191323Z_reco.root"
19-Nov-2025 23:35:45 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/fd/c8/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T234455Z_gen_003516_g4_detsim_20251115T191323Z_reco.root"
Begin processing the 931st record. run: 8428 subRun: 0 event: 35151 at 19-Nov-2025 23:35:46 CET
Begin processing the 932nd record. run: 8428 subRun: 0 event: 35152 at 19-Nov-2025 23:35:46 CET
Begin processing the 933rd record. run: 8428 subRun: 0 event: 35153 at 19-Nov-2025 23:35:46 CET
Begin processing the 934th record. run: 8428 subRun: 0 event: 35154 at 19-Nov-2025 23:35:46 CET
Begin processing the 935th record. run: 8428 subRun: 0 event: 35155 at 19-Nov-2025 23:35:46 CET
Begin processing the 936th record. run: 8428 subRun: 0 event: 35156 at 19-Nov-2025 23:35:47 CET
Begin processing the 937th record. run: 8428 subRun: 0 event: 35157 at 19-Nov-2025 23:35:47 CET
Begin processing the 938th record. run: 8428 subRun: 0 event: 35158 at 19-Nov-2025 23:35:47 CET
Begin processing the 939th record. run: 8428 subRun: 0 event: 35159 at 19-Nov-2025 23:35:48 CET
Begin processing the 940th record. run: 8428 subRun: 0 event: 35160 at 19-Nov-2025 23:35:48 CET
19-Nov-2025 23:35:48 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/fd/c8/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T234455Z_gen_003516_g4_detsim_20251115T191323Z_reco.root"
19-Nov-2025 23:35:48 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/46/63/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T234510Z_gen_003546_g4_detsim_20251115T183701Z_reco.root"
19-Nov-2025 23:35:48 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/46/63/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T234510Z_gen_003546_g4_detsim_20251115T183701Z_reco.root"
Begin processing the 941st record. run: 8428 subRun: 0 event: 35451 at 19-Nov-2025 23:35:48 CET
Begin processing the 942nd record. run: 8428 subRun: 0 event: 35452 at 19-Nov-2025 23:35:48 CET
Begin processing the 943rd record. run: 8428 subRun: 0 event: 35453 at 19-Nov-2025 23:35:49 CET
Begin processing the 944th record. run: 8428 subRun: 0 event: 35454 at 19-Nov-2025 23:35:49 CET
Begin processing the 945th record. run: 8428 subRun: 0 event: 35455 at 19-Nov-2025 23:35:49 CET
Begin processing the 946th record. run: 8428 subRun: 0 event: 35456 at 19-Nov-2025 23:35:49 CET
Begin processing the 947th record. run: 8428 subRun: 0 event: 35457 at 19-Nov-2025 23:35:49 CET
Begin processing the 948th record. run: 8428 subRun: 0 event: 35458 at 19-Nov-2025 23:35:49 CET
Begin processing the 949th record. run: 8428 subRun: 0 event: 35459 at 19-Nov-2025 23:35:49 CET
Begin processing the 950th record. run: 8428 subRun: 0 event: 35460 at 19-Nov-2025 23:35:50 CET
19-Nov-2025 23:35:50 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/46/63/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T234510Z_gen_003546_g4_detsim_20251115T183701Z_reco.root"
19-Nov-2025 23:35:50 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/ad/96/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T234519Z_gen_003570_g4_detsim_20251106T135717Z_reco.root"
19-Nov-2025 23:35:50 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/ad/96/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T234519Z_gen_003570_g4_detsim_20251106T135717Z_reco.root"
Begin processing the 951st record. run: 8428 subRun: 0 event: 35691 at 19-Nov-2025 23:35:50 CET
Begin processing the 952nd record. run: 8428 subRun: 0 event: 35692 at 19-Nov-2025 23:35:50 CET
Begin processing the 953rd record. run: 8428 subRun: 0 event: 35693 at 19-Nov-2025 23:35:50 CET
Begin processing the 954th record. run: 8428 subRun: 0 event: 35694 at 19-Nov-2025 23:35:50 CET
Begin processing the 955th record. run: 8428 subRun: 0 event: 35695 at 19-Nov-2025 23:35:51 CET
Begin processing the 956th record. run: 8428 subRun: 0 event: 35696 at 19-Nov-2025 23:35:51 CET
Begin processing the 957th record. run: 8428 subRun: 0 event: 35697 at 19-Nov-2025 23:35:51 CET
Begin processing the 958th record. run: 8428 subRun: 0 event: 35698 at 19-Nov-2025 23:35:51 CET
Begin processing the 959th record. run: 8428 subRun: 0 event: 35699 at 19-Nov-2025 23:35:51 CET
Begin processing the 960th record. run: 8428 subRun: 0 event: 35700 at 19-Nov-2025 23:35:51 CET
19-Nov-2025 23:35:51 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/ad/96/prod_eminus_1-500MeV_dune10kt_1x2x6_20251002T234519Z_gen_003570_g4_detsim_20251106T135717Z_reco.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                             0.049678      0.096021      0.916659      0.0837062     0.0883396       960    
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                0.00305319     0.0047897     0.0392276    0.00416649     0.0026387       960    
end_path:triggerAna:TriggerAnaTree     0.0457061     0.0908449      0.91294      0.0775402     0.0880627       960    
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1746.19 MB
  Peak resident set size usage (VmHWM): 980.509 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.

Processing output file prod_eminus_1-500MeV_dune10kt_1x2x6__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__s6000__l2000__ntuple__EMINUS_20251119T210211_c2.root
merged pass1_CERN_000003.json