Jobsub ID 250975.1@dunegpschedd02.fnal.gov

Jobsub ID	250975.1@dunegpschedd02.fnal.gov
Workflow ID	10647
Stage ID	1
User name	schellma@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-24 23:13:39
Site	CERN
Entry	CMSHTPC_T2_CH_CERN_ce507
Last heartbeat	2025-11-24 23:47:21
From worker node	Hostname	b9g02p3210.cern.ch
	cpuinfo	Intel(R) Xeon(R) Silver 4216 CPU @ 2.10GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	343800 (95 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-24 23:41:38
Input files	monte-carlo-010647-000012
Jobscript	Exit code	0
	Real time	3m (230s)
	CPU time	1m (89s = 38%)
	Max RSS bytes	674455552 (643 MiB)
Outputting started	2025-11-24 23:45:29
Output files	fardet-hd:prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__ntuple__CAVE-NEUTRON_prod_s008000_l002000_20251124T222815_c11.root
Finished	2025-11-24 23:47:21
Saved logs	justin-logs:250975.1-dunegpschedd02.fnal.gov.logs.tgz
List job events (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

-2025 00:45:19 CET
Begin processing the 981st record. run: 8378 subRun: 0 event: 57698658 at 25-Nov-2025 00:45:19 CET
25-Nov-2025 00:45:19 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/63/f1/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T011038Z_gen_005770_supernova_g4_detsim_20251115T180947Z_reco.root"
25-Nov-2025 00:45:19 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/ce/e2/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T011052Z_gen_005772_supernova_g4_detsim_20251115T180308Z_reco.root"
25-Nov-2025 00:45:19 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/ce/e2/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T011052Z_gen_005772_supernova_g4_detsim_20251115T180308Z_reco.root"
Begin processing the 982nd record. run: 8378 subRun: 0 event: 57710069 at 25-Nov-2025 00:45:20 CET
Begin processing the 983rd record. run: 8378 subRun: 0 event: 57711616 at 25-Nov-2025 00:45:20 CET
Begin processing the 984th record. run: 8378 subRun: 0 event: 57713575 at 25-Nov-2025 00:45:20 CET
Begin processing the 985th record. run: 8378 subRun: 0 event: 57714081 at 25-Nov-2025 00:45:20 CET
Begin processing the 986th record. run: 8378 subRun: 0 event: 57714725 at 25-Nov-2025 00:45:20 CET
Begin processing the 987th record. run: 8378 subRun: 0 event: 57715066 at 25-Nov-2025 00:45:20 CET
Begin processing the 988th record. run: 8378 subRun: 0 event: 57715365 at 25-Nov-2025 00:45:20 CET
Begin processing the 989th record. run: 8378 subRun: 0 event: 57715700 at 25-Nov-2025 00:45:21 CET
Begin processing the 990th record. run: 8378 subRun: 0 event: 57715810 at 25-Nov-2025 00:45:21 CET
Begin processing the 991st record. run: 8378 subRun: 0 event: 57718013 at 25-Nov-2025 00:45:21 CET
Begin processing the 992nd record. run: 8378 subRun: 0 event: 57718173 at 25-Nov-2025 00:45:21 CET
Begin processing the 993rd record. run: 8378 subRun: 0 event: 57719460 at 25-Nov-2025 00:45:21 CET
25-Nov-2025 00:45:21 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/ce/e2/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T011052Z_gen_005772_supernova_g4_detsim_20251115T180308Z_reco.root"
25-Nov-2025 00:45:21 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/0f/cf/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T011146Z_gen_005778_supernova_g4_detsim_20251115T175355Z_reco.root"
25-Nov-2025 00:45:21 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/0f/cf/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T011146Z_gen_005778_supernova_g4_detsim_20251115T175355Z_reco.root"
Begin processing the 994th record. run: 8378 subRun: 0 event: 57771035 at 25-Nov-2025 00:45:22 CET
Begin processing the 995th record. run: 8378 subRun: 0 event: 57771582 at 25-Nov-2025 00:45:22 CET
Begin processing the 996th record. run: 8378 subRun: 0 event: 57772686 at 25-Nov-2025 00:45:22 CET
Begin processing the 997th record. run: 8378 subRun: 0 event: 57774081 at 25-Nov-2025 00:45:22 CET
Begin processing the 998th record. run: 8378 subRun: 0 event: 57774125 at 25-Nov-2025 00:45:22 CET
Begin processing the 999th record. run: 8378 subRun: 0 event: 57774725 at 25-Nov-2025 00:45:22 CET
Begin processing the 1000th record. run: 8378 subRun: 0 event: 57775810 at 25-Nov-2025 00:45:22 CET
Begin processing the 1001st record. run: 8378 subRun: 0 event: 57778658 at 25-Nov-2025 00:45:22 CET
25-Nov-2025 00:45:23 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/0f/cf/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T011146Z_gen_005778_supernova_g4_detsim_20251115T175355Z_reco.root"
25-Nov-2025 00:45:23 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/24/e9/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T011209Z_gen_005783_supernova_g4_detsim_20251115T180435Z_reco.root"
25-Nov-2025 00:45:23 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/24/e9/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T011209Z_gen_005783_supernova_g4_detsim_20251115T180435Z_reco.root"
Begin processing the 1002nd record. run: 8378 subRun: 0 event: 57820252 at 25-Nov-2025 00:45:23 CET
Begin processing the 1003rd record. run: 8378 subRun: 0 event: 57820359 at 25-Nov-2025 00:45:23 CET
Begin processing the 1004th record. run: 8378 subRun: 0 event: 57821035 at 25-Nov-2025 00:45:23 CET
Begin processing the 1005th record. run: 8378 subRun: 0 event: 57821902 at 25-Nov-2025 00:45:23 CET
Begin processing the 1006th record. run: 8378 subRun: 0 event: 57822686 at 25-Nov-2025 00:45:23 CET
Begin processing the 1007th record. run: 8378 subRun: 0 event: 57823575 at 25-Nov-2025 00:45:24 CET
Begin processing the 1008th record. run: 8378 subRun: 0 event: 57823891 at 25-Nov-2025 00:45:24 CET
Begin processing the 1009th record. run: 8378 subRun: 0 event: 57824725 at 25-Nov-2025 00:45:24 CET
Begin processing the 1010th record. run: 8378 subRun: 0 event: 57825365 at 25-Nov-2025 00:45:24 CET
Begin processing the 1011th record. run: 8378 subRun: 0 event: 57825810 at 25-Nov-2025 00:45:24 CET
Begin processing the 1012th record. run: 8378 subRun: 0 event: 57827670 at 25-Nov-2025 00:45:24 CET
Begin processing the 1013th record. run: 8378 subRun: 0 event: 57828125 at 25-Nov-2025 00:45:25 CET
Begin processing the 1014th record. run: 8378 subRun: 0 event: 57828658 at 25-Nov-2025 00:45:25 CET
Begin processing the 1015th record. run: 8378 subRun: 0 event: 57829059 at 25-Nov-2025 00:45:25 CET
25-Nov-2025 00:45:25 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/24/e9/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T011209Z_gen_005783_supernova_g4_detsim_20251115T180435Z_reco.root"
25-Nov-2025 00:45:25 CET  Initiating request to open input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/d1/9d/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T011239Z_gen_005798_supernova_g4_detsim_20251115T171645Z_reco.root"
25-Nov-2025 00:45:25 CET  Opened input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/d1/9d/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T011239Z_gen_005798_supernova_g4_detsim_20251115T171645Z_reco.root"
Begin processing the 1016th record. run: 8378 subRun: 0 event: 57970069 at 25-Nov-2025 00:45:25 CET
Begin processing the 1017th record. run: 8378 subRun: 0 event: 57970252 at 25-Nov-2025 00:45:26 CET
Begin processing the 1018th record. run: 8378 subRun: 0 event: 57970359 at 25-Nov-2025 00:45:26 CET
Begin processing the 1019th record. run: 8378 subRun: 0 event: 57971616 at 25-Nov-2025 00:45:26 CET
Begin processing the 1020th record. run: 8378 subRun: 0 event: 57973575 at 25-Nov-2025 00:45:26 CET
Begin processing the 1021st record. run: 8378 subRun: 0 event: 57973891 at 25-Nov-2025 00:45:26 CET
Begin processing the 1022nd record. run: 8378 subRun: 0 event: 57975365 at 25-Nov-2025 00:45:26 CET
Begin processing the 1023rd record. run: 8378 subRun: 0 event: 57977629 at 25-Nov-2025 00:45:27 CET
Begin processing the 1024th record. run: 8378 subRun: 0 event: 57978013 at 25-Nov-2025 00:45:27 CET
Begin processing the 1025th record. run: 8378 subRun: 0 event: 57978173 at 25-Nov-2025 00:45:27 CET
Begin processing the 1026th record. run: 8378 subRun: 0 event: 57978626 at 25-Nov-2025 00:45:27 CET
Begin processing the 1027th record. run: 8378 subRun: 0 event: 57979059 at 25-Nov-2025 00:45:27 CET
Begin processing the 1028th record. run: 8378 subRun: 0 event: 57979908 at 25-Nov-2025 00:45:27 CET
25-Nov-2025 00:45:28 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/d1/9d/prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6_20251002T011239Z_gen_005798_supernova_g4_detsim_20251115T171645Z_reco.root"

========================================================================================================================
TimeTracker printout (sec)                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================
Full event                             0.0570556     0.0841053      1.01261      0.0809361     0.0326973      1028    
------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                0.00315825    0.00474148     0.0280934    0.00415541    0.00267291      1028    
end_path:triggerAna:TriggerAnaTree     0.053254      0.0787962      1.00892      0.075626      0.0324777      1028    
========================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1437.34 MB
  Peak resident set size usage (VmHWM): 663.446 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.

Processing output file prodbackground_radiological_decay0_cavernneutrons_dune10kt_1x2x6__trg_mc_2025a_tpg__tpg_dune10kt_1x2x6__reco__v10_12_01d01__triggerana_dune10kt_1x2x6__v10_12_01d01__ntuple__CAVE-NEUTRON_prod_s008000_l002000_20251124T222815_c11.root
merged pass1_CERN_000012.json