Jobsub ID 242976.110@dunegpschedd02.fnal.gov

Jobsub ID	242976.110@dunegpschedd02.fnal.gov
Workflow ID	10088
Stage ID	1
User name	epennacc@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-13 10:23:19
Site	US_UCSD
Entry	CMSHTPC_T2_US_UCSD_gw7
Last heartbeat	2025-11-13 19:15:05
From worker node	Hostname	mh-7763-9.t2.ucsd.edu
	cpuinfo	AMD EPYC 7763 64-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	171000 (47 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-13 11:00:30
Input files	fardet-hd:prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T191727Z_gen_002148_supernova_g4_detsim.root fardet-hd:prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T195315Z_gen_000282_supernova_g4_detsim.root fardet-hd:prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T194912Z_gen_003496_supernova_g4_detsim.root fardet-hd:prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T185142Z_gen_000828_supernova_g4_detsim.root
Jobscript	Exit code	0
	Real time	7h (28638s)
	CPU time	28m (1712s = 5%)
	Max RSS bytes	837062656 (798 MiB)
Outputting started	2025-11-13 18:57:48
Output files	fardet-hd:prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T191727Z_gen_002148_supernova_g4_detsim_20251113T110039Z_reco.root fardet-hd:prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T195315Z_gen_000282_supernova_g4_detsim_20251113T113048Z_reco.root fardet-hd:prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T194912Z_gen_003496_supernova_g4_detsim_20251113T162247Z_reco.root fardet-hd:prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T185142Z_gen_000828_supernova_g4_detsim_20251113T181049Z_reco.root
Finished	2025-11-13 19:15:05
Saved logs	justin-logs:242976.110-dunegpschedd02.fnal.gov.logs.tgz
List job events (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

000828_supernova_g4_detsim.root"
13-Nov-2025 10:11:08 PST  Opened input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/12/36/prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T185142Z_gen_000828_supernova_g4_detsim.root"
Begin processing the 1st record. run: 8111 subRun: 0 event: 41351 at 13-Nov-2025 10:11:10 PST
13-Nov-2025 10:11:26 PST  Opened output file with pattern "prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T185142Z_gen_000828_supernova_g4_detsim_20251113T181049Z_reco.root"
Begin processing the 2nd record. run: 8111 subRun: 0 event: 41352 at 13-Nov-2025 10:31:51 PST
Begin processing the 3rd record. run: 8111 subRun: 0 event: 41353 at 13-Nov-2025 10:32:14 PST
Begin processing the 4th record. run: 8111 subRun: 0 event: 41354 at 13-Nov-2025 10:32:43 PST
Begin processing the 5th record. run: 8111 subRun: 0 event: 41355 at 13-Nov-2025 10:33:20 PST
Begin processing the 6th record. run: 8111 subRun: 0 event: 41356 at 13-Nov-2025 10:33:51 PST
Begin processing the 7th record. run: 8111 subRun: 0 event: 41357 at 13-Nov-2025 10:34:15 PST
Begin processing the 8th record. run: 8111 subRun: 0 event: 41358 at 13-Nov-2025 10:34:38 PST
Begin processing the 9th record. run: 8111 subRun: 0 event: 41359 at 13-Nov-2025 10:35:07 PST
Begin processing the 10th record. run: 8111 subRun: 0 event: 41360 at 13-Nov-2025 10:35:27 PST
Begin processing the 11th record. run: 8111 subRun: 0 event: 41361 at 13-Nov-2025 10:36:01 PST
Begin processing the 12th record. run: 8111 subRun: 0 event: 41362 at 13-Nov-2025 10:36:28 PST
Begin processing the 13th record. run: 8111 subRun: 0 event: 41363 at 13-Nov-2025 10:36:54 PST
Begin processing the 14th record. run: 8111 subRun: 0 event: 41364 at 13-Nov-2025 10:37:21 PST
Begin processing the 15th record. run: 8111 subRun: 0 event: 41365 at 13-Nov-2025 10:37:40 PST
Begin processing the 16th record. run: 8111 subRun: 0 event: 41366 at 13-Nov-2025 10:37:59 PST
Begin processing the 17th record. run: 8111 subRun: 0 event: 41367 at 13-Nov-2025 10:38:22 PST
Begin processing the 18th record. run: 8111 subRun: 0 event: 41368 at 13-Nov-2025 10:38:56 PST
Begin processing the 19th record. run: 8111 subRun: 0 event: 41369 at 13-Nov-2025 10:39:18 PST
Begin processing the 20th record. run: 8111 subRun: 0 event: 41370 at 13-Nov-2025 10:39:54 PST
Begin processing the 21st record. run: 8111 subRun: 0 event: 41371 at 13-Nov-2025 10:40:26 PST
Begin processing the 22nd record. run: 8111 subRun: 0 event: 41372 at 13-Nov-2025 10:40:51 PST
Begin processing the 23rd record. run: 8111 subRun: 0 event: 41373 at 13-Nov-2025 10:41:10 PST
Begin processing the 24th record. run: 8111 subRun: 0 event: 41374 at 13-Nov-2025 10:41:37 PST
Begin processing the 25th record. run: 8111 subRun: 0 event: 41375 at 13-Nov-2025 10:42:06 PST
Begin processing the 26th record. run: 8111 subRun: 0 event: 41376 at 13-Nov-2025 10:42:50 PST
Begin processing the 27th record. run: 8111 subRun: 0 event: 41377 at 13-Nov-2025 10:43:19 PST
Begin processing the 28th record. run: 8111 subRun: 0 event: 41378 at 13-Nov-2025 10:43:46 PST
Begin processing the 29th record. run: 8111 subRun: 0 event: 41379 at 13-Nov-2025 10:44:14 PST
Begin processing the 30th record. run: 8111 subRun: 0 event: 41380 at 13-Nov-2025 10:44:38 PST
Begin processing the 31st record. run: 8111 subRun: 0 event: 41381 at 13-Nov-2025 10:44:50 PST
Begin processing the 32nd record. run: 8111 subRun: 0 event: 41382 at 13-Nov-2025 10:45:06 PST
Begin processing the 33rd record. run: 8111 subRun: 0 event: 41383 at 13-Nov-2025 10:45:44 PST
Begin processing the 34th record. run: 8111 subRun: 0 event: 41384 at 13-Nov-2025 10:46:20 PST
Begin processing the 35th record. run: 8111 subRun: 0 event: 41385 at 13-Nov-2025 10:46:50 PST
Begin processing the 36th record. run: 8111 subRun: 0 event: 41386 at 13-Nov-2025 10:47:19 PST
Begin processing the 37th record. run: 8111 subRun: 0 event: 41387 at 13-Nov-2025 10:48:04 PST
Begin processing the 38th record. run: 8111 subRun: 0 event: 41388 at 13-Nov-2025 10:48:49 PST
Begin processing the 39th record. run: 8111 subRun: 0 event: 41389 at 13-Nov-2025 10:49:18 PST
Begin processing the 40th record. run: 8111 subRun: 0 event: 41390 at 13-Nov-2025 10:49:50 PST
Begin processing the 41st record. run: 8111 subRun: 0 event: 41391 at 13-Nov-2025 10:50:44 PST
Begin processing the 42nd record. run: 8111 subRun: 0 event: 41392 at 13-Nov-2025 10:51:25 PST
Begin processing the 43rd record. run: 8111 subRun: 0 event: 41393 at 13-Nov-2025 10:52:06 PST
Begin processing the 44th record. run: 8111 subRun: 0 event: 41394 at 13-Nov-2025 10:52:42 PST
Begin processing the 45th record. run: 8111 subRun: 0 event: 41395 at 13-Nov-2025 10:53:30 PST
Begin processing the 46th record. run: 8111 subRun: 0 event: 41396 at 13-Nov-2025 10:54:11 PST
Begin processing the 47th record. run: 8111 subRun: 0 event: 41397 at 13-Nov-2025 10:54:52 PST
Begin processing the 48th record. run: 8111 subRun: 0 event: 41398 at 13-Nov-2025 10:55:35 PST
Begin processing the 49th record. run: 8111 subRun: 0 event: 41399 at 13-Nov-2025 10:56:15 PST
Begin processing the 50th record. run: 8111 subRun: 0 event: 41400 at 13-Nov-2025 10:56:56 PST
13-Nov-2025 10:57:44 PST  Closed output file "prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T185142Z_gen_000828_supernova_g4_detsim_20251113T181049Z_reco.root"
13-Nov-2025 10:57:44 PST  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/12/36/prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T185142Z_gen_000828_supernova_g4_detsim.root"

=========================================================================================================================================
TimeTracker printout (sec)                                 Min           Avg           Max         Median          RMS         nEvts   
=========================================================================================================================================
Full event                                               10.8449       30.6575       53.4058       28.9785       9.36578        50     
-----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.000208707   0.00612021     0.0945493    0.000375749    0.0181519       50     
makers:tpmakerTPCsimpleThr:TriggerPrimitiveMakerTPC      8.02778       27.2295       49.7583       25.3397       9.29325        50     
makers:tpmakerTPCabsRS:TriggerPrimitiveMakerTPC          2.75187       3.41902       3.77294       3.56351      0.305644        50     
[art]:TriggerResults:TriggerResultInserter              1.495e-05    2.63473e-05   8.9959e-05     2.247e-05    1.41079e-05      50     
end_path:out1:RootOutput                                 3.2e-06     5.64066e-06   3.9979e-05     4.385e-06    5.77106e-06      50     
end_path:out1:RootOutput(write)                        0.00142139    0.00212785    0.00392266    0.00211947    0.000415058      50     
=========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1607.75 MB
  Peak resident set size usage (VmHWM): 837.063 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T185142Z_gen_000828_supernova_g4_detsim_20251113T181049Z_reco.root
Extracted metadata
checking file====== fardet-hd:prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T185142Z_gen_000828_supernova_g4_detsim.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
did.list
file.list
jobscript.log
mem.db
old_md.json
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T185142Z_gen_000828_supernova_g4_detsim_20251113T181049Z_reco.root
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T185142Z_gen_000828_supernova_g4_detsim_20251113T181049Z_reco.root.ext.json
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T185142Z_gen_000828_supernova_g4_detsim_20251113T181049Z_reco.root.json
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T185142Z_gen_000828_supernova_g4_detsim_20251113T181049Z_reco.root.temp.json
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T191727Z_gen_002148_supernova_g4_detsim_20251113T110039Z_reco.root
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T191727Z_gen_002148_supernova_g4_detsim_20251113T110039Z_reco.root.ext.json
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T191727Z_gen_002148_supernova_g4_detsim_20251113T110039Z_reco.root.json
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T191727Z_gen_002148_supernova_g4_detsim_20251113T110039Z_reco.root.temp.json
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T194912Z_gen_003496_supernova_g4_detsim_20251113T162247Z_reco.root
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T194912Z_gen_003496_supernova_g4_detsim_20251113T162247Z_reco.root.ext.json
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T194912Z_gen_003496_supernova_g4_detsim_20251113T162247Z_reco.root.json
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T194912Z_gen_003496_supernova_g4_detsim_20251113T162247Z_reco.root.temp.json
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T195315Z_gen_000282_supernova_g4_detsim_20251113T113048Z_reco.root
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T195315Z_gen_000282_supernova_g4_detsim_20251113T113048Z_reco.root.ext.json
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T195315Z_gen_000282_supernova_g4_detsim_20251113T113048Z_reco.root.json
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T195315Z_gen_000282_supernova_g4_detsim_20251113T113048Z_reco.root.temp.json
temp_pfns.txt
time.db
triggersim_hist.root