Jobsub ID 248719.39@dunegpschedd01.fnal.gov

Jobsub ID	248719.39@dunegpschedd01.fnal.gov
Workflow ID	10088
Stage ID	1
User name	epennacc@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-13 12:19:23
Site	US_UCSD
Entry	CMSHTPC_T2_US_UCSD_gw6
Last heartbeat	2025-11-13 21:03:22
From worker node	Hostname	mh-7763-17.t2.ucsd.edu
	cpuinfo	AMD EPYC 7763 64-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	171000 (47 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-13 12:20:11
Input files	fardet-hd:prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T210832Z_gen_002882_supernova_g4_detsim.root fardet-hd:prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T205059Z_gen_003778_supernova_g4_detsim.root fardet-hd:prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T191457Z_gen_002054_supernova_g4_detsim.root fardet-hd:prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T185058Z_gen_000811_supernova_g4_detsim.root
Jobscript	Exit code	0
	Real time	8h (29030s)
	CPU time	29m (1794s = 6%)
	Max RSS bytes	763203584 (727 MiB)
Outputting started	2025-11-13 20:24:02
Output files	fardet-hd:prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T210832Z_gen_002882_supernova_g4_detsim_20251113T122019Z_reco.root fardet-hd:prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T205059Z_gen_003778_supernova_g4_detsim_20251113T171443Z_reco.root fardet-hd:prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T191457Z_gen_002054_supernova_g4_detsim_20251113T182259Z_reco.root fardet-hd:prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T185058Z_gen_000811_supernova_g4_detsim_20251113T193540Z_reco.root
Finished	2025-11-13 21:03:22
Saved logs	justin-logs:248719.39-dunegpschedd01.fnal.gov.logs.tgz
List job events (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

_000811_supernova_g4_detsim.root"
13-Nov-2025 11:35:59 PST  Opened input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/e1/1a/prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T185058Z_gen_000811_supernova_g4_detsim.root"
Begin processing the 1st record. run: 8111 subRun: 0 event: 40501 at 13-Nov-2025 11:36:02 PST
13-Nov-2025 11:37:03 PST  Opened output file with pattern "prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T185058Z_gen_000811_supernova_g4_detsim_20251113T193540Z_reco.root"
Begin processing the 2nd record. run: 8111 subRun: 0 event: 40502 at 13-Nov-2025 11:55:17 PST
Begin processing the 3rd record. run: 8111 subRun: 0 event: 40503 at 13-Nov-2025 11:55:36 PST
Begin processing the 4th record. run: 8111 subRun: 0 event: 40504 at 13-Nov-2025 11:55:54 PST
Begin processing the 5th record. run: 8111 subRun: 0 event: 40505 at 13-Nov-2025 11:56:12 PST
Begin processing the 6th record. run: 8111 subRun: 0 event: 40506 at 13-Nov-2025 11:56:54 PST
Begin processing the 7th record. run: 8111 subRun: 0 event: 40507 at 13-Nov-2025 11:57:46 PST
Begin processing the 8th record. run: 8111 subRun: 0 event: 40508 at 13-Nov-2025 11:58:42 PST
Begin processing the 9th record. run: 8111 subRun: 0 event: 40509 at 13-Nov-2025 11:59:52 PST
Begin processing the 10th record. run: 8111 subRun: 0 event: 40510 at 13-Nov-2025 12:00:17 PST
Begin processing the 11th record. run: 8111 subRun: 0 event: 40511 at 13-Nov-2025 12:00:35 PST
Begin processing the 12th record. run: 8111 subRun: 0 event: 40512 at 13-Nov-2025 12:00:47 PST
Begin processing the 13th record. run: 8111 subRun: 0 event: 40513 at 13-Nov-2025 12:01:00 PST
Begin processing the 14th record. run: 8111 subRun: 0 event: 40514 at 13-Nov-2025 12:01:16 PST
Begin processing the 15th record. run: 8111 subRun: 0 event: 40515 at 13-Nov-2025 12:01:31 PST
Begin processing the 16th record. run: 8111 subRun: 0 event: 40516 at 13-Nov-2025 12:01:46 PST
Begin processing the 17th record. run: 8111 subRun: 0 event: 40517 at 13-Nov-2025 12:02:01 PST
Begin processing the 18th record. run: 8111 subRun: 0 event: 40518 at 13-Nov-2025 12:02:16 PST
Begin processing the 19th record. run: 8111 subRun: 0 event: 40519 at 13-Nov-2025 12:02:31 PST
Begin processing the 20th record. run: 8111 subRun: 0 event: 40520 at 13-Nov-2025 12:02:45 PST
Begin processing the 21st record. run: 8111 subRun: 0 event: 40521 at 13-Nov-2025 12:03:00 PST
Begin processing the 22nd record. run: 8111 subRun: 0 event: 40522 at 13-Nov-2025 12:03:17 PST
Begin processing the 23rd record. run: 8111 subRun: 0 event: 40523 at 13-Nov-2025 12:03:29 PST
Begin processing the 24th record. run: 8111 subRun: 0 event: 40524 at 13-Nov-2025 12:03:43 PST
Begin processing the 25th record. run: 8111 subRun: 0 event: 40525 at 13-Nov-2025 12:03:55 PST
Begin processing the 26th record. run: 8111 subRun: 0 event: 40526 at 13-Nov-2025 12:04:12 PST
Begin processing the 27th record. run: 8111 subRun: 0 event: 40527 at 13-Nov-2025 12:04:32 PST
Begin processing the 28th record. run: 8111 subRun: 0 event: 40528 at 13-Nov-2025 12:04:49 PST
Begin processing the 29th record. run: 8111 subRun: 0 event: 40529 at 13-Nov-2025 12:05:04 PST
Begin processing the 30th record. run: 8111 subRun: 0 event: 40530 at 13-Nov-2025 12:05:19 PST
Begin processing the 31st record. run: 8111 subRun: 0 event: 40531 at 13-Nov-2025 12:05:31 PST
Begin processing the 32nd record. run: 8111 subRun: 0 event: 40532 at 13-Nov-2025 12:05:43 PST
Begin processing the 33rd record. run: 8111 subRun: 0 event: 40533 at 13-Nov-2025 12:05:59 PST
Begin processing the 34th record. run: 8111 subRun: 0 event: 40534 at 13-Nov-2025 12:06:56 PST
Begin processing the 35th record. run: 8111 subRun: 0 event: 40535 at 13-Nov-2025 12:07:09 PST
Begin processing the 36th record. run: 8111 subRun: 0 event: 40536 at 13-Nov-2025 12:07:28 PST
Begin processing the 37th record. run: 8111 subRun: 0 event: 40537 at 13-Nov-2025 12:08:36 PST
Begin processing the 38th record. run: 8111 subRun: 0 event: 40538 at 13-Nov-2025 12:09:25 PST
Begin processing the 39th record. run: 8111 subRun: 0 event: 40539 at 13-Nov-2025 12:10:25 PST
Begin processing the 40th record. run: 8111 subRun: 0 event: 40540 at 13-Nov-2025 12:11:31 PST
Begin processing the 41st record. run: 8111 subRun: 0 event: 40541 at 13-Nov-2025 12:12:31 PST
Begin processing the 42nd record. run: 8111 subRun: 0 event: 40542 at 13-Nov-2025 12:13:47 PST
Begin processing the 43rd record. run: 8111 subRun: 0 event: 40543 at 13-Nov-2025 12:14:37 PST
Begin processing the 44th record. run: 8111 subRun: 0 event: 40544 at 13-Nov-2025 12:15:50 PST
Begin processing the 45th record. run: 8111 subRun: 0 event: 40545 at 13-Nov-2025 12:17:00 PST
Begin processing the 46th record. run: 8111 subRun: 0 event: 40546 at 13-Nov-2025 12:18:13 PST
Begin processing the 47th record. run: 8111 subRun: 0 event: 40547 at 13-Nov-2025 12:19:28 PST
Begin processing the 48th record. run: 8111 subRun: 0 event: 40548 at 13-Nov-2025 12:20:47 PST
Begin processing the 49th record. run: 8111 subRun: 0 event: 40549 at 13-Nov-2025 12:21:55 PST
Begin processing the 50th record. run: 8111 subRun: 0 event: 40550 at 13-Nov-2025 12:22:57 PST
13-Nov-2025 12:23:58 PST  Closed output file "prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T185058Z_gen_000811_supernova_g4_detsim_20251113T193540Z_reco.root"
13-Nov-2025 12:23:58 PST  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/e1/1a/prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T185058Z_gen_000811_supernova_g4_detsim.root"

=========================================================================================================================================
TimeTracker printout (sec)                                 Min           Avg           Max         Median          RMS         nEvts   
=========================================================================================================================================
Full event                                               11.4091       34.8959       78.0256       18.0203       24.333         50     
-----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.000267218   0.00591926     0.0679907    0.000490992    0.0165962       50     
makers:tpmakerTPCsimpleThr:TriggerPrimitiveMakerTPC      7.83547       31.4779       74.4372       14.8044       24.337         50     
makers:tpmakerTPCabsRS:TriggerPrimitiveMakerTPC          2.76488       3.40928       3.74511       3.51369      0.258537        50     
[art]:TriggerResults:TriggerResultInserter              1.643e-05    3.00112e-05   0.000114849    2.291e-05    1.79849e-05      50     
end_path:out1:RootOutput                                3.53e-06     6.8568e-06     4.561e-05    4.7655e-06    6.77646e-06      50     
end_path:out1:RootOutput(write)                         0.0014095    0.00210501    0.00371826     0.0021429    0.000408093      50     
=========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1484.22 MB
  Peak resident set size usage (VmHWM): 732.25 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T185058Z_gen_000811_supernova_g4_detsim_20251113T193540Z_reco.root
Extracted metadata
checking file====== fardet-hd:prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T185058Z_gen_000811_supernova_g4_detsim.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
did.list
file.list
jobscript.log
mem.db
old_md.json
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T185058Z_gen_000811_supernova_g4_detsim_20251113T193540Z_reco.root
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T185058Z_gen_000811_supernova_g4_detsim_20251113T193540Z_reco.root.ext.json
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T185058Z_gen_000811_supernova_g4_detsim_20251113T193540Z_reco.root.json
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T185058Z_gen_000811_supernova_g4_detsim_20251113T193540Z_reco.root.temp.json
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T191457Z_gen_002054_supernova_g4_detsim_20251113T182259Z_reco.root
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T191457Z_gen_002054_supernova_g4_detsim_20251113T182259Z_reco.root.ext.json
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T191457Z_gen_002054_supernova_g4_detsim_20251113T182259Z_reco.root.json
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T191457Z_gen_002054_supernova_g4_detsim_20251113T182259Z_reco.root.temp.json
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T205059Z_gen_003778_supernova_g4_detsim_20251113T171443Z_reco.root
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T205059Z_gen_003778_supernova_g4_detsim_20251113T171443Z_reco.root.ext.json
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T205059Z_gen_003778_supernova_g4_detsim_20251113T171443Z_reco.root.json
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T205059Z_gen_003778_supernova_g4_detsim_20251113T171443Z_reco.root.temp.json
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T210832Z_gen_002882_supernova_g4_detsim_20251113T122019Z_reco.root
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T210832Z_gen_002882_supernova_g4_detsim_20251113T122019Z_reco.root.ext.json
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T210832Z_gen_002882_supernova_g4_detsim_20251113T122019Z_reco.root.json
prodmarley_nue_flat_cc_dune10kt_1x2x2_20250926T210832Z_gen_002882_supernova_g4_detsim_20251113T122019Z_reco.root.temp.json
temp_pfns.txt
time.db
triggersim_hist.root