Jobsub ID 14033.166@dunegpschedd02.fnal.gov

Jobsub ID	14033.166@dunegpschedd02.fnal.gov
Workflow ID	251
Stage ID	1
User name	epennacc@fnal.gov
HTCondor Group	group_dune.prod.mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4193255424 (3999 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-08-02 19:21:39
Site	UK_QMUL
Entry	DUNE_UK_London_QMUL_arcce02
Last heartbeat	2025-08-03 02:17:09
From worker node	Hostname	cn530.htc.esc.qmul
	cpuinfo	Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	171000 (47 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-08-02 20:03:43
Input files	monte-carlo-000251-009730
Jobscript	Exit code	0
	Real time	6h (22266s)
	CPU time	6h (22075s = 99%)
	Max RSS bytes	1923473408 (1834 MiB)
Outputting started	2025-08-03 02:14:50
Output files	fardet-hd:prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250802T200348Z_gen_009730_supernova_g4_halfActiveVol_detsim_reco.root
Finished	2025-08-03 02:17:09
Saved logs	justin-logs:14033.166-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

6 XUs and 18 XVs -> 12 XUVs
C:0 T:17 6 XUs and 7 XVs -> 5 XUVs
C:0 T:19 7 XUs and 5 XVs -> 3 XUVs
C:0 T:21 20 XUs and 17 XVs -> 9 XUVs
C:0 T:23 26 XUs and 29 XVs -> 18 XUVs
121 XUVs total
84 collection wire objects
121 potential space points
Neighbour search...
301 tests to find 180 neighbours
Iterating with no regularization...
Begin: 281452
0 228749
1 228426
2 228396
Now with regularization...
Begin: 137420
0 137411
Begin processing the 44th record. run: 251 subRun: 0 event: 486494 at 03-Aug-2025 03:14:37 BST
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 17 XUs and 22 XVs -> 11 XUVs
C:0 T:3 24 XUs and 24 XVs -> 18 XUVs
C:0 T:5 4 XUs and 6 XVs -> 2 XUVs
C:0 T:7 6 XUs and 10 XVs -> 4 XUVs
C:0 T:9 5 XUs and 6 XVs -> 5 XUVs
C:0 T:11 6 XUs and 8 XVs -> 5 XUVs
C:0 T:13 15 XUs and 11 XVs -> 7 XUVs
C:0 T:15 9 XUs and 10 XVs -> 6 XUVs
C:0 T:17 11 XUs and 17 XVs -> 5 XUVs
C:0 T:19 20 XUs and 19 XVs -> 16 XUVs
C:0 T:21 12 XUs and 8 XVs -> 5 XUVs
C:0 T:23 15 XUs and 16 XVs -> 9 XUVs
93 XUVs total
68 collection wire objects
93 potential space points
Neighbour search...
193 tests to find 94 neighbours
Iterating with no regularization...
Begin: 266834
0 227490
1 226753
2 226743
Now with regularization...
Begin: 163971
0 163966
Begin processing the 45th record. run: 251 subRun: 0 event: 486495 at 03-Aug-2025 03:14:37 BST
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 21 XUs and 21 XVs -> 9 XUVs
C:0 T:3 32 XUs and 31 XVs -> 21 XUVs
C:0 T:5 25 XUs and 26 XVs -> 16 XUVs
C:0 T:7 9 XUs and 8 XVs -> 4 XUVs
C:0 T:9 3 XUs and 4 XVs -> 1 XUVs
C:0 T:11 10 XUs and 10 XVs -> 6 XUVs
C:0 T:13 19 XUs and 21 XVs -> 10 XUVs
C:0 T:15 11 XUs and 13 XVs -> 6 XUVs
C:0 T:17 19 XUs and 17 XVs -> 13 XUVs
C:0 T:19 7 XUs and 10 XVs -> 7 XUVs
C:0 T:21 20 XUs and 20 XVs -> 12 XUVs
C:0 T:23 15 XUs and 13 XVs -> 10 XUVs
115 XUVs total
85 collection wire objects
115 potential space points
Neighbour search...
261 tests to find 146 neighbours
Iterating with no regularization...
Begin: 353782
0 317444
1 317254
Now with regularization...
Begin: 226581
0 226550
Begin processing the 46th record. run: 251 subRun: 0 event: 486496 at 03-Aug-2025 03:14:38 BST
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 9 XUs and 12 XVs -> 7 XUVs
C:0 T:3 22 XUs and 21 XVs -> 12 XUVs
C:0 T:5 10 XUs and 11 XVs -> 5 XUVs
C:0 T:7 7 XUs and 8 XVs -> 4 XUVs
C:0 T:9 17 XUs and 17 XVs -> 10 XUVs
C:0 T:11 8 XUs and 6 XVs -> 1 XUVs
C:0 T:13 12 XUs and 14 XVs -> 8 XUVs
C:0 T:15 7 XUs and 5 XVs -> 3 XUVs
C:0 T:17 1 XUs and 1 XVs -> 0 XUVs
C:0 T:19 7 XUs and 8 XVs -> 6 XUVs
C:0 T:21 5 XUs and 5 XVs -> 3 XUVs
C:0 T:23 25 XUs and 27 XVs -> 16 XUVs
75 XUVs total
57 collection wire objects
75 potential space points
Neighbour search...
151 tests to find 76 neighbours
Iterating with no regularization...
Begin: 234116
0 218160
1 217828
2 217823
Now with regularization...
Begin: 168841
0 168839
Begin processing the 47th record. run: 251 subRun: 0 event: 486497 at 03-Aug-2025 03:14:39 BST
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 29 XUs and 22 XVs -> 12 XUVs
C:0 T:3 11 XUs and 14 XVs -> 8 XUVs
C:0 T:5 20 XUs and 20 XVs -> 14 XUVs
C:0 T:7 6 XUs and 6 XVs -> 5 XUVs
C:0 T:9 16 XUs and 10 XVs -> 6 XUVs
C:0 T:11 12 XUs and 13 XVs -> 6 XUVs
C:0 T:13 6 XUs and 4 XVs -> 1 XUVs
C:0 T:15 8 XUs and 7 XVs -> 4 XUVs
C:0 T:17 7 XUs and 6 XVs -> 4 XUVs
C:0 T:19 12 XUs and 15 XVs -> 6 XUVs
C:0 T:21 39 XUs and 38 XVs -> 20 XUVs
C:0 T:23 24 XUs and 22 XVs -> 15 XUVs
101 XUVs total
74 collection wire objects
101 potential space points
Neighbour search...
203 tests to find 96 neighbours
Iterating with no regularization...
Begin: 279552
0 243165
1 242987
Now with regularization...
Begin: 172719
0 172708
Begin processing the 48th record. run: 251 subRun: 0 event: 486498 at 03-Aug-2025 03:14:40 BST
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 22 XUs and 20 XVs -> 13 XUVs
C:0 T:3 16 XUs and 14 XVs -> 10 XUVs
C:0 T:5 9 XUs and 6 XVs -> 6 XUVs
C:0 T:7 20 XUs and 19 XVs -> 12 XUVs
C:0 T:9 6 XUs and 5 XVs -> 3 XUVs
C:0 T:11 18 XUs and 15 XVs -> 9 XUVs
C:0 T:13 13 XUs and 9 XVs -> 5 XUVs
C:0 T:15 9 XUs and 7 XVs -> 4 XUVs
C:0 T:17 9 XUs and 8 XVs -> 3 XUVs
C:0 T:19 10 XUs and 12 XVs -> 5 XUVs
C:0 T:21 29 XUs and 29 XVs -> 17 XUVs
C:0 T:23 17 XUs and 14 XVs -> 9 XUVs
96 XUVs total
67 collection wire objects
96 potential space points
Neighbour search...
218 tests to find 122 neighbours
Iterating with no regularization...
Begin: 256420
0 224255
1 223999
2 223982
Now with regularization...
Begin: 148911
0 148905
Begin processing the 49th record. run: 251 subRun: 0 event: 486499 at 03-Aug-2025 03:14:41 BST
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 32 XUs and 24 XVs -> 17 XUVs
C:0 T:3 30 XUs and 23 XVs -> 18 XUVs
C:0 T:5 18 XUs and 14 XVs -> 11 XUVs
C:0 T:7 13 XUs and 12 XVs -> 6 XUVs
C:0 T:9 2 XUs and 1 XVs -> 0 XUVs
C:0 T:11 7 XUs and 5 XVs -> 2 XUVs
C:0 T:13 12 XUs and 8 XVs -> 5 XUVs
C:0 T:15 9 XUs and 5 XVs -> 4 XUVs
C:0 T:17 19 XUs and 15 XVs -> 8 XUVs
C:0 T:19 7 XUs and 6 XVs -> 4 XUVs
C:0 T:21 14 XUs and 17 XVs -> 11 XUVs
C:0 T:23 11 XUs and 8 XVs -> 4 XUVs
90 XUVs total
72 collection wire objects
90 potential space points
Neighbour search...
168 tests to find 78 neighbours
Iterating with no regularization...
Begin: 337749
0 326526
1 326526
Now with regularization...
Begin: 259755
0 259753
Begin processing the 50th record. run: 251 subRun: 0 event: 486500 at 03-Aug-2025 03:14:42 BST
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 14 XUs and 11 XVs -> 5 XUVs
C:0 T:3 24 XUs and 25 XVs -> 11 XUVs
C:0 T:5 4 XUs and 8 XVs -> 3 XUVs
C:0 T:7 8 XUs and 8 XVs -> 7 XUVs
C:0 T:9 7 XUs and 8 XVs -> 4 XUVs
C:0 T:11 4 XUs and 6 XVs -> 2 XUVs
C:0 T:13 3 XUs and 2 XVs -> 1 XUVs
C:0 T:15 18 XUs and 19 XVs -> 13 XUVs
C:0 T:17 11 XUs and 10 XVs -> 7 XUVs
C:0 T:19 5 XUs and 6 XVs -> 3 XUVs
C:0 T:21 22 XUs and 24 XVs -> 14 XUVs
C:0 T:23 18 XUs and 21 XVs -> 8 XUVs
78 XUVs total
61 collection wire objects
78 potential space points
Neighbour search...
142 tests to find 64 neighbours
Iterating with no regularization...
Begin: 262922
0 229678
1 229671
Now with regularization...
Begin: 173859
0 173854
03-Aug-2025 03:14:45 BST  Closed output file "prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250802T200348Z_gen_009730_supernova_g4_halfActiveVol_detsim_reco.root"
03-Aug-2025 03:14:45 BST  Closed input file "prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250802T200348Z_gen_009730_supernova_g4_halfActiveVol_detsim.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.063585      0.0771174     0.0890772     0.0773449    0.00683733       50     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000426718   0.000598942   0.00148138    0.000581125   0.000142529      50     
reco:gaushit:GausHitFinder                     0.0479707     0.0586058     0.0659818     0.0590385    0.00453747       50     
reco:spsolve:SpacePointSolver                 0.00346252    0.00495953    0.00958493    0.00483105    0.000985723      50     
reco:hitfd:DisambigFromSpacePoints            0.00141741    0.00196497    0.00480625    0.00192247    0.000490153      50     
reco:rns:RandomNumberSaver                    2.5561e-05    3.79211e-05   0.000268745   3.27925e-05   3.34283e-05      50     
[art]:TriggerResults:TriggerResultInserter    1.4106e-05    1.88222e-05    5.593e-05    1.7455e-05    6.07132e-06      50     
end_path:out1:RootOutput                       3.821e-06    5.25374e-06   2.5003e-05     4.818e-06    2.87582e-06      50     
end_path:out1:RootOutput(write)               0.00756287     0.0105455     0.0146817     0.0101518    0.00175079       50     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1773.7 MB
  Peak resident set size usage (VmHWM): 891.617 MB
====================================================================================================
Art has completed and will exit with status 0.
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250802T200348Z_gen_009730.root 109936271
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250802T200348Z_gen_009730_supernova_g4_halfActiveVol.root 720126877
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250802T200348Z_gen_009730_supernova_g4_halfActiveVol_detsim.root 1831722744
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250802T200348Z_gen_009730_supernova_g4_halfActiveVol_detsim_hist.root 12750
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250802T200348Z_gen_009730_supernova_g4_halfActiveVol_detsim_reco.root 1835143679
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250802T200348Z_gen_009730_supernova_g4_halfActiveVol_detsim_reco.root.ext.json 1606
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250802T200348Z_gen_009730_supernova_g4_halfActiveVol_detsim_reco.root.json 1835
written output file: prodbackground_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250802T200348Z_gen_009730_supernova_g4_halfActiveVol_detsim_reco.root.temp.json 1835