Jobsub ID 241556.0@dunegpschedd02.fnal.gov

Jobsub ID	241556.0@dunegpschedd02.fnal.gov
Workflow ID	9932
Stage ID	1
User name	smanthey@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-11 22:06:24
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat	2025-11-11 22:48:21
From worker node	Hostname	dunegli-7726941-0-fnpc23009.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-11 22:20:36
Input files	fardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250207T130155Z_gen_004747_supernova_g4_detsim_reco_20250724T131406Z_reco2.root
Jobscript	Exit code	0
	Real time	5m (337s)
	CPU time	5m (323s = 95%)
	Max RSS bytes	917819392 (875 MiB)
Outputting started	2025-11-11 22:26:13
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dune10kt_1x2x6_centralAPA/fnal/09932/1/001/fdhd_ana_2025-11-11T_222042Z_hist.root
Finished	2025-11-11 22:48:21
Saved logs	justin-logs:241556.0-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

.97, -247.63, 387.84)	32846	32792
marley	1000180400	0.00	(245.01, -186.83, 383.06)	32845	32792
marley	1000180360	0.00	(263.29, -173.31, 395.93)	32844	32792
marley	1000180400	0.00	(267.44, -176.15, 390.82)	32843	32792
marley	1000180400	0.00	(211.89, -305.16, 349.65)	32842	32792
marley	1000180400	0.00	(205.40, -285.44, 334.50)	32841	32792
marley	1000180400	0.00	(190.88, -252.39, 367.23)	32840	32792
marley	2212		0.00	(363.46, -228.01, 470.78)	32839	32792
marley	1000260560	0.00	(379.12, -219.10, 484.28)	32838	32792
marley	1000260560	0.00	(378.72, -219.38, 484.86)	32837	32792
marley	1000260580	0.00	(378.69, -219.85, 484.60)	32836	32792
marley	2212		0.01	(363.42, -209.35, 482.56)	32835	32792
marley	1000180360	0.00	(30.05, -163.53, 386.01)	32834	32792
marley	1000180400	0.01	(-34.02, -54.53, 326.54)	32833	32792
marley	1000180400	0.00	(-29.69, -59.08, 327.45)	32832	32792
marley	1000180360	0.00	(33.45, 14.94, 312.40)	32831	32792
marley	1000180400	0.00	(39.86, 15.90, 317.51)	32830	32792
marley	1000180400	0.01	(43.86, 20.38, 319.64)	32829	32792
marley	1000180400	0.00	(43.81, 20.35, 319.18)	32828	32792
marley	1000180400	0.01	(43.52, 19.18, 318.52)	32827	32792
marley	1000180360	0.01	(32.05, 29.21, 318.36)	32826	32792
marley	1000180360	0.00	(35.42, 27.52, 319.84)	32825	32792
marley	1000180400	0.00	(36.52, 29.42, 320.12)	32824	32792
marley	1000180400	0.00	(48.87, 26.05, 342.74)	32823	32792
marley	1000180400	0.01	(58.26, 29.18, 346.09)	32822	32792
marley	1000180400	0.01	(9.75, 5.37, 373.65)	32821	32792
marley	1000180400	0.00	(9.95, 5.56, 373.97)	32820	32792
marley	22		1.46	(14.36, 4.68, 375.38)	32794	32753
marley	1000180400	0.03	(14.36, 4.68, 375.38)	32793	32753
marley	2112		0.12	(14.36, 4.68, 375.38)	32792	32753
marley	1000180400	0.01	(26.16, 8.52, 418.33)	32791	32753
marley	1000180400	0.01	(26.54, 14.17, 433.93)	32790	32753
marley	22		1.46	(28.71, 29.93, 452.80)	32755	32749
marley	1000180400	0.18	(28.71, 29.93, 452.80)	32754	32749
marley	2112		1.63	(28.71, 29.93, 452.80)	32753	32749
marley	1000180400	0.03	(31.59, 29.27, 450.76)	32752	32749
marley	1000180400	0.25	(36.24, 30.27, 450.34)	32751	32749
marley	1000180400	0.20	(33.57, 33.23, 453.62)	32750	32749
marley	2112		3.75	(36.02, 35.35, 453.27)	32749	0
marley	1000190390	0.05	(36.02, 35.35, 453.27)	32748	0
marley	11		15.79	(36.02, 35.35, 453.27)	32747	0
Signal Track IDs: 32747; 32748; 32749; 32750; 32751; 32752; 32753; 32754; 32755; 32790; 32791; 32792; 32793; 32794; 32820; 32821; 32822; 32823; 32824; 32825; 32826; 32827; 32828; 32829; 32830; 32831; 32832; 32833; 32834; 32835; 32836; 32837; 32838; 32839; 32840; 32841; 32842; 32843; 32844; 32845; 32846; 32847; 32848; 32850; 32851; 32852; 32873; 32874; [0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Nov-2025 22:26:01 UTC run: 5089 subRun: 0 event: 237350
[33m
Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Nov-2025 22:26:03 UTC run: 5089 subRun: 0 event: 237350
[34mOpFlash PE 939.68 with purity 0.98 time 0.00 plane 0
 - Vertex (0.03, 19.34, 439.84)
	*** 1st Sanity check: Ratio 0.24 <= 1.00
	*** 2nd Sanity check: #OpHits 60 >= 60
OpFlash PE 5.31 with purity 1.00 time 0.03 plane 0
 - Vertex (0.05, 391.04, 300.41)
	*** 1st Sanity check: Ratio 0.36 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 3.89 with purity 1.00 time 0.03 plane 0
 - Vertex (0.05, 498.40, 752.33)
	*** 1st Sanity check: Ratio 0.50 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 106.19 with purity 0.98 time 0.04 plane 0
 - Vertex (0.05, 86.76, 419.58)
	*** 1st Sanity check: Ratio 0.17 <= 1.00
	*** 2nd Sanity check: #OpHits 25 >= 25
OpFlash PE 1.87 with purity 1.00 time 0.05 plane 0
 - Vertex (0.05, 529.30, 316.31)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 12.50 with purity 0.40 time 0.05 plane 0
 - Vertex (0.05, 93.41, 1013.48)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 62.79 with purity 0.88 time 0.06 plane 0
 - Vertex (0.02, 11.03, 412.16)
	*** 1st Sanity check: Ratio 0.26 <= 1.00
	*** 2nd Sanity check: #OpHits 17 >= 17
OpFlash PE 5.69 with purity 0.18 time 0.06 plane 0
 - Vertex (-0.05, -529.26, 999.94)
	*** 1st Sanity check: Ratio 0.37 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 16.60 with purity 0.15 time 0.06 plane 0
 - Vertex (-0.05, -278.74, 88.04)
	*** 1st Sanity check: Ratio 0.43 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 36.62 with purity 0.56 time 0.09 plane 0
 - Vertex (0.02, 50.04, 495.75)
	*** 1st Sanity check: Ratio 0.26 <= 1.00
	*** 2nd Sanity check: #OpHits 13 >= 13
OpFlash PE 16.05 with purity 0.38 time 0.11 plane 0
 - Vertex (-0.00, -27.01, 590.44)
	*** 1st Sanity check: Ratio 0.17 <= 1.00
	*** 2nd Sanity check: #OpHits 8 >= 8
OpFlash PE 172.44 with purity 0.50 time 0.29 plane 0
 - Vertex (-0.05, -31.14, 427.91)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1

# of OpFlashes (solarflash) in full geometry: 8420
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Nov-2025 22:26:03 UTC run: 5089 subRun: 0 event: 237350
[36m
# OpHits (ophitspe) in full geometry: 68830
# OpFlashes (solarflash) in full geometry: 8420
# Hits (hitfd) in each view: 169, 171, 424, 0
# Cluster from the hits: 109, 109, 390, 0
# Tracks (pmtracktc) in full geometry: 1[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Nov-2025 22:26:13 UTC run: 5089 subRun: 0 event: 237350
[32m
# ClusterReco: Looping over 249 matched clusters[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Nov-2025 22:26:13 UTC run: 5089 subRun: 0 event: 237350
[32m*** Matched preselection cluster: 0
 - MainTrackID 32794
 - Gen 1 -> marley TPC 4
 - Purity 1.00 Hits 2
 - Charge 166.48 ( MaxHit 104.34 )
 - #AdjCl 0 ( 0 signal ):
 - RecoCol  Time,Y,Z ( 17.81, -656.99, 382.62 )
 - RecoInd0 Time,Y,Z ( 17.82, -656.97, 287.03 )
 - RecoInd1 Time,Y,Z ( 17.66, -657.01, 443.15 )
*** Matched flash: 
 - Purity 0.00 Plane 0 #Hits 7 PE 32.42 MaxPE 13.19
 - Time 11.26 Fast 0.69 Residual 2.79
 - Reco Time,Y,Z ( 11.26, -580.58, 351.44 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 36.02, 35.35, 453.27 )
 - Main X,Y,Z ( 28.71, 29.93, 452.80 )
 - EDep X,Y,Z ( -5.84, -17.31, 382.66 )
 - Reco X,Y,Z ( -1.05, -656.99, 382.62 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Nov-2025 22:26:13 UTC run: 5089 subRun: 0 event: 237350
[32m*** Matched preselection cluster: 13
 - MainTrackID 32747
 - Gen 1 -> marley TPC 7
 - Purity 1.00 Hits 7
 - Charge 2114.19 ( MaxHit 481.51 )
 - #AdjCl 1 ( 1 signal ):
    - Cluster 6 at distance 55.80 with time 67.67 and charge 102.98 in TPC 7 and hits 1
 - RecoCol  Time,Y,Z ( 213.40, 33.48, 454.51 )
 - RecoInd0 Time,Y,Z ( 213.45, 33.46, 447.10 )
 - RecoInd1 Time,Y,Z ( 213.06, 33.50, 347.71 )
*** Matched flash: 
 - Purity 0.98 Plane 0 #Hits 60 PE 939.68 MaxPE 225.19
 - Time -18.10 Fast 0.90 Residual 335.78
 - Reco Time,Y,Z ( -18.10, 19.34, 439.84 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 36.02, 35.35, 453.27 )
 - Main X,Y,Z ( 37.89, 33.76, 455.69 )
 - EDep X,Y,Z ( 38.26, 31.44, 454.84 )
 - Reco X,Y,Z ( 37.17, 33.48, 454.51 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Nov-2025 22:26:13 UTC run: 5089 subRun: 0 event: 237350
[32m-----------------------------------------------------------------------------------------
[0m
%MSG
11-Nov-2025 22:26:13 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/4f/c3/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250207T130155Z_gen_004747_supernova_g4_detsim_reco_20250724T131406Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 11-Nov-2025 22:26:13 UTC  ModuleEndJob
[35mFinished running the SolarNuAna module[0m
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.129666       5.94555       14.8051      0.352489       6.49803        50     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00131229    0.00851113     0.138702     0.00222232     0.0196366       50     
end_path:solarnuana:SolarNuAna     0.127584       5.93685       14.8025      0.346568       6.50091        50     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 11-Nov-2025 22:26:13 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1552.61 MB
  Peak resident set size usage (VmHWM): 904.667 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 50 passed = 50 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         50         50          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 309.973104 Real = 321.465098

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1552.61 VmHWM = 904.667

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0