Jobsub ID 278126.1@dunegpschedd01.fnal.gov

Jobsub ID	278126.1@dunegpschedd01.fnal.gov
Workflow ID	11809
Stage ID	1
User name	smanthey@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-14 19:24:54
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat	2026-01-15 02:47:38
From worker node	Hostname	dunegli-8318973-0-fnpc22016.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-14 23:00:05
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T195720Z_gen_001319_supernova_g4stage1_g4stage2_detsim_reco_20250626T234157Z_reco2.root
Jobscript	Exit code	0
	Real time	3h (13645s)
	CPU time	3h (13519s = 99%)
	Max RSS bytes	2551361536 (2433 MiB)
Outputting started	2026-01-15 02:47:31
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/11809/1/001/fdhd_ana_2026-01-14T_230017Z_hist.root
Finished	2026-01-15 02:47:38
Saved logs	justin-logs:278126.1-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

t: 13190 at 15-Jan-2026 02:15:51 UTC
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 02:15:53 UTC run: 5038 subRun: 0 event: 13190
[35m
###################################################
Event:			13190
Flag:			623613162
Geometry:		dunevd10kt_3view_30deg_v5_refactored_1x8x14ref (VD)
Signal Label:		marley
PDS Frequency in [MHz]:	62.50
PDS Tick in [us]:	0.016
TPC Frequency in [MHz]:	2.00
TPC Tick in [us]:	0.50
TPC Map:		112 TPCs
TPC DriftLength in [cm]:650.07
TPC DriftTime in [us]:	4048.69
Fiducial Volume in [cm]:850.32, 1507.84, 2306.12
###################################################[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 02:15:53 UTC run: 5038 subRun: 0 event: 13190
[91m
There are a total of 133071 Particles in the event

# of particles 11	from gen 1 marley
# of particles 31050	from gen 2 Ar39GenInLAr
# of particles 3613	from gen 3 Kr85GenInLAr
# of particles 4	from gen 4 Ar42GenInLAr
# of particles 2	from gen 5 K42From42ArGenInLAr
# of particles 26	from gen 6 Rn222ChainRn222GenInLAr
# of particles 33	from gen 7 Rn222ChainPo218GenInLAr
# of particles 49	from gen 8 Rn222ChainPb214GenInLAr
# of particles 59	from gen 9 Rn222ChainBi214GenInLAr
# of particles 26	from gen 10 Rn222ChainPb210GenInLAr
# of particles 21	from gen 11 Rn220ChainPb212GenInLAr
# of particles 221	from gen 12 K40GenInCathode
# of particles 3016	from gen 13 U238ChainGenInCathode
# of particles 3654	from gen 14 Th232ChainGenInCathode
# of particles 122	from gen 15 K40GenInAnode
# of particles 1385	from gen 16 U238ChainGenInAnode
# of particles 1724	from gen 17 Th232ChainGenInAnode
# of particles 0	from gen 18 Rn222ChainGenInPDS
# of particles 1	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 1	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 28	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 49	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 51	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 38	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 26	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 13	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 02:15:53 UTC run: 5038 subRun: 0 event: 13190
[33m
Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 7.80 MeV
Position (9.36, 69.91, 564.39) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	22		1.46	(9.36, 69.91, 564.39)	133089	133050
marley	1000180400	0.00	(9.36, 69.91, 564.39)	133088	133050
marley	12		0.04	(9.36, 69.91, 564.39)	133087	133050
marley	22		0.00	(9.36, 69.91, 564.39)	133085	133050
marley	11		0.00	(9.36, 69.91, 564.39)	133084	133050
marley	11		0.00	(9.36, 69.91, 564.39)	133083	133050
marley	22		0.03	(9.36, 69.91, 564.39)	133053	0
marley	22		1.61	(9.36, 69.91, 564.39)	133052	0
marley	22		1.09	(9.36, 69.91, 564.39)	133051	0
marley	1000190400	0.00	(9.36, 69.91, 564.39)	133050	0
marley	11		3.57	(9.36, 69.91, 564.39)	133049	0
Signal Track IDs: 133049; 133050; 133051; 133052; 133053; 133083; 133084; 133085; 133087; 133088; 133089; [0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 02:15:53 UTC run: 5038 subRun: 0 event: 13190
[33m
Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 02:16:42 UTC run: 5038 subRun: 0 event: 13190
[34mOpFlash PE 17.47 with purity 0.34 time -0.79 plane 1
 - Vertex (138.68, 743.30, 838.65)
	*** 1st Sanity check: Ratio 0.35 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 64.09 with purity 0.53 time 0.29 plane 0
 - Vertex (-327.50, 251.96, 730.81)
	*** 1st Sanity check: Ratio 0.18 <= 1.00
	*** 2nd Sanity check: #OpHits 8 >= 8
OpFlash PE 109.33 with purity 0.41 time 0.29 plane 0
 - Vertex (-327.50, -89.14, 703.24)
	*** 1st Sanity check: Ratio 0.09 <= 1.00
	*** 2nd Sanity check: #OpHits 16 >= 16
OpFlash PE 77.82 with purity 0.23 time 0.17 plane 0
 - Vertex (-327.50, -239.57, 484.87)
	*** 1st Sanity check: Ratio 0.15 <= 1.00
	*** 2nd Sanity check: #OpHits 11 >= 11
OpFlash PE 34.20 with purity 0.32 time 1.26 plane 0
 - Vertex (-327.50, 102.00, 527.19)
	*** 1st Sanity check: Ratio 0.25 <= 1.00
	*** 2nd Sanity check: #OpHits 6 >= 6
OpFlash PE 23.38 with purity 0.16 time 2.26 plane 0
 - Vertex (-327.50, -433.83, 834.64)
	*** 1st Sanity check: Ratio 0.31 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4

# of OpHits (ophit10ppm): 52758 for times between -4253.51 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 18414 for times between -4253.51 us and 295147919198126080.00 us.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 02:16:44 UTC run: 5038 subRun: 0 event: 13190
[36m
# OpHits (ophit10ppm) in full geometry: 52758
# OpFlashes (solarflash) in full geometry: 18414
# Hits (gaushit) in each view: 6586, 6586, 6535, 0
# Cluster from the hits: 2720, 2803, 5564, 0
# Tracks (pmtracktc) in full geometry: 446[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 02:47:30 UTC run: 5038 subRun: 0 event: 13190
[32m
# ClusterReco: Looping over 5546 matched clusters[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 02:47:30 UTC run: 5038 subRun: 0 event: 13190
[32m*** Matched preselection cluster: 2554 from 5546
 - MainTrackID 133049
 - Gen 1 -> marley TPC 28
 - Purity 1.00 Hits 4
 - Charge 566.31 ( MaxHit 269.99 )
 - #AdjCl 11 ( 0 signal ):
    - Cluster 1969 at distance 70.28 with time 1540.64 and charge 29.14 in TPC 30 and hits 1
    - Cluster 2205 at distance 78.31 with time 1703.33 and charge 38.24 in TPC 28 and hits 1
    - Cluster 2231 at distance 73.94 with time 1720.07 and charge 61.14 in TPC 28 and hits 1
    - Cluster 2525 at distance 75.25 with time 1946.31 and charge 224.58 in TPC 36 and hits 3
    - Cluster 2540 at distance 88.01 with time 1958.48 and charge 37.03 in TPC 28 and hits 1
    - Cluster 2634 at distance 98.70 with time 2026.22 and charge 83.73 in TPC 28 and hits 1
    - Cluster 2831 at distance 52.29 with time 2187.60 and charge 44.87 in TPC 36 and hits 1
    - Cluster 2945 at distance 88.90 with time 2269.58 and charge 31.33 in TPC 32 and hits 1
    - Cluster 2951 at distance 69.49 with time 2271.91 and charge 31.07 in TPC 28 and hits 1
    - Cluster 3082 at distance 84.74 with time 2378.62 and charge 25.68 in TPC 24 and hits 1
    - Cluster 3217 at distance 87.98 with time 2484.28 and charge 27.41 in TPC 24 and hits 1
 - RecoCol  Time,Y,Z ( 1967.36, 69.54, 564.02 )
 - RecoInd0 Time,Y,Z ( 1967.40, 69.52, 522.72 )
 - RecoInd1 Time,Y,Z ( 1967.40, 69.55, 522.72 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 9.36, 69.91, 564.39 )
 - Main X,Y,Z ( 9.42, 69.64, 563.67 )
 - EDep X,Y,Z ( 9.26, 69.74, 563.98 )
 - Reco X,Y,Z ( -1000000.00, 69.54, 564.02 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 02:47:30 UTC run: 5038 subRun: 0 event: 13190
[32m-----------------------------------------------------------------------------------------
[0m
%MSG
15-Jan-2026 02:47:30 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/d8/39/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T195720Z_gen_001319_supernova_g4stage1_g4stage2_detsim_reco_20250626T234157Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 15-Jan-2026 02:47:30 UTC  ModuleEndJob
[35mFinished running the SolarNuAna module[0m
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.593812       1359.59       2818.73       1874.53       1150.36        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000655447   0.00773606     0.0183216    0.00655055    0.00640608       10     
end_path:solarnuana:SolarNuAna     0.575328       1359.58       2818.71       1874.53       1150.37        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 15-Jan-2026 02:47:30 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3191.49 MB
  Peak resident set size usage (VmHWM): 2551.36 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 13507.387451 Real = 13624.756865

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3191.49 VmHWM = 2551.36

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===