Jobsub ID 300251.178@dunegpschedd01.fnal.gov

Jobsub ID	300251.178@dunegpschedd01.fnal.gov
Workflow ID	12375
Stage ID	1
User name	smanthey@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-24 19:22:00
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat	2026-01-25 17:35:25
From worker node	Hostname	dunegli-8427007-0-fnpc18005.fnal.gov
	cpuinfo	AMD EPYC 7551 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-25 06:37:26
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T100320Z_gen_003663_supernova_g4stage1_g4stage2_detsim_reco_20250628T015359Z_reco2.root
Jobscript	Exit code	0
	Real time	10h (39453s)
	CPU time	10h (38790s = 98%)
	Max RSS bytes	2574020608 (2454 MiB)
Outputting started	2026-01-25 17:34:59
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/12375/1/001/fdhd_ana_2026-01-25T_063745Z_hist.root
Finished	2026-01-25 17:35:25
Saved logs	justin-logs:300251.178-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Bi214GenInUpperMesh1x8x14
# of particles 38	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 38	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 58	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 83844	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3566	from gen 27 foamGammasAtLAr1x8x14
# of particles 0	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 0	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 15:59:05 UTC run: 5004 subRun: 0 event: 36629
[33m
Number of Signal Particles: 8
Neutrino Interaction: -1
Neutrino Energy: 24.38 MeV
Position (371.59, 347.31, 960.47) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		1.23	(371.60, 347.31, 960.47)	132400	132325
marley	-12		0.09	(371.60, 347.31, 960.47)	132399	132325
marley	1000200400	0.00	(371.60, 347.31, 960.47)	132398	132325
marley	22		0.03	(371.59, 347.31, 960.47)	132329	0
marley	22		0.77	(371.59, 347.31, 960.47)	132328	0
marley	22		1.16	(371.59, 347.31, 960.47)	132327	0
marley	22		0.33	(371.59, 347.31, 960.47)	132326	0
marley	1000190400	0.02	(371.59, 347.31, 960.47)	132325	0
marley	11		20.57	(371.59, 347.31, 960.47)	132324	0
Signal Track IDs: 132324; 132325; 132326; 132327; 132328; 132329; 132398; 132399; 132400; [0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 15:59:05 UTC run: 5004 subRun: 0 event: 36629
[33m
Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 16:01:03 UTC run: 5004 subRun: 0 event: 36629
[34mOpFlash PE 211.68 with purity 0.22 time -0.31 plane 1
 - Vertex (272.05, 743.30, 1343.78)
	*** 1st Sanity check: Ratio 0.30 <= 1.00
	*** 2nd Sanity check: #OpHits 12 >= 12
OpFlash PE 161.59 with purity 0.25 time -0.06 plane 1
 - Vertex (198.48, 743.30, 989.51)
	*** 1st Sanity check: Ratio 0.14 <= 1.00
	*** 2nd Sanity check: #OpHits 13 >= 13
OpFlash PE 106.63 with purity 0.24 time 0.74 plane 0
 - Vertex (-327.50, 231.24, 862.58)
	*** 1st Sanity check: Ratio 0.12 <= 1.00
	*** 2nd Sanity check: #OpHits 16 >= 16
OpFlash PE 104.21 with purity 0.25 time 1.82 plane 2
 - Vertex (135.07, -743.30, 450.26)
	*** 1st Sanity check: Ratio 0.28 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 13.34 with purity 0.70 time 3.46 plane 0
 - Vertex (-327.50, 367.94, 958.69)
	*** 1st Sanity check: Ratio 0.70 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 40.81 with purity 0.12 time 2.94 plane 1
 - Vertex (243.18, 743.30, 1498.92)
	*** 1st Sanity check: Ratio 0.27 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5

# of OpHits (ophit10ppm): 53113 for times between -4253.16 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 18415 for times between -4253.03 us and 295147919198126080.00 us.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 16:01:06 UTC run: 5004 subRun: 0 event: 36629
[36m
# OpHits (ophit10ppm) in full geometry: 53113
# OpFlashes (solarflash) in full geometry: 18415
# Hits (gaushit) in each view: 6613, 6511, 6660, 0
# Cluster from the hits: 2760, 2797, 5660, 0
# Tracks (pmtracktc) in full geometry: 482[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 17:34:48 UTC run: 5004 subRun: 0 event: 36629
[32m
# ClusterReco: Looping over 5654 matched clusters[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 17:34:48 UTC run: 5004 subRun: 0 event: 36629
[32m-----------------------------------------------------------------------------------------
[0m
%MSG
Begin processing the 10th record. run: 5004 subRun: 0 event: 36630 at 25-Jan-2026 17:34:49 UTC
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 17:34:55 UTC run: 5004 subRun: 0 event: 36630
[35m
###################################################
Event:			36630
Flag:			290674005
Geometry:		dunevd10kt_3view_30deg_v5_refactored_1x8x14ref (VD)
Signal Label:		marley
PDS Frequency in [MHz]:	62.50
PDS Tick in [us]:	0.016
TPC Frequency in [MHz]:	2.00
TPC Tick in [us]:	0.50
TPC Map:		112 TPCs
TPC DriftLength in [cm]:650.07
TPC DriftTime in [us]:	4048.69
Fiducial Volume in [cm]:850.32, 1507.84, 2306.12
###################################################[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 17:34:57 UTC run: 5004 subRun: 0 event: 36630
[91m
There are a total of 133053 Particles in the event

# of particles 9	from gen 1 marley
# of particles 31264	from gen 2 Ar39GenInLAr
# of particles 3595	from gen 3 Kr85GenInLAr
# of particles 1	from gen 4 Ar42GenInLAr
# of particles 3	from gen 5 K42From42ArGenInLAr
# of particles 28	from gen 6 Rn222ChainRn222GenInLAr
# of particles 27	from gen 7 Rn222ChainPo218GenInLAr
# of particles 60	from gen 8 Rn222ChainPb214GenInLAr
# of particles 39	from gen 9 Rn222ChainBi214GenInLAr
# of particles 18	from gen 10 Rn222ChainPb210GenInLAr
# of particles 21	from gen 11 Rn220ChainPb212GenInLAr
# of particles 218	from gen 12 K40GenInCathode
# of particles 3096	from gen 13 U238ChainGenInCathode
# of particles 3503	from gen 14 Th232ChainGenInCathode
# of particles 94	from gen 15 K40GenInAnode
# of particles 1434	from gen 16 U238ChainGenInAnode
# of particles 1590	from gen 17 Th232ChainGenInAnode
# of particles 1	from gen 18 Rn222ChainGenInPDS
# of particles 3	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 1	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 19	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 33	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 49	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 39	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 41	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 19	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 17:34:57 UTC run: 5004 subRun: 0 event: 36630
[33m
Number of Signal Particles: 8
Neutrino Interaction: -1
Neutrino Energy: 64.91 MeV
Position (-202.34, 31.14, 1553.13) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.38	(-202.34, 31.14, 1553.13)	133077	133026
marley	-12		0.93	(-202.34, 31.14, 1553.13)	133076	133026
marley	1000200400	0.00	(-202.34, 31.14, 1553.13)	133075	133026
marley	22		0.03	(-202.34, 31.14, 1553.13)	133030	0
marley	22		1.61	(-202.34, 31.14, 1553.13)	133029	0
marley	22		0.65	(-202.34, 31.14, 1553.13)	133028	0
marley	22		2.10	(-202.34, 31.14, 1553.13)	133027	0
marley	1000190400	0.07	(-202.34, 31.14, 1553.13)	133026	0
marley	11		58.95	(-202.34, 31.14, 1553.13)	133025	0
Signal Track IDs: 133025; 133026; 133027; 133028; 133029; 133030; 133075; 133076; 133077; [0m
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 17:34:57 UTC run: 5004 subRun: 0 event: 36630
[31m
Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.
[0m
%MSG
25-Jan-2026 17:34:58 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/ba/5a/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T100320Z_gen_003663_supernova_g4stage1_g4stage2_detsim_reco_20250628T015359Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 25-Jan-2026 17:34:58 UTC  ModuleEndJob
[35mFinished running the SolarNuAna module[0m
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          2.0023        3933.8        7801.65       5817.67       3260.5         10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00256275     0.0120385     0.0229877     0.0117467    0.00788485       10     
end_path:solarnuana:SolarNuAna      1.99609       3933.79       7801.65       5817.66       3260.5         10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 25-Jan-2026 17:34:58 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3189.72 MB
  Peak resident set size usage (VmHWM): 2574.02 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 38751.424704 Real = 39407.461567

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3189.72 VmHWM = 2574.02

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===