Jobsub ID 300856.0@dunegpschedd01.fnal.gov

Jobsub ID	300856.0@dunegpschedd01.fnal.gov
Workflow ID	12372
Stage ID	1
User name	smanthey@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-25 17:59:06
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2026-01-26 10:30:54
From worker node	Hostname	dunegli-8279335-0-fnpc22029.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-26 07:16:21
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T190728Z_gen_004062_supernova_g4stage1_g4stage2_detsim_reco_20250702T120747Z_reco2.root
Jobscript	Exit code	0
	Real time	3h (11630s)
	CPU time	3h (11544s = 99%)
	Max RSS bytes	2571231232 (2452 MiB)
Outputting started	2026-01-26 10:30:11
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/12372/1/001/fdhd_ana_2026-01-26T_071628Z_hist.root
Finished	2026-01-26 10:30:54
Saved logs	justin-logs:300856.0-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

.00, 309.48)
	*** 1st Sanity check: Ratio 0.06 <= 1.00
	*** 2nd Sanity check: #OpHits 44 >= 44
OpFlash PE 45.89 with purity 0.27 time 0.20 plane 2
 - Vertex (124.10, -743.30, 454.75)
	*** 1st Sanity check: Ratio 0.30 <= 1.00
	*** 2nd Sanity check: #OpHits 6 >= 6
OpFlash PE 48.17 with purity 0.35 time 1.57 plane 0
 - Vertex (-327.50, 487.61, 711.05)
	*** 1st Sanity check: Ratio 0.30 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 51.35 with purity 0.44 time 2.70 plane 0
 - Vertex (-327.50, -199.28, 290.86)
	*** 1st Sanity check: Ratio 0.29 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 9.32 with purity 0.50 time 3.74 plane 2
 - Vertex (135.07, -743.30, 450.26)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1

# of OpHits (ophit10ppm): 52493 for times between -4254.31 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 18313 for times between -4254.31 us and 295147919198126080.00 us.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 09:56:28 UTC run: 5057 subRun: 0 event: 40619
[36m
# OpHits (ophit10ppm) in full geometry: 52493
# OpFlashes (solarflash) in full geometry: 18313
# Hits (gaushit) in each view: 6713, 6636, 6712, 0
# Cluster from the hits: 2821, 2818, 5690, 0
# Tracks (pmtracktc) in full geometry: 464[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 10:30:07 UTC run: 5057 subRun: 0 event: 40619
[32m
# ClusterReco: Looping over 5688 matched clusters[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 10:30:07 UTC run: 5057 subRun: 0 event: 40619
[32m*** Matched preselection cluster: 4414 from 5688
 - MainTrackID 132634
 - Gen 1 -> marley TPC 10
 - Purity 1.00 Hits 6
 - Charge 1082.96 ( MaxHit 250.88 )
 - #AdjCl 13 ( 1 signal ):
    - Cluster 3809 at distance 90.54 with time 2880.04 and charge 48.89 in TPC 22 and hits 2
    - Cluster 4128 at distance 44.70 with time 3115.66 and charge 59.65 in TPC 20 and hits 2
    - Cluster 4198 at distance 98.41 with time 3178.47 and charge 28.07 in TPC 20 and hits 1
    - Cluster 4267 at distance 47.78 with time 3227.36 and charge 149.64 in TPC 10 and hits 1
    - Cluster 4337 at distance 52.40 with time 3273.17 and charge 42.14 in TPC 18 and hits 2
    - Cluster 4379 at distance 36.66 with time 3300.95 and charge 376.81 in TPC 10 and hits 3
    - Cluster 4438 at distance 21.33 with time 3345.94 and charge 29.28 in TPC 8 and hits 1
    - Cluster 4667 at distance 84.29 with time 3517.96 and charge 105.33 in TPC 18 and hits 2
    - Cluster 4822 at distance 90.36 with time 3623.89 and charge 23.67 in TPC 18 and hits 1
    - Cluster 4888 at distance 81.66 with time 3668.08 and charge 47.05 in TPC 18 and hits 2
    - Cluster 4933 at distance 80.66 with time 3699.47 and charge 26.22 in TPC 8 and hits 1
    - Cluster 5077 at distance 95.09 with time 3815.16 and charge 29.83 in TPC 8 and hits 1
    - Cluster 5152 at distance 98.60 with time 3869.10 and charge 125.99 in TPC 20 and hits 3
 - RecoCol  Time,Y,Z ( 3325.38, -332.58, 284.54 )
 - RecoInd0 Time,Y,Z ( 3324.96, -332.57, 219.92 )
 - RecoInd1 Time,Y,Z ( 3325.22, -332.59, 288.52 )
*** Matched flash: 9102 from 18313
 - Purity 30.53 % Plane 0 #Hits 44
 - MainOpHitPE 72.97 (PE);  TotalPE 1147.05 vs expected 461.20 (PE)
 - Time 0.28 (us) Fast 29.81 % Residual 242.42
 - Reco Time,Y,Z ( 0.28, -291.00, 309.48 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -209.90, -331.18, 283.53 )
 - Main X,Y,Z ( -208.85, -332.83, 285.67 )
 - EDep X,Y,Z ( -208.38, -332.97, 284.59 )
 - Reco X,Y,Z ( -208.85, -332.58, 284.54 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 10:30:07 UTC run: 5057 subRun: 0 event: 40619
[32m-----------------------------------------------------------------------------------------
[0m
%MSG
Begin processing the 10th record. run: 5057 subRun: 0 event: 40620 at 26-Jan-2026 10:30:08 UTC
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 10:30:10 UTC run: 5057 subRun: 0 event: 40620
[35m
###################################################
Event:			40620
Flag:			766363650
Geometry:		dunevd10kt_3view_30deg_v5_refactored_1x8x14ref (VD)
Signal Label:		marley
PDS Frequency in [MHz]:	62.50
PDS Tick in [us]:	0.016
TPC Frequency in [MHz]:	2.00
TPC Tick in [us]:	0.50
TPC Map:		112 TPCs
TPC DriftLength in [cm]:650.07
TPC DriftTime in [us]:	4048.69
Fiducial Volume in [cm]:850.32, 1507.84, 2306.12
###################################################[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 10:30:10 UTC run: 5057 subRun: 0 event: 40620
[91m
There are a total of 132619 Particles in the event

# of particles 8	from gen 1 marley
# of particles 30946	from gen 2 Ar39GenInLAr
# of particles 3548	from gen 3 Kr85GenInLAr
# of particles 3	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 37	from gen 6 Rn222ChainRn222GenInLAr
# of particles 21	from gen 7 Rn222ChainPo218GenInLAr
# of particles 77	from gen 8 Rn222ChainPb214GenInLAr
# of particles 20	from gen 9 Rn222ChainBi214GenInLAr
# of particles 13	from gen 10 Rn222ChainPb210GenInLAr
# of particles 39	from gen 11 Rn220ChainPb212GenInLAr
# of particles 269	from gen 12 K40GenInCathode
# of particles 2858	from gen 13 U238ChainGenInCathode
# of particles 3558	from gen 14 Th232ChainGenInCathode
# of particles 89	from gen 15 K40GenInAnode
# of particles 1348	from gen 16 U238ChainGenInAnode
# of particles 1690	from gen 17 Th232ChainGenInAnode
# of particles 0	from gen 18 Rn222ChainGenInPDS
# of particles 1	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 1	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 11	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 72	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 68	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 41	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 39	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 14	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 10:30:10 UTC run: 5057 subRun: 0 event: 40620
[33m
Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 46.08 MeV
Position (64.00, 612.30, 1667.13) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.07	(64.00, 612.30, 1667.13)	132656	132600
marley	-12		1.25	(64.00, 612.30, 1667.13)	132655	132600
marley	1000200400	0.00	(64.00, 612.30, 1667.13)	132654	132600
marley	22		0.03	(64.00, 612.30, 1667.13)	132603	0
marley	22		0.77	(64.00, 612.30, 1667.13)	132602	0
marley	22		5.98	(64.00, 612.30, 1667.13)	132601	0
marley	1000190400	0.09	(64.00, 612.30, 1667.13)	132600	0
marley	11		37.70	(64.00, 612.30, 1667.13)	132599	0
Signal Track IDs: 132599; 132600; 132601; 132602; 132603; 132654; 132655; 132656; [0m
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 10:30:10 UTC run: 5057 subRun: 0 event: 40620
[31m
Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.
[0m
%MSG
26-Jan-2026 10:30:11 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/08/2e/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T190728Z_gen_004062_supernova_g4stage1_g4stage2_detsim_reco_20250702T120747Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 26-Jan-2026 10:30:11 UTC  ModuleEndJob
[35mFinished running the SolarNuAna module[0m
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.603622       1159.12       2241.25       1599.44       973.36         10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000630767    0.0115455     0.0355258     0.0086381     0.0108668       10     
end_path:solarnuana:SolarNuAna     0.584291       1159.11       2241.24       1599.43       973.359        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 26-Jan-2026 10:30:11 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3196.14 MB
  Peak resident set size usage (VmHWM): 2571.23 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 11531.236826 Real = 11614.962839

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3196.14 VmHWM = 2571.23

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===