Jobsub ID 299100.1@dunegpschedd01.fnal.gov

Jobsub ID	299100.1@dunegpschedd01.fnal.gov
Workflow ID	12150
Stage ID	1
User name	smanthey@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-22 07:26:42
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2026-01-22 11:30:47
From worker node	Hostname	dunegli-8242260-0-fnpc19126.fnal.gov
	cpuinfo	AMD EPYC 7502 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-22 07:27:01
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T190339Z_gen_000898_supernova_g4stage1_g4stage2_detsim_reco_20250730T125057Z_reco2.root
Jobscript	Exit code	0
	Real time	4h (14618s)
	CPU time	4h (14522s = 99%)
	Max RSS bytes	2561433600 (2442 MiB)
Outputting started	2026-01-22 11:30:39
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/12150/1/001/fdhd_ana_2026-01-22T_072709Z_hist.root
Finished	2026-01-22 11:30:47
Saved logs	justin-logs:299100.1-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

un: 0 event: 8979
[33m
Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 30.17 MeV
Position (86.78, 287.47, 545.64) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.20	(86.78, 287.47, 545.64)	132587	132558
marley	-12		0.51	(86.78, 287.47, 545.64)	132586	132558
marley	22		0.79	(86.78, 287.47, 545.64)	132561	0
marley	22		2.77	(86.78, 287.47, 545.64)	132560	0
marley	1000020040	3.98	(86.78, 287.47, 545.64)	132559	0
marley	1000170360	0.50	(86.78, 287.47, 545.64)	132558	0
marley	11		14.18	(86.78, 287.47, 545.64)	132557	0
Signal Track IDs: 132557; 132558; 132559; 132560; 132561; 132586; 132587; [0m
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 10:51:11 UTC run: 5038 subRun: 0 event: 8979
[31m
Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.
[0m
%MSG
Begin processing the 10th record. run: 5038 subRun: 0 event: 8980 at 22-Jan-2026 10:51:11 UTC
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 10:51:14 UTC run: 5038 subRun: 0 event: 8980
[35m
###################################################
Event:			8980
Flag:			1807523442
Geometry:		dunevd10kt_3view_30deg_v5_refactored_1x8x14ref (VD)
Signal Label:		marley
PDS Frequency in [MHz]:	62.50
PDS Tick in [us]:	0.016
TPC Frequency in [MHz]:	2.00
TPC Tick in [us]:	0.50
TPC Map:		112 TPCs
TPC DriftLength in [cm]:650.07
TPC DriftTime in [us]:	4048.69
Fiducial Volume in [cm]:850.32, 1507.84, 2306.12
###################################################[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 10:51:14 UTC run: 5038 subRun: 0 event: 8980
[91m
There are a total of 132552 Particles in the event

# of particles 7	from gen 1 marley
# of particles 30922	from gen 2 Ar39GenInLAr
# of particles 3489	from gen 3 Kr85GenInLAr
# of particles 3	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 31	from gen 6 Rn222ChainRn222GenInLAr
# of particles 30	from gen 7 Rn222ChainPo218GenInLAr
# of particles 38	from gen 8 Rn222ChainPb214GenInLAr
# of particles 50	from gen 9 Rn222ChainBi214GenInLAr
# of particles 32	from gen 10 Rn222ChainPb210GenInLAr
# of particles 29	from gen 11 Rn220ChainPb212GenInLAr
# of particles 250	from gen 12 K40GenInCathode
# of particles 2907	from gen 13 U238ChainGenInCathode
# of particles 3684	from gen 14 Th232ChainGenInCathode
# of particles 85	from gen 15 K40GenInAnode
# of particles 1344	from gen 16 U238ChainGenInAnode
# of particles 1578	from gen 17 Th232ChainGenInAnode
# of particles 0	from gen 18 Rn222ChainGenInPDS
# of particles 1	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 1	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 16	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 54	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 49	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 41	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 46	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 17	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 10:51:14 UTC run: 5038 subRun: 0 event: 8980
[33m
Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 24.21 MeV
Position (-220.34, 445.23, 405.95) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.35	(-220.34, 445.23, 405.95)	132585	132531
marley	-12		0.21	(-220.34, 445.23, 405.95)	132584	132531
marley	22		1.27	(-220.34, 445.23, 405.95)	132534	0
marley	22		1.09	(-220.34, 445.23, 405.95)	132533	0
marley	2212		6.11	(-220.34, 445.23, 405.95)	132532	0
marley	1000180390	0.19	(-220.34, 445.23, 405.95)	132531	0
marley	11		6.47	(-220.34, 445.23, 405.95)	132530	0
Signal Track IDs: 132530; 132531; 132532; 132533; 132534; 132584; 132585; [0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 10:51:14 UTC run: 5038 subRun: 0 event: 8980
[33m
Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 10:52:18 UTC run: 5038 subRun: 0 event: 8980
[34mOpFlash PE 1228.70 with purity 0.39 time 0.12 plane 0
 - Vertex (-327.50, 440.76, 373.62)
	*** 1st Sanity check: Ratio 0.14 <= 1.00
	*** 2nd Sanity check: #OpHits 30 >= 30
OpFlash PE 25.96 with purity 0.41 time 4.57 plane 0
 - Vertex (-327.50, 465.37, 555.45)
	*** 1st Sanity check: Ratio 0.41 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4

# of OpHits (ophit10ppm): 52239 for times between -4254.66 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 18292 for times between -4254.66 us and 295147919198126080.00 us.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 10:52:21 UTC run: 5038 subRun: 0 event: 8980
[36m
# OpHits (ophit10ppm) in full geometry: 52239
# OpFlashes (solarflash) in full geometry: 18292
# Hits (gaushit) in each view: 6644, 6574, 6693, 0
# Cluster from the hits: 2779, 2773, 5682, 0
# Tracks (pmtracktc) in full geometry: 482[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 11:30:39 UTC run: 5038 subRun: 0 event: 8980
[32m
# ClusterReco: Looping over 5667 matched clusters[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 11:30:39 UTC run: 5038 subRun: 0 event: 8980
[32m*** Matched preselection cluster: 4413 from 5667
 - MainTrackID 132530
 - Gen 1 -> marley TPC 22
 - Purity 1.00 Hits 7
 - Charge 725.58 ( MaxHit 243.60 )
 - #AdjCl 7 ( 2 signal ):
    - Cluster 4028 at distance 97.54 with time 3085.78 and charge 22.79 in TPC 24 and hits 1
    - Cluster 4444 at distance 95.56 with time 3415.89 and charge 41.91 in TPC 22 and hits 1
    - Cluster 4567 at distance 57.32 with time 3497.52 and charge 36.53 in TPC 22 and hits 1
    - Cluster 4662 at distance 47.75 with time 3578.86 and charge 24.04 in TPC 16 and hits 1
    - Cluster 4716 at distance 69.82 with time 3612.85 and charge 56.90 in TPC 30 and hits 1
    - Cluster 4864 at distance 73.24 with time 3709.64 and charge 75.35 in TPC 22 and hits 1
    - Cluster 4940 at distance 72.52 with time 3762.19 and charge 204.51 in TPC 22 and hits 2
 - RecoCol  Time,Y,Z ( 3392.33, 446.06, 406.21 )
 - RecoInd0 Time,Y,Z ( 3393.51, 446.04, 376.46 )
 - RecoInd1 Time,Y,Z ( 3393.80, 446.09, 373.80 )
*** Matched flash: 9148 from 18292
 - Purity 38.95 % Plane 0 #Hits 30
 - MainOpHitPE 168.68 (PE);  TotalPE 1228.70 vs expected 333.50 (PE)
 - Time 0.12 (us) Fast 13.81 % Residual 3513.90
 - Reco Time,Y,Z ( 0.12, 440.76, 373.62 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -220.34, 445.23, 405.95 )
 - Main X,Y,Z ( -219.08, 446.29, 406.43 )
 - EDep X,Y,Z ( -220.31, 445.34, 405.95 )
 - Reco X,Y,Z ( -219.63, 446.06, 406.21 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 11:30:39 UTC run: 5038 subRun: 0 event: 8980
[32m-----------------------------------------------------------------------------------------
[0m
%MSG
22-Jan-2026 11:30:39 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/30/87/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T190339Z_gen_000898_supernova_g4stage1_g4stage2_detsim_reco_20250730T125057Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 22-Jan-2026 11:30:39 UTC  ModuleEndJob
[35mFinished running the SolarNuAna module[0m
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.861133       1456.83       2766.07       2198.87       1201.31        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00138254    0.00941677     0.0204367    0.00784202    0.00746612       10     
end_path:solarnuana:SolarNuAna     0.859578       1456.82       2766.07       2198.86       1201.31        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 22-Jan-2026 11:30:39 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3185.06 MB
  Peak resident set size usage (VmHWM): 2561.43 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 14507.618457 Real = 14600.717468

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3185.06 VmHWM = 2561.43

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===