Jobsub ID 299698.1@dunegpschedd01.fnal.gov

Jobsub ID	299698.1@dunegpschedd01.fnal.gov
Workflow ID	12261
Stage ID	1
User name	smanthey@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-23 04:35:50
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2026-01-23 11:33:47
From worker node	Hostname	dunegli-8249451-0-fnpc19113.fnal.gov
	cpuinfo	AMD EPYC 7502 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-23 06:22:29
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T164024Z_gen_004539_supernova_g4stage1_g4stage2_detsim_reco_20250625T050935Z_reco2.root
Jobscript	Exit code	0
	Real time	5h (18662s)
	CPU time	5h (18535s = 99%)
	Max RSS bytes	2568785920 (2449 MiB)
Outputting started	2026-01-23 11:33:31
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/12261/1/001/fdhd_ana_2026-01-23T_062237Z_hist.root
Finished	2026-01-23 11:33:47
Saved logs	justin-logs:299698.1-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Particles in the event

# of particles 9	from gen 1 marley
# of particles 31435	from gen 2 Ar39GenInLAr
# of particles 3443	from gen 3 Kr85GenInLAr
# of particles 2	from gen 4 Ar42GenInLAr
# of particles 1	from gen 5 K42From42ArGenInLAr
# of particles 28	from gen 6 Rn222ChainRn222GenInLAr
# of particles 37	from gen 7 Rn222ChainPo218GenInLAr
# of particles 33	from gen 8 Rn222ChainPb214GenInLAr
# of particles 33	from gen 9 Rn222ChainBi214GenInLAr
# of particles 34	from gen 10 Rn222ChainPb210GenInLAr
# of particles 18	from gen 11 Rn220ChainPb212GenInLAr
# of particles 255	from gen 12 K40GenInCathode
# of particles 2998	from gen 13 U238ChainGenInCathode
# of particles 3992	from gen 14 Th232ChainGenInCathode
# of particles 116	from gen 15 K40GenInAnode
# of particles 1380	from gen 16 U238ChainGenInAnode
# of particles 1666	from gen 17 Th232ChainGenInAnode
# of particles 1	from gen 18 Rn222ChainGenInPDS
# of particles 4	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 1	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 17	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 51	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 56	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 45	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 37	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 17	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 11:00:57 UTC run: 5067 subRun: 0 event: 45390
[33m
Number of Signal Particles: 8
Neutrino Interaction: -1
Neutrino Energy: 23.57 MeV
Position (-184.66, -142.95, 699.59) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.69	(-184.66, -142.95, 699.59)	133593	133534
marley	-12		0.62	(-184.66, -142.95, 699.59)	133592	133534
marley	1000200400	0.00	(-184.66, -142.95, 699.59)	133591	133534
marley	22		0.03	(-184.66, -142.95, 699.59)	133538	0
marley	22		1.61	(-184.66, -142.95, 699.59)	133537	0
marley	22		0.65	(-184.66, -142.95, 699.59)	133536	0
marley	22		2.09	(-184.66, -142.95, 699.59)	133535	0
marley	1000190400	0.00	(-184.66, -142.95, 699.59)	133534	0
marley	11		17.68	(-184.66, -142.95, 699.59)	133533	0
Signal Track IDs: 133533; 133534; 133535; 133536; 133537; 133538; 133591; 133592; 133593; [0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 11:00:57 UTC run: 5067 subRun: 0 event: 45390
[33m
Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 11:02:11 UTC run: 5067 subRun: 0 event: 45390
[34mOpFlash PE 34.53 with purity 0.12 time -5.60 plane 0
 - Vertex (-327.50, 293.40, 1302.78)
	*** 1st Sanity check: Ratio 0.58 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 193.97 with purity 0.15 time -3.04 plane 1
 - Vertex (241.32, 743.30, 1641.62)
	*** 1st Sanity check: Ratio 0.29 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 29.18 with purity 0.24 time -0.16 plane 1
 - Vertex (154.87, 743.30, 523.05)
	*** 1st Sanity check: Ratio 0.35 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 1273.38 with purity 0.26 time 0.15 plane 0
 - Vertex (-327.50, -129.85, 714.96)
	*** 1st Sanity check: Ratio 0.09 <= 1.00
	*** 2nd Sanity check: #OpHits 44 >= 44
OpFlash PE 173.53 with purity 0.32 time 1.75 plane 1
 - Vertex (285.07, 743.30, 1641.62)
	*** 1st Sanity check: Ratio 0.42 <= 1.00
	*** 2nd Sanity check: #OpHits 9 >= 9
OpFlash PE 50.87 with purity 0.05 time 1.82 plane 2
 - Vertex (94.21, -743.30, 695.81)
	*** 1st Sanity check: Ratio 0.22 <= 1.00
	*** 2nd Sanity check: #OpHits 8 >= 8
OpFlash PE 48.70 with purity 0.29 time 2.16 plane 0
 - Vertex (-327.50, -411.59, 918.54)
	*** 1st Sanity check: Ratio 0.29 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 69.01 with purity 0.27 time 2.09 plane 0
 - Vertex (-327.50, 108.39, 929.70)
	*** 1st Sanity check: Ratio 0.19 <= 1.00
	*** 2nd Sanity check: #OpHits 10 >= 10
OpFlash PE 13.86 with purity 0.56 time 3.41 plane 0
 - Vertex (-327.50, 536.71, 1727.45)
	*** 1st Sanity check: Ratio 0.56 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 37.73 with purity 0.33 time 4.50 plane 0
 - Vertex (-327.50, -499.20, 841.54)
	*** 1st Sanity check: Ratio 0.20 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 21.89 with purity 0.10 time 5.86 plane 0
 - Vertex (-327.50, -42.92, 662.62)
	*** 1st Sanity check: Ratio 0.30 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4

# of OpHits (ophit10ppm): 52784 for times between -4254.31 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 18225 for times between -4254.31 us and 295147919198126080.00 us.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 11:02:14 UTC run: 5067 subRun: 0 event: 45390
[36m
# OpHits (ophit10ppm) in full geometry: 52784
# OpFlashes (solarflash) in full geometry: 18225
# Hits (gaushit) in each view: 6832, 6689, 6671, 0
# Cluster from the hits: 2847, 2875, 5648, 0
# Tracks (pmtracktc) in full geometry: 493[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 11:33:31 UTC run: 5067 subRun: 0 event: 45390
[32m
# ClusterReco: Looping over 5643 matched clusters[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 11:33:31 UTC run: 5067 subRun: 0 event: 45390
[32m*** Matched preselection cluster: 4231 from 5643
 - MainTrackID 133533
 - Gen 1 -> marley TPC 35
 - Purity 1.00 Hits 13
 - Charge 1901.17 ( MaxHit 237.11 )
 - #AdjCl 8 ( 1 signal ):
    - Cluster 3562 at distance 96.49 with time 2704.80 and charge 26.33 in TPC 37 and hits 1
    - Cluster 3690 at distance 80.85 with time 2787.52 and charge 79.75 in TPC 33 and hits 1
    - Cluster 3944 at distance 51.85 with time 2960.27 and charge 21.92 in TPC 37 and hits 1
    - Cluster 4083 at distance 75.41 with time 3058.17 and charge 93.84 in TPC 35 and hits 1
    - Cluster 4139 at distance 78.88 with time 3097.25 and charge 129.04 in TPC 43 and hits 1
    - Cluster 4144 at distance 33.14 with time 3098.58 and charge 187.25 in TPC 35 and hits 3
    - Cluster 4196 at distance 94.98 with time 3138.21 and charge 38.87 in TPC 43 and hits 1
    - Cluster 4628 at distance 91.88 with time 3491.72 and charge 116.27 in TPC 35 and hits 1
 - RecoCol  Time,Y,Z ( 3171.07, -146.33, 701.82 )
 - RecoInd0 Time,Y,Z ( 3171.01, -146.30, 669.03 )
 - RecoInd1 Time,Y,Z ( 3170.93, -146.36, 705.48 )
*** Matched flash: 9023 from 18225
 - Purity 26.11 % Plane 0 #Hits 44
 - MainOpHitPE 118.37 (PE);  TotalPE 1273.38 vs expected 726.00 (PE)
 - Time 0.15 (us) Fast 31.91 % Residual 761.06
 - Reco Time,Y,Z ( 0.15, -129.85, 714.96 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -184.66, -142.95, 699.59 )
 - Main X,Y,Z ( -184.25, -148.39, 703.80 )
 - EDep X,Y,Z ( -183.67, -147.87, 702.95 )
 - Reco X,Y,Z ( -184.10, -146.33, 701.82 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 11:33:31 UTC run: 5067 subRun: 0 event: 45390
[32m-----------------------------------------------------------------------------------------
[0m
%MSG
23-Jan-2026 11:33:31 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/8e/78/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T164024Z_gen_004539_supernova_g4stage1_g4stage2_detsim_reco_20250625T050935Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 23-Jan-2026 11:33:31 UTC  ModuleEndJob
[35mFinished running the SolarNuAna module[0m
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.915606       1861.22       3265.06       1955.16       1034.57        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000554375   0.00824513     0.0166348    0.00796744    0.00607957       10     
end_path:solarnuana:SolarNuAna     0.912999       1861.21       3265.06       1955.15       1034.57        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 23-Jan-2026 11:33:31 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3194.44 MB
  Peak resident set size usage (VmHWM): 2568.79 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 18519.664367 Real = 18644.546033

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3194.44 VmHWM = 2568.79

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===