Jobsub ID 294232.1@dunegpschedd02.fnal.gov

Jobsub ID	294232.1@dunegpschedd02.fnal.gov
Workflow ID	12259
Stage ID	1
User name	smanthey@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-23 11:02:13
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2026-01-23 17:01:02
From worker node	Hostname	dunegli-8249370-0-fnpc23110.fnal.gov
	cpuinfo	AMD EPYC 9354 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-23 11:02:50
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T151328Z_gen_002528_supernova_g4stage1_g4stage2_detsim_reco_20250703T012127Z_reco2.root
Jobscript	Exit code	0
	Real time	5h (21485s)
	CPU time	5h (21296s = 99%)
	Max RSS bytes	2572939264 (2453 MiB)
Outputting started	2026-01-23 17:00:56
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/12259/1/001/fdhd_ana_2026-01-23T_110259Z_hist.root
Finished	2026-01-23 17:01:02
Saved logs	justin-logs:294232.1-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

###################################[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 16:18:27 UTC run: 5067 subRun: 0 event: 25280
[91m
There are a total of 132462 Particles in the event

# of particles 8	from gen 1 marley
# of particles 31030	from gen 2 Ar39GenInLAr
# of particles 3468	from gen 3 Kr85GenInLAr
# of particles 0	from gen 4 Ar42GenInLAr
# of particles 1	from gen 5 K42From42ArGenInLAr
# of particles 33	from gen 6 Rn222ChainRn222GenInLAr
# of particles 35	from gen 7 Rn222ChainPo218GenInLAr
# of particles 48	from gen 8 Rn222ChainPb214GenInLAr
# of particles 46	from gen 9 Rn222ChainBi214GenInLAr
# of particles 6	from gen 10 Rn222ChainPb210GenInLAr
# of particles 32	from gen 11 Rn220ChainPb212GenInLAr
# of particles 239	from gen 12 K40GenInCathode
# of particles 2906	from gen 13 U238ChainGenInCathode
# of particles 3534	from gen 14 Th232ChainGenInCathode
# of particles 105	from gen 15 K40GenInAnode
# of particles 1329	from gen 16 U238ChainGenInAnode
# of particles 1571	from gen 17 Th232ChainGenInAnode
# of particles 0	from gen 18 Rn222ChainGenInPDS
# of particles 2	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 1	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 23	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 51	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 34	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 43	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 62	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 7	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 16:18:27 UTC run: 5067 subRun: 0 event: 25280
[33m
Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 14.86 MeV
Position (186.22, -411.51, 1833.42) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.60	(186.22, -411.51, 1833.42)	132509	132450
marley	-12		0.71	(186.22, -411.51, 1833.42)	132508	132450
marley	1000200400	0.00	(186.22, -411.51, 1833.42)	132507	132450
marley	22		0.03	(186.22, -411.51, 1833.42)	132453	0
marley	22		0.77	(186.22, -411.51, 1833.42)	132452	0
marley	22		3.96	(186.22, -411.51, 1833.42)	132451	0
marley	1000190400	0.01	(186.22, -411.51, 1833.42)	132450	0
marley	11		8.59	(186.22, -411.51, 1833.42)	132449	0
Signal Track IDs: 132449; 132450; 132451; 132452; 132453; 132507; 132508; 132509; [0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 16:18:27 UTC run: 5067 subRun: 0 event: 25280
[33m
Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 16:19:07 UTC run: 5067 subRun: 0 event: 25280
[34mOpFlash PE 72.78 with purity 0.16 time 0.38 plane 0
 - Vertex (-327.50, -336.56, 1776.24)
	*** 1st Sanity check: Ratio 0.22 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 46.88 with purity 0.28 time 0.37 plane 3
 - Vertex (163.40, 2.00, 2188.38)
	*** 1st Sanity check: Ratio 0.23 <= 1.00
	*** 2nd Sanity check: #OpHits 6 >= 6
OpFlash PE 100.59 with purity 0.42 time 0.50 plane 2
 - Vertex (239.65, -743.30, 1750.45)
	*** 1st Sanity check: Ratio 0.21 <= 1.00
	*** 2nd Sanity check: #OpHits 8 >= 8
OpFlash PE 50.71 with purity 0.07 time 1.08 plane 0
 - Vertex (-327.50, 590.40, 811.11)
	*** 1st Sanity check: Ratio 0.39 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 70.67 with purity 0.72 time 1.77 plane 3
 - Vertex (267.62, 168.80, 2188.38)
	*** 1st Sanity check: Ratio 0.35 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 169.97 with purity 0.05 time 2.96 plane 2
 - Vertex (100.98, -743.30, 1045.94)
	*** 1st Sanity check: Ratio 0.25 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 6.21 with purity 1.00 time 5.46 plane 0
 - Vertex (-327.50, 373.40, 1973.46)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1

# of OpHits (ophit10ppm): 52901 for times between -4253.67 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 18071 for times between -4253.67 us and 295147919198126080.00 us.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 16:19:10 UTC run: 5067 subRun: 0 event: 25280
[36m
# OpHits (ophit10ppm) in full geometry: 52901
# OpFlashes (solarflash) in full geometry: 18071
# Hits (gaushit) in each view: 6640, 6633, 6610, 0
# Cluster from the hits: 2778, 2823, 5612, 0
# Tracks (pmtracktc) in full geometry: 468[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 17:00:55 UTC run: 5067 subRun: 0 event: 25280
[32m
# ClusterReco: Looping over 5602 matched clusters[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 17:00:55 UTC run: 5067 subRun: 0 event: 25280
[32m*** Matched preselection cluster: 1116 from 5602
 - MainTrackID 132449
 - Gen 1 -> marley TPC 97
 - Purity 1.00 Hits 5
 - Charge 1088.98 ( MaxHit 319.63 )
 - #AdjCl 14 ( 2 signal ):
    - Cluster 336 at distance 90.99 with time 305.26 and charge 40.19 in TPC 101 and hits 1
    - Cluster 1025 at distance 94.76 with time 794.11 and charge 87.69 in TPC 97 and hits 2
    - Cluster 1034 at distance 9.59 with time 801.28 and charge 440.66 in TPC 97 and hits 2
    - Cluster 1091 at distance 92.05 with time 842.27 and charge 43.92 in TPC 97 and hits 1
    - Cluster 1119 at distance 98.53 with time 857.56 and charge 83.83 in TPC 97 and hits 1
    - Cluster 1150 at distance 5.74 with time 876.37 and charge 49.35 in TPC 97 and hits 1
    - Cluster 1203 at distance 93.44 with time 920.45 and charge 84.75 in TPC 89 and hits 1
    - Cluster 1229 at distance 95.14 with time 937.96 and charge 168.52 in TPC 89 and hits 1
    - Cluster 1456 at distance 45.17 with time 1103.77 and charge 48.38 in TPC 97 and hits 1
    - Cluster 1457 at distance 64.18 with time 1104.55 and charge 32.06 in TPC 93 and hits 1
    - Cluster 1549 at distance 57.18 with time 1181.82 and charge 58.50 in TPC 97 and hits 1
    - Cluster 1612 at distance 68.84 with time 1235.06 and charge 43.18 in TPC 97 and hits 1
    - Cluster 1650 at distance 98.81 with time 1261.39 and charge 28.98 in TPC 89 and hits 1
    - Cluster 1769 at distance 94.06 with time 1348.67 and charge 233.57 in TPC 89 and hits 1
 - RecoCol  Time,Y,Z ( 855.82, -410.79, 1833.90 )
 - RecoInd0 Time,Y,Z ( 856.40, -410.81, 1868.00 )
 - RecoInd1 Time,Y,Z ( 856.17, -410.78, 1868.00 )
*** Matched flash: 7115 from 18071
 - Purity 0.00 % Plane 0 #Hits 15
 - MainOpHitPE 25.97 (PE);  TotalPE 196.47 vs expected 115.30 (PE)
 - Time -909.74 (us) Fast 34.43 % Residual 50.42
 - Reco Time,Y,Z ( -909.74, -411.28, 1855.99 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 186.22, -411.51, 1833.42 )
 - Main X,Y,Z ( 188.88, -410.64, 1833.71 )
 - EDep X,Y,Z ( 188.48, -410.73, 1833.80 )
 - Reco X,Y,Z ( 41.55, -410.79, 1833.90 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 17:00:55 UTC run: 5067 subRun: 0 event: 25280
[32m-----------------------------------------------------------------------------------------
[0m
%MSG
23-Jan-2026 17:00:55 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/37/51/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T151328Z_gen_002528_supernova_g4stage1_g4stage2_detsim_reco_20250703T012127Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 23-Jan-2026 17:00:55 UTC  ModuleEndJob
[35mFinished running the SolarNuAna module[0m
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.499217       2143.93       2944.15       2561.09       1083.93        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00165223    0.00987699     0.0232576    0.00682241    0.00783756       10     
end_path:solarnuana:SolarNuAna     0.496428       2143.92       2944.15       2561.07       1083.93        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 23-Jan-2026 17:00:55 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3191.41 MB
  Peak resident set size usage (VmHWM): 2572.94 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 21280.697435 Real = 21465.640818

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3191.41 VmHWM = 2572.94

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===