Jobsub ID 300750.0@dunegpschedd01.fnal.gov

Jobsub ID	300750.0@dunegpschedd01.fnal.gov
Workflow ID	12378
Stage ID	1
User name	smanthey@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-25 15:28:59
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2026-01-26 02:04:09
From worker node	Hostname	dunegli-8270274-0-fnpc18007.fnal.gov
	cpuinfo	AMD EPYC 7551 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-25 15:30:26
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250126T032856Z_gen_003065_supernova_g4stage1_g4stage2_detsim_reco_20250627T181608Z_reco2.root
Jobscript	Exit code	0
	Real time	10h (37981s)
	CPU time	10h (37396s = 98%)
	Max RSS bytes	2584350720 (2464 MiB)
Outputting started	2026-01-26 02:03:28
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/12378/1/001/fdhd_ana_2026-01-25T_153056Z_hist.root
Finished	2026-01-26 02:04:09
Saved logs	justin-logs:300750.0-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

8; 132554; 132555; [0m
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 00:35:24 UTC run: 4909 subRun: 0 event: 30649
[31m
Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.
[0m
%MSG
Begin processing the 10th record. run: 4909 subRun: 0 event: 30650 at 26-Jan-2026 00:35:24 UTC
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 00:35:30 UTC run: 4909 subRun: 0 event: 30650
[35m
###################################################
Event:			30650
Flag:			1525192544
Geometry:		dunevd10kt_3view_30deg_v5_refactored_1x8x14ref (VD)
Signal Label:		marley
PDS Frequency in [MHz]:	62.50
PDS Tick in [us]:	0.016
TPC Frequency in [MHz]:	2.00
TPC Tick in [us]:	0.50
TPC Map:		112 TPCs
TPC DriftLength in [cm]:650.07
TPC DriftTime in [us]:	4048.69
Fiducial Volume in [cm]:850.32, 1507.84, 2306.12
###################################################[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 00:35:31 UTC run: 4909 subRun: 0 event: 30650
[91m
There are a total of 133075 Particles in the event

# of particles 7	from gen 1 marley
# of particles 31255	from gen 2 Ar39GenInLAr
# of particles 3607	from gen 3 Kr85GenInLAr
# of particles 2	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 24	from gen 6 Rn222ChainRn222GenInLAr
# of particles 32	from gen 7 Rn222ChainPo218GenInLAr
# of particles 34	from gen 8 Rn222ChainPb214GenInLAr
# of particles 24	from gen 9 Rn222ChainBi214GenInLAr
# of particles 23	from gen 10 Rn222ChainPb210GenInLAr
# of particles 21	from gen 11 Rn220ChainPb212GenInLAr
# of particles 246	from gen 12 K40GenInCathode
# of particles 3009	from gen 13 U238ChainGenInCathode
# of particles 3766	from gen 14 Th232ChainGenInCathode
# of particles 105	from gen 15 K40GenInAnode
# of particles 1240	from gen 16 U238ChainGenInAnode
# of particles 1648	from gen 17 Th232ChainGenInAnode
# of particles 1	from gen 18 Rn222ChainGenInPDS
# of particles 1	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 5	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 17	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 42	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 40	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 39	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 26	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 13	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 00:35:32 UTC run: 4909 subRun: 0 event: 30650
[33m
Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 26.13 MeV
Position (-11.63, -566.26, 346.85) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.47	(-11.63, -566.26, 346.85)	133095	133058
marley	-12		0.84	(-11.63, -566.26, 346.85)	133094	133058
marley	22		0.03	(-11.63, -566.26, 346.85)	133061	0
marley	22		1.61	(-11.63, -566.26, 346.85)	133060	0
marley	22		0.65	(-11.63, -566.26, 346.85)	133059	0
marley	1000190400	0.02	(-11.63, -566.26, 346.85)	133058	0
marley	11		22.32	(-11.63, -566.26, 346.85)	133057	0
Signal Track IDs: 133057; 133058; 133059; 133060; 133061; 133094; 133095; [0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 00:35:32 UTC run: 4909 subRun: 0 event: 30650
[33m
Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 00:37:38 UTC run: 4909 subRun: 0 event: 30650
[34mOpFlash PE 337.60 with purity 0.30 time -3.77 plane 1
 - Vertex (210.07, 743.30, 1045.94)
	*** 1st Sanity check: Ratio 0.52 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 198.97 with purity 0.31 time -2.60 plane 2
 - Vertex (210.07, -743.30, 748.10)
	*** 1st Sanity check: Ratio 0.26 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 489.12 with purity 0.40 time 0.34 plane 0
 - Vertex (-327.50, -462.47, 349.44)
	*** 1st Sanity check: Ratio 0.09 <= 1.00
	*** 2nd Sanity check: #OpHits 29 >= 29
OpFlash PE 386.58 with purity 0.46 time 0.17 plane 2
 - Vertex (111.97, -743.30, 387.60)
	*** 1st Sanity check: Ratio 0.16 <= 1.00
	*** 2nd Sanity check: #OpHits 17 >= 17
OpFlash PE 18.29 with purity 0.22 time 2.52 plane 4
 - Vertex (132.91, -77.55, -96.50)
	*** 1st Sanity check: Ratio 0.68 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 33.29 with purity 0.27 time 4.32 plane 2
 - Vertex (74.96, -743.30, 329.09)
	*** 1st Sanity check: Ratio 0.59 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3

# of OpHits (ophit10ppm): 52941 for times between -4254.28 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 18232 for times between -4254.28 us and 295147919198126080.00 us.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 00:37:42 UTC run: 4909 subRun: 0 event: 30650
[36m
# OpHits (ophit10ppm) in full geometry: 52941
# OpFlashes (solarflash) in full geometry: 18232
# Hits (gaushit) in each view: 6862, 6683, 6666, 0
# Cluster from the hits: 2873, 2833, 5632, 0
# Tracks (pmtracktc) in full geometry: 451[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 02:03:26 UTC run: 4909 subRun: 0 event: 30650
[32m
# ClusterReco: Looping over 5626 matched clusters[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 02:03:26 UTC run: 4909 subRun: 0 event: 30650
[32m*** Matched preselection cluster: 2713 from 5626
 - MainTrackID 133057
 - Gen 1 -> marley TPC 16
 - Purity 1.00 Hits 12
 - Charge 2583.23 ( MaxHit 417.76 )
 - #AdjCl 7 ( 0 signal ):
    - Cluster 1936 at distance 91.84 with time 1529.71 and charge 53.32 in TPC 16 and hits 1
    - Cluster 2006 at distance 90.69 with time 1584.58 and charge 287.91 in TPC 16 and hits 2
    - Cluster 2026 at distance 92.74 with time 1598.37 and charge 46.46 in TPC 16 and hits 1
    - Cluster 2623 at distance 74.51 with time 2025.92 and charge 29.02 in TPC 22 and hits 1
    - Cluster 2631 at distance 35.50 with time 2030.29 and charge 26.36 in TPC 20 and hits 1
    - Cluster 2977 at distance 97.32 with time 2266.62 and charge 33.50 in TPC 20 and hits 1
    - Cluster 3200 at distance 90.80 with time 2444.17 and charge 304.09 in TPC 16 and hits 2
 - RecoCol  Time,Y,Z ( 2079.93, -564.54, 344.26 )
 - RecoInd0 Time,Y,Z ( 2079.34, -564.59, 373.80 )
 - RecoInd1 Time,Y,Z ( 2081.51, -564.49, 373.06 )
*** Matched flash: 5118 from 18232
 - Purity 0.00 % Plane 0 #Hits 8
 - MainOpHitPE 50.63 (PE);  TotalPE 137.56 vs expected 1590.66 (PE)
 - Time -1880.07 (us) Fast 73.57 % Residual 542.19
 - Reco Time,Y,Z ( -1880.07, -542.10, 338.26 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -11.63, -566.26, 346.85 )
 - Main X,Y,Z ( -7.01, -563.78, 342.95 )
 - EDep X,Y,Z ( -6.95, -563.81, 342.70 )
 - Reco X,Y,Z ( -310.79, -564.54, 344.26 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 02:03:26 UTC run: 4909 subRun: 0 event: 30650
[32m-----------------------------------------------------------------------------------------
[0m
%MSG
26-Jan-2026 02:03:27 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/ed/c0/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250126T032856Z_gen_003065_supernova_g4stage1_g4stage2_detsim_reco_20250627T181608Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 26-Jan-2026 02:03:27 UTC  ModuleEndJob
[35mFinished running the SolarNuAna module[0m
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          1.85699       3785.08       8320.24       5166.73       3227.01        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00104085     0.0105658     0.0215592    0.00949194    0.00746882       10     
end_path:solarnuana:SolarNuAna      1.83908       3785.07       8320.22       5166.73       3227.01        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 26-Jan-2026 02:03:27 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3197.56 MB
  Peak resident set size usage (VmHWM): 2584.35 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 37352.375161 Real = 37919.648334

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3197.56 VmHWM = 2584.35

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===