Jobsub ID 278696.0@dunegpschedd01.fnal.gov

Jobsub ID	278696.0@dunegpschedd01.fnal.gov
Workflow ID	11913
Stage ID	1
User name	smanthey@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-15 03:37:23
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2026-01-15 08:43:55
From worker node	Hostname	dunegli-8162503-0-fnpc23039.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-15 03:38:08
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T034133Z_gen_000209_supernova_g4stage1_g4stage2_detsim_reco_20250730T070627Z_reco2.root
Jobscript	Exit code	0
	Real time	5h (18320s)
	CPU time	5h (18076s = 98%)
	Max RSS bytes	2576924672 (2457 MiB)
Outputting started	2026-01-15 08:43:28
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/11913/1/001/fdhd_ana_2026-01-15T_033826Z_hist.root
Finished	2026-01-15 08:43:55
Saved logs	justin-logs:278696.0-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

1
    - Cluster 5377 at distance 61.57 with time 4086.41 and charge 30.14 in TPC 54 and hits 1
    - Cluster 5434 at distance 66.47 with time 4126.34 and charge 120.09 in TPC 40 and hits 3
 - RecoCol  Time,Y,Z ( 3752.32, -580.52, 903.55 )
 - RecoInd0 Time,Y,Z ( 3751.70, -580.70, 971.48 )
 - RecoInd1 Time,Y,Z ( 3756.03, -580.35, 965.94 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -275.07, -582.02, 901.21 )
 - Main X,Y,Z ( -276.46, -581.48, 902.74 )
 - EDep X,Y,Z ( -279.47, -578.90, 905.80 )
 - Reco X,Y,Z ( -1000000.00, -580.52, 903.55 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 07:54:16 UTC run: 5030 subRun: 0 event: 2089
[32m-----------------------------------------------------------------------------------------
[0m
%MSG
Begin processing the 10th record. run: 5030 subRun: 0 event: 2090 at 15-Jan-2026 07:54:16 UTC
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 07:54:19 UTC run: 5030 subRun: 0 event: 2090
[35m
###################################################
Event:			2090
Flag:			747409689
Geometry:		dunevd10kt_3view_30deg_v5_refactored_1x8x14ref (VD)
Signal Label:		marley
PDS Frequency in [MHz]:	62.50
PDS Tick in [us]:	0.016
TPC Frequency in [MHz]:	2.00
TPC Tick in [us]:	0.50
TPC Map:		112 TPCs
TPC DriftLength in [cm]:650.07
TPC DriftTime in [us]:	4048.69
Fiducial Volume in [cm]:850.32, 1507.84, 2306.12
###################################################[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 07:54:20 UTC run: 5030 subRun: 0 event: 2090
[91m
There are a total of 133309 Particles in the event

# of particles 8	from gen 1 marley
# of particles 31385	from gen 2 Ar39GenInLAr
# of particles 3560	from gen 3 Kr85GenInLAr
# of particles 0	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 23	from gen 6 Rn222ChainRn222GenInLAr
# of particles 33	from gen 7 Rn222ChainPo218GenInLAr
# of particles 44	from gen 8 Rn222ChainPb214GenInLAr
# of particles 71	from gen 9 Rn222ChainBi214GenInLAr
# of particles 19	from gen 10 Rn222ChainPb210GenInLAr
# of particles 23	from gen 11 Rn220ChainPb212GenInLAr
# of particles 233	from gen 12 K40GenInCathode
# of particles 3054	from gen 13 U238ChainGenInCathode
# of particles 3602	from gen 14 Th232ChainGenInCathode
# of particles 90	from gen 15 K40GenInAnode
# of particles 1391	from gen 16 U238ChainGenInAnode
# of particles 1676	from gen 17 Th232ChainGenInAnode
# of particles 0	from gen 18 Rn222ChainGenInPDS
# of particles 6	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 2	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 19	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 60	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 56	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 33	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 50	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 23	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 07:54:20 UTC run: 5030 subRun: 0 event: 2090
[33m
Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 13.71 MeV
Position (-13.40, 121.43, 1234.51) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.09	(-13.40, 121.43, 1234.51)	133358	133279
marley	-12		1.22	(-13.40, 121.43, 1234.51)	133357	133279
marley	1000200400	0.00	(-13.40, 121.43, 1234.51)	133356	133279
marley	22		0.03	(-13.40, 121.43, 1234.51)	133282	0
marley	22		0.77	(-13.40, 121.43, 1234.51)	133281	0
marley	22		4.39	(-13.40, 121.43, 1234.51)	133280	0
marley	1000190400	0.00	(-13.40, 121.43, 1234.51)	133279	0
marley	11		7.02	(-13.40, 121.43, 1234.51)	133278	0
Signal Track IDs: 133278; 133279; 133280; 133281; 133282; 133356; 133357; 133358; [0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 07:54:20 UTC run: 5030 subRun: 0 event: 2090
[33m
Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 07:55:28 UTC run: 5030 subRun: 0 event: 2090
[34mOpFlash PE 13.81 with purity 0.19 time 0.49 plane 1
 - Vertex (238.51, 743.30, 1939.46)
	*** 1st Sanity check: Ratio 0.62 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 299.92 with purity 0.12 time 0.69 plane 0
 - Vertex (-327.50, 99.95, 1282.11)
	*** 1st Sanity check: Ratio 0.10 <= 1.00
	*** 2nd Sanity check: #OpHits 26 >= 26
OpFlash PE 109.00 with purity 0.46 time 1.58 plane 2
 - Vertex (210.07, -743.30, 1641.62)
	*** 1st Sanity check: Ratio 0.30 <= 1.00
	*** 2nd Sanity check: #OpHits 6 >= 6
OpFlash PE 104.85 with purity 0.10 time 1.80 plane 0
 - Vertex (-327.50, 175.02, 1182.86)
	*** 1st Sanity check: Ratio 0.14 <= 1.00
	*** 2nd Sanity check: #OpHits 12 >= 12

# of OpHits (ophit10ppm): 53668 for times between -4253.91 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 18295 for times between -4253.91 us and 295147919198126080.00 us.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 07:55:31 UTC run: 5030 subRun: 0 event: 2090
[36m
# OpHits (ophit10ppm) in full geometry: 53668
# OpFlashes (solarflash) in full geometry: 18295
# Hits (gaushit) in each view: 6830, 6711, 6682, 0
# Cluster from the hits: 2869, 2897, 5680, 0
# Tracks (pmtracktc) in full geometry: 426[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 08:43:27 UTC run: 5030 subRun: 0 event: 2090
[32m
# ClusterReco: Looping over 5675 matched clusters[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 08:43:27 UTC run: 5030 subRun: 0 event: 2090
[32m*** Matched preselection cluster: 2757 from 5675
 - MainTrackID 133281
 - Gen 1 -> marley TPC 68
 - Purity 1.00 Hits 5
 - Charge 797.53 ( MaxHit 396.45 )
 - #AdjCl 7 ( 1 signal ):
    - Cluster 2423 at distance 59.78 with time 1852.31 and charge 30.77 in TPC 58 and hits 1
    - Cluster 2647 at distance 23.38 with time 2050.63 and charge 381.61 in TPC 68 and hits 3
    - Cluster 2759 at distance 95.12 with time 2115.64 and charge 168.07 in TPC 68 and hits 3
    - Cluster 3115 at distance 58.91 with time 2366.77 and charge 34.79 in TPC 68 and hits 1
    - Cluster 3149 at distance 86.63 with time 2385.72 and charge 250.43 in TPC 68 and hits 2
    - Cluster 3395 at distance 78.63 with time 2562.67 and charge 178.29 in TPC 68 and hits 1
    - Cluster 3422 at distance 89.79 with time 2583.86 and charge 61.65 in TPC 68 and hits 1
 - RecoCol  Time,Y,Z ( 2115.17, 121.37, 1233.95 )
 - RecoInd0 Time,Y,Z ( 2114.91, 121.35, 1270.32 )
 - RecoInd1 Time,Y,Z ( 2115.50, 121.38, 1255.51 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -13.40, 121.43, 1234.51 )
 - Main X,Y,Z ( 0.35, 125.06, 1229.77 )
 - EDep X,Y,Z ( -14.88, 123.52, 1235.28 )
 - Reco X,Y,Z ( -1000000.00, 121.37, 1233.95 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 08:43:27 UTC run: 5030 subRun: 0 event: 2090
[32m-----------------------------------------------------------------------------------------
[0m
%MSG
15-Jan-2026 08:43:28 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/b1/9f/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T034133Z_gen_000209_supernova_g4stage1_g4stage2_detsim_reco_20250730T070627Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 15-Jan-2026 08:43:28 UTC  ModuleEndJob
[35mFinished running the SolarNuAna module[0m
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.702284       1825.11       3161.42       2921.8        1491.97        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00120179     0.0112825     0.0288086    0.00887294    0.00992299       10     
end_path:solarnuana:SolarNuAna     0.673324       1825.1        3161.42       2921.78       1491.97        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 15-Jan-2026 08:43:28 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3200.24 MB
  Peak resident set size usage (VmHWM): 2576.92 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 18058.794603 Real = 18289.946691

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3200.24 VmHWM = 2576.92

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===