Jobsub ID 273046.0@dunegpschedd02.fnal.gov

Jobsub ID	273046.0@dunegpschedd02.fnal.gov
Workflow ID	11915
Stage ID	1
User name	smanthey@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-15 06:21:31
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2026-01-15 15:02:21
From worker node	Hostname	dunegli-8167433-0-fnpc18005.fnal.gov
	cpuinfo	AMD EPYC 7551 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-15 06:23:32
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250122T154650Z_gen_000324_supernova_g4stage1_g4stage2_detsim_reco_20250701T052433Z_reco2.root
Jobscript	Exit code	0
	Real time	8h (31103s)
	CPU time	8h (30706s = 98%)
	Max RSS bytes	2587303936 (2467 MiB)
Outputting started	2026-01-15 15:01:56
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/11915/1/001/fdhd_ana_2026-01-15T_062359Z_hist.root
Finished	2026-01-15 15:02:21
Saved logs	justin-logs:273046.0-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

particles 58	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 83844	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3566	from gen 27 foamGammasAtLAr1x8x14
# of particles 0	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 0	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 15:01:46 UTC run: 4799 subRun: 0 event: 3239
[33m
Number of Signal Particles: 5
Neutrino Interaction: -1
Neutrino Energy: 63.83 MeV
Position (328.65, 645.88, 1080.53) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	22		2.22	(484.51, 570.60, 1072.08)	132535	132466
marley	1000010020	0.00	(484.51, 570.60, 1072.08)	132534	132466
marley	2212		0.00	(500.40, 638.69, 1096.89)	132519	132466
marley	2212		0.00	(500.78, 635.16, 1099.57)	132517	132466
marley	2212		0.00	(499.68, 633.06, 1101.62)	132516	132466
marley	2212		0.00	(498.99, 622.61, 1103.08)	132514	132466
marley	1000080160	0.00	(497.28, 622.29, 1101.45)	132513	132466
marley	2212		0.00	(492.46, 623.75, 1103.51)	132512	132466
marley	1000080160	0.00	(482.21, 623.22, 1108.05)	132511	132466
marley	1000060120	0.00	(455.64, 644.07, 1119.76)	132510	132466
marley	2212		0.00	(433.57, 635.78, 1095.02)	132509	132466
marley	1000080160	0.00	(426.15, 637.68, 1086.21)	132508	132466
marley	2212		0.01	(429.16, 641.90, 1095.71)	132507	132466
marley	2212		0.00	(426.42, 641.99, 1103.83)	132506	132466
marley	1000060120	0.00	(429.44, 648.02, 1148.80)	132505	132466
marley	1000080160	0.00	(429.66, 666.65, 1152.26)	132504	132466
marley	1000060120	0.01	(429.86, 666.64, 1152.32)	132503	132466
marley	1000180400	0.00	(264.32, 488.62, 1265.24)	132502	132466
marley	2212		0.05	(456.89, 447.92, 1278.79)	132501	132466
marley	2212		0.55	(479.08, 459.07, 1303.36)	132500	132466
marley	2212		0.01	(475.68, 456.79, 1312.29)	132499	132466
marley	2212		0.28	(470.26, 455.35, 1324.23)	132498	132466
marley	1000070140	0.16	(438.60, 453.62, 1344.00)	132497	132466
marley	22		0.01	(440.76, 454.49, 1346.68)	132470	132465
marley	22		0.01	(440.76, 454.49, 1346.68)	132469	132465
marley	22		4.44	(440.76, 454.49, 1346.68)	132468	132465
marley	1000060120	0.89	(440.76, 454.49, 1346.68)	132467	132465
marley	2112		1.07	(440.76, 454.49, 1346.68)	132466	132465
marley	2112		6.43	(328.65, 645.88, 1080.53)	132465	0
marley	1000190390	0.25	(328.65, 645.88, 1080.53)	132464	0
marley	11		47.85	(328.65, 645.88, 1080.53)	132463	0
Signal Track IDs: 132463; 132464; 132465; 132466; 132467; 132468; 132469; 132470; 132497; 132498; 132499; 132500; 132501; 132502; 132503; 132504; 132505; 132506; 132507; 132508; 132509; 132510; 132511; 132512; 132513; 132514; 132516; 132517; 132519; 132534; 132535; [0m
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 15:01:46 UTC run: 4799 subRun: 0 event: 3239
[31m
Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.
[0m
%MSG
Begin processing the 10th record. run: 4799 subRun: 0 event: 3240 at 15-Jan-2026 15:01:47 UTC
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 15:01:52 UTC run: 4799 subRun: 0 event: 3240
[35m
###################################################
Event:			3240
Flag:			594321802
Geometry:		dunevd10kt_3view_30deg_v5_refactored_1x8x14ref (VD)
Signal Label:		marley
PDS Frequency in [MHz]:	62.50
PDS Tick in [us]:	0.016
TPC Frequency in [MHz]:	2.00
TPC Tick in [us]:	0.50
TPC Map:		112 TPCs
TPC DriftLength in [cm]:650.07
TPC DriftTime in [us]:	4048.69
Fiducial Volume in [cm]:850.32, 1507.84, 2306.12
###################################################[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 15:01:53 UTC run: 4799 subRun: 0 event: 3240
[91m
There are a total of 133047 Particles in the event

# of particles 20	from gen 1 marley
# of particles 31173	from gen 2 Ar39GenInLAr
# of particles 3544	from gen 3 Kr85GenInLAr
# of particles 1	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 31	from gen 6 Rn222ChainRn222GenInLAr
# of particles 21	from gen 7 Rn222ChainPo218GenInLAr
# of particles 40	from gen 8 Rn222ChainPb214GenInLAr
# of particles 39	from gen 9 Rn222ChainBi214GenInLAr
# of particles 11	from gen 10 Rn222ChainPb210GenInLAr
# of particles 23	from gen 11 Rn220ChainPb212GenInLAr
# of particles 251	from gen 12 K40GenInCathode
# of particles 3035	from gen 13 U238ChainGenInCathode
# of particles 3612	from gen 14 Th232ChainGenInCathode
# of particles 119	from gen 15 K40GenInAnode
# of particles 1349	from gen 16 U238ChainGenInAnode
# of particles 1708	from gen 17 Th232ChainGenInAnode
# of particles 4	from gen 18 Rn222ChainGenInPDS
# of particles 2	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 2	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 25	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 48	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 41	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 33	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 52	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 15	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 15:01:53 UTC run: 4799 subRun: 0 event: 3240
[33m
Number of Signal Particles: 6
Neutrino Interaction: -1
Neutrino Energy: 48.23 MeV
Position (331.42, -650.36, 1470.37) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	1000260570	0.00	(425.14, -652.92, 1245.90)	133152	133016
marley	22		7.65	(425.14, -652.92, 1245.90)	133151	133016
marley	22		7.65	(425.14, -652.92, 1245.90)	133150	133016
marley	22		7.65	(425.14, -652.92, 1245.90)	133149	133016
marley	22		7.65	(425.14, -652.92, 1245.90)	133148	133016
marley	22		7.65	(425.14, -652.92, 1245.90)	133147	133016
marley	22		7.65	(425.14, -652.92, 1245.90)	133146	133016
marley	2212		0.00	(450.72, -519.34, 1413.87)	133051	133016
marley	2212		0.00	(453.93, -530.33, 1416.00)	133050	133016
marley	2212		0.00	(454.03, -532.40, 1412.21)	133049	133016
marley	2212		0.00	(456.23, -528.95, 1403.40)	133048	133016
marley	2212		0.05	(450.28, -524.84, 1398.81)	133047	133016
marley	2212		0.02	(448.65, -533.78, 1384.22)	133046	133016
marley	2212		0.01	(442.77, -548.25, 1376.76)	133045	133016
marley	2212		0.17	(442.74, -548.47, 1376.58)	133044	133016
marley	2212		0.07	(439.21, -552.89, 1377.28)	133043	133016
marley	22		6.34	(331.42, -650.36, 1470.37)	133017	0
marley	2112		0.32	(331.42, -650.36, 1470.37)	133016	0
marley	1000190390	0.07	(331.42, -650.36, 1470.37)	133015	0
marley	11		32.19	(331.42, -650.36, 1470.37)	133014	0
Signal Track IDs: 133014; 133015; 133016; 133017; 133043; 133044; 133045; 133046; 133047; 133048; 133049; 133050; 133051; 133146; 133147; 133148; 133149; 133150; 133151; 133152; [0m
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 15:01:53 UTC run: 4799 subRun: 0 event: 3240
[31m
Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.
[0m
%MSG
15-Jan-2026 15:01:53 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/28/63/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250122T154650Z_gen_000324_supernova_g4stage1_g4stage2_detsim_reco_20250701T052433Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 15-Jan-2026 15:01:53 UTC  ModuleEndJob
[35mFinished running the SolarNuAna module[0m
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          1.43307       3099.24       7961.46       2703.66       3168.18        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00191154     0.0102725     0.0210564     0.0093795    0.00694752       10     
end_path:solarnuana:SolarNuAna      1.42557       3099.23       7961.46       2703.66       3168.18        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 15-Jan-2026 15:01:53 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3199.03 MB
  Peak resident set size usage (VmHWM): 2587.3 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 30670.863909 Real = 31049.234705

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3199.03 VmHWM = 2587.3

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===