Jobsub ID 241872.0@dunegpschedd02.fnal.gov

Jobsub ID	241872.0@dunegpschedd02.fnal.gov
Workflow ID	9961
Stage ID	1
User name	smanthey@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-12 03:31:44
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2025-11-13 05:26:35
From worker node	Hostname	dunegli-7572162-0-fnpc23040.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	outputting_failed
Started	2025-11-13 03:26:23
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T232708Z_gen_003240_supernova_g4stage1_g4stage2_detsim_reco_20250702T135326Z_reco2.root
Jobscript	Exit code	0
	Real time	1h (7190s)
	CPU time	1h (7122s = 99%)
	Max RSS bytes	1914908672 (1826 MiB)
Outputting started	2025-11-13 05:26:13
Output files
Finished	2025-11-13 05:26:35
List job events (HTCondor job logs unavailable)
Jobscript log (last 10,000 characters)

180400	0.01	(75.11, 93.01, 1658.07)	132008	131938
marley	1000180400	0.02	(63.74, 114.82, 1647.34)	132007	131938
marley	1000180400	0.02	(63.53, 114.56, 1649.04)	132006	131938
marley	1000180400	0.02	(62.72, 114.20, 1647.93)	132005	131938
marley	1000180400	0.03	(64.25, 44.72, 1695.17)	132004	131938
marley	1000180360	0.01	(63.56, 45.89, 1695.27)	132003	131938
marley	1000180400	0.01	(73.13, 66.27, 1734.45)	132002	131938
marley	1000180360	0.00	(66.88, 63.12, 1747.73)	132001	131938
marley	1000180400	0.02	(47.86, 72.99, 1780.34)	132000	131938
marley	1000180400	0.02	(15.02, 69.77, 1763.24)	131999	131938
marley	1000180400	0.01	(31.88, 50.75, 1739.78)	131998	131938
marley	1000180400	0.03	(30.16, 45.82, 1738.47)	131997	131938
marley	1000180360	0.03	(39.97, 48.61, 1733.48)	131996	131938
marley	1000180400	0.00	(31.26, 48.31, 1726.53)	131995	131938
marley	1000180400	0.04	(8.85, 53.05, 1690.65)	131994	131938
marley	1000180400	0.05	(18.45, 135.46, 1908.30)	131993	131938
marley	1000180400	0.01	(15.54, 32.57, 1839.15)	131992	131938
marley	1000180400	0.01	(1.37, 24.25, 1815.87)	131991	131938
marley	1000180400	0.01	(7.03, 22.03, 1806.33)	131990	131938
marley	1000180400	0.03	(11.80, 23.17, 1803.77)	131989	131938
marley	1000180400	0.04	(7.69, 26.12, 1799.13)	131988	131938
marley	1000180400	0.04	(25.51, -11.68, 1775.81)	131987	131938
marley	1000180400	0.07	(43.94, 37.79, 1744.95)	131986	131938
marley	1000180400	0.02	(44.49, 35.24, 1745.66)	131985	131938
marley	1000180400	0.03	(54.46, 29.66, 1743.63)	131984	131938
marley	1000180400	0.02	(54.00, 26.42, 1746.03)	131983	131938
marley	1000180400	0.08	(55.40, 26.19, 1752.00)	131982	131938
marley	1000180400	0.05	(62.28, 28.82, 1727.33)	131981	131938
marley	1000180400	0.09	(25.34, 39.57, 1723.47)	131980	131938
marley	1000180400	0.02	(32.19, 30.37, 1730.89)	131979	131938
marley	1000180400	0.01	(27.18, 23.70, 1785.70)	131978	131938
marley	1000180400	0.00	(59.61, 27.47, 1843.10)	131977	131938
marley	1000180400	0.00	(90.37, 28.87, 1887.26)	131976	131938
marley	1000180400	0.04	(105.60, 45.46, 1924.61)	131975	131938
marley	1000180400	0.03	(109.60, 48.68, 1922.94)	131974	131938
marley	1000180400	0.00	(124.11, 78.64, 1952.33)	131973	131938
marley	1000180400	0.07	(130.98, 92.51, 1965.17)	131972	131938
marley	1000180400	0.00	(122.72, 88.28, 1970.40)	131971	131938
marley	1000180400	0.07	(115.26, 85.52, 1974.41)	131970	131938
marley	1000180400	0.03	(114.86, 90.95, 1976.01)	131969	131938
marley	1000180400	0.10	(115.02, 92.19, 1980.19)	131968	131938
marley	1000180400	0.01	(116.53, 91.27, 1979.67)	131967	131938
marley	1000180400	0.02	(116.64, 91.07, 1979.60)	131966	131938
marley	1000180400	0.01	(115.74, 87.74, 1978.35)	131965	131938
marley	1000180400	0.15	(106.60, 79.29, 1974.85)	131964	131938
marley	1000180400	0.01	(115.14, 82.73, 1980.07)	131963	131938
marley	22		4.93	(133.52, 94.11, 2016.29)	131939	0
marley	2112		1.65	(133.52, 94.11, 2016.29)	131938	0
marley	1000190390	0.17	(133.52, 94.11, 2016.29)	131937	0
marley	11		35.93	(133.52, 94.11, 2016.29)	131936	0
Signal Track IDs: 131936; 131937; 131938; 131939; 131963; 131964; 131965; 131966; 131967; 131968; 131969; 131970; 131971; 131972; 131973; 131974; 131975; 131976; 131977; 131978; 131979; 131980; 131981; 131982; 131983; 131984; 131985; 131986; 131987; 131988; 131989; 131990; 131991; 131992; 131993; 131994; 131995; 131996; 131997; 131998; 131999; 132000; 132001; 132002; 132003; 132004; 132005; 132006; 132007; 132008; 132009; 132010; 132011; 132012; 132013; 132014; 132015; 132016; 132017; 132018; 132019; 132020; 132021; 132022; 132023; 132024; 132025; 132026; 132027; 132028; 132029; 132030; 132031; 132032; 132033; 132034; 132035; 132036; 132037; 132038; 132039; 132040; 132041; 132043; 132044; 132062; 132063; [0m
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Nov-2025 05:26:10 UTC run: 4901 subRun: 0 event: 32399
[31m
Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.
[0m
%MSG
Begin processing the 10th record. run: 4901 subRun: 0 event: 32400 at 13-Nov-2025 05:26:10 UTC
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Nov-2025 05:26:12 UTC run: 4901 subRun: 0 event: 32400
[35m
###################################################
Event:			32400
Flag:			608896383
Geometry:		dunevd10kt_3view_30deg_v5_refactored_1x8x14ref (VD)
Signal Label:		marley
PDS Frequency in [MHz]:	62.50
PDS Tick in [us]:	0.016
TPC Frequency in [MHz]:	2.00
TPC Tick in [us]:	0.50
TPC Map:		112 TPCs
TPC DriftLength in [cm]:650.07
TPC DriftTime in [us]:	4048.69
Fiducial Volume in [cm]:850.32, 1507.84, 2306.12
###################################################[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Nov-2025 05:26:12 UTC run: 4901 subRun: 0 event: 32400
[91m
There are a total of 133122 Particles in the event

# of particles 6	from gen 1 marley
# of particles 31428	from gen 2 Ar39GenInLAr
# of particles 3560	from gen 3 Kr85GenInLAr
# of particles 5	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 25	from gen 6 Rn222ChainRn222GenInLAr
# of particles 31	from gen 7 Rn222ChainPo218GenInLAr
# of particles 41	from gen 8 Rn222ChainPb214GenInLAr
# of particles 48	from gen 9 Rn222ChainBi214GenInLAr
# of particles 22	from gen 10 Rn222ChainPb210GenInLAr
# of particles 19	from gen 11 Rn220ChainPb212GenInLAr
# of particles 268	from gen 12 K40GenInCathode
# of particles 3165	from gen 13 U238ChainGenInCathode
# of particles 3429	from gen 14 Th232ChainGenInCathode
# of particles 108	from gen 15 K40GenInAnode
# of particles 1330	from gen 16 U238ChainGenInAnode
# of particles 1520	from gen 17 Th232ChainGenInAnode
# of particles 0	from gen 18 Rn222ChainGenInPDS
# of particles 2	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 3	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 21	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 63	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 41	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 35	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 76	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 28	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Nov-2025 05:26:12 UTC run: 4901 subRun: 0 event: 32400
[33m
Number of Signal Particles: 6
Neutrino Interaction: -1
Neutrino Energy: 69.78 MeV
Position (-288.63, -418.41, 1790.38) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.05	(-288.63, -418.41, 1790.38)	133095	133090
marley	-12		0.12	(-288.63, -418.41, 1790.38)	133094	133090
marley	2212		1.31	(-288.63, -418.41, 1790.38)	133092	0
marley	1000020040	4.68	(-288.63, -418.41, 1790.38)	133091	0
marley	1000160350	0.66	(-288.63, -418.41, 1790.38)	133090	0
marley	11		47.23	(-288.63, -418.41, 1790.38)	133089	0
Signal Track IDs: 133089; 133090; 133091; 133092; 133094; 133095; [0m
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Nov-2025 05:26:12 UTC run: 4901 subRun: 0 event: 32400
[31m
Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.
[0m
%MSG
13-Nov-2025 05:26:13 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/32/59/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T232708Z_gen_003240_supernova_g4stage1_g4stage2_detsim_reco_20250702T135326Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 13-Nov-2025 05:26:13 UTC  ModuleEndJob
[35mFinished running the SolarNuAna module[0m
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.571775       714.423       2543.23       1.07158       1093.7         10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000683208   0.00761833     0.0194274    0.00590951    0.00719076       10     
end_path:solarnuana:SolarNuAna     0.570896       714.415       2543.23       1.07055       1093.7         10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 13-Nov-2025 05:26:13 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2534.1 MB
  Peak resident set size usage (VmHWM): 1914.91 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 7109.675586 Real = 7167.822391

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 2534.1 VmHWM = 1914.91

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0