Jobsub ID 268474.1@dunegpschedd02.fnal.gov

Jobsub ID	268474.1@dunegpschedd02.fnal.gov
Workflow ID	11699
Stage ID	1
User name	smanthey@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-11 07:04:31
Site	UK_Manchester
Entry	UBoone_T2_UK_Manchester_ce02
Last heartbeat	2026-01-11 10:26:40
From worker node	Hostname	wn2206251.tier2.hep.manchester.ac.uk
	cpuinfo	Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	257400 (71 hours)
	GPU
	Inner Apptainer?	True
Job state	outputting_failed
Started	2026-01-11 07:05:24
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T090736Z_gen_003968_supernova_g4stage1_g4stage2_detsim_reco_20250730T195747Z_reco2.root
Jobscript	Exit code	0
	Real time	3h (12055s)
	CPU time	3h (11906s = 98%)
	Max RSS bytes	2561310720 (2442 MiB)
Outputting started	2026-01-11 10:26:20
Output files
Finished	2026-01-11 10:26:40
List job events Cached HTCondor job logs
Jobscript log (last 10,000 characters)

77, 1303.60)	132415	132359
marley	22		9.00	(529.08, -768.77, 1303.60)	132360	132321
marley	1000280590	0.00	(529.08, -768.77, 1303.60)	132359	132321
marley	1000070140	0.04	(530.23, -767.63, 1304.41)	132358	132321
marley	1000070140	0.03	(529.54, -767.19, 1304.88)	132357	132321
marley	1000070140	0.00	(530.74, -762.91, 1305.47)	132356	132321
marley	1000070140	0.09	(530.83, -762.45, 1305.58)	132355	132321
marley	1000070140	0.10	(531.13, -763.45, 1303.77)	132354	132321
marley	1000070140	0.00	(532.00, -762.06, 1304.24)	132353	132321
marley	1000070140	0.08	(532.94, -760.65, 1305.12)	132352	132321
marley	1000070140	0.08	(531.28, -758.14, 1303.09)	132351	132321
marley	1000070140	0.13	(531.43, -766.55, 1289.62)	132350	132321
marley	1000260560	0.01	(529.76, -766.33, 1289.92)	132349	132321
marley	1000080160	0.20	(526.38, -758.45, 1290.08)	132348	132321
marley	1000070140	0.16	(526.66, -759.03, 1290.67)	132347	132321
marley	1000070140	0.10	(525.66, -754.87, 1295.29)	132346	132321
marley	1000260560	0.00	(507.65, -741.01, 1292.62)	132345	132321
marley	1000180400	0.03	(324.97, -682.55, 1251.92)	132344	132321
marley	1000180400	0.09	(322.41, -683.54, 1253.29)	132343	132321
marley	22		5.32	(333.98, -693.92, 1255.88)	132322	0
marley	2112		1.39	(333.98, -693.92, 1255.88)	132321	0
marley	1000190390	0.01	(333.98, -693.92, 1255.88)	132320	0
marley	11		49.12	(333.98, -693.92, 1255.88)	132319	0
Signal Track IDs: 132319; 132320; 132321; 132322; 132343; 132344; 132345; 132346; 132347; 132348; 132349; 132350; 132351; 132352; 132353; 132354; 132355; 132356; 132357; 132358; 132359; 132360; 132415; 132416; 132417; 132418; 132419; 132420; 132421; 132422; 132423; 132424; 132425; 132426; [0m
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Jan-2026 09:43:13 GMT run: 5042 subRun: 0 event: 39679
[31m
Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.
[0m
%MSG
Begin processing the 10th record. run: 5042 subRun: 0 event: 39680 at 11-Jan-2026 09:43:14 GMT
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Jan-2026 09:43:18 GMT run: 5042 subRun: 0 event: 39680
[35m
###################################################
Event:			39680
Flag:			349824145
Geometry:		dunevd10kt_3view_30deg_v5_refactored_1x8x14ref (VD)
Signal Label:		marley
PDS Frequency in [MHz]:	62.50
PDS Tick in [us]:	0.016
TPC Frequency in [MHz]:	2.00
TPC Tick in [us]:	0.50
TPC Map:		112 TPCs
TPC DriftLength in [cm]:650.07
TPC DriftTime in [us]:	4048.69
Fiducial Volume in [cm]:850.32, 1507.84, 2306.12
###################################################[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Jan-2026 09:43:19 GMT run: 5042 subRun: 0 event: 39680
[91m
There are a total of 132710 Particles in the event

# of particles 18	from gen 1 marley
# of particles 30885	from gen 2 Ar39GenInLAr
# of particles 3593	from gen 3 Kr85GenInLAr
# of particles 3	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 32	from gen 6 Rn222ChainRn222GenInLAr
# of particles 34	from gen 7 Rn222ChainPo218GenInLAr
# of particles 57	from gen 8 Rn222ChainPb214GenInLAr
# of particles 32	from gen 9 Rn222ChainBi214GenInLAr
# of particles 29	from gen 10 Rn222ChainPb210GenInLAr
# of particles 7	from gen 11 Rn220ChainPb212GenInLAr
# of particles 234	from gen 12 K40GenInCathode
# of particles 3012	from gen 13 U238ChainGenInCathode
# of particles 3654	from gen 14 Th232ChainGenInCathode
# of particles 131	from gen 15 K40GenInAnode
# of particles 1286	from gen 16 U238ChainGenInAnode
# of particles 1623	from gen 17 Th232ChainGenInAnode
# of particles 3	from gen 18 Rn222ChainGenInPDS
# of particles 3	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 4	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 12	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 58	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 50	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 34	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 46	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 22	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Jan-2026 09:43:19 GMT run: 5042 subRun: 0 event: 39680
[33m
Number of Signal Particles: 5
Neutrino Interaction: -1
Neutrino Energy: 11.29 MeV
Position (348.97, 513.61, 1524.31) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.10	(493.88, 329.07, 1015.68)	132774	132771
marley	-12		0.06	(493.88, 329.07, 1015.68)	132773	132771
marley	1000060140	0.04	(493.88, 329.07, 1015.68)	132771	132674
marley	2212		0.58	(493.88, 329.07, 1015.68)	132770	132674
marley	1000070140	0.00	(509.53, 411.36, 1061.67)	132694	132674
marley	1000070140	0.00	(509.23, 412.04, 1062.59)	132693	132674
marley	1000080160	0.00	(510.44, 410.00, 1061.83)	132689	132674
marley	1000070140	0.00	(510.52, 410.35, 1061.49)	132688	132674
marley	2212		0.00	(482.36, 401.76, 1059.19)	132681	132674
marley	2212		0.00	(476.54, 401.10, 1062.79)	132680	132674
marley	2212		0.01	(454.03, 417.69, 1057.91)	132679	132674
marley	2212		0.00	(453.45, 417.99, 1030.84)	132678	132674
marley	2212		0.07	(456.93, 418.32, 1021.71)	132677	132674
marley	2212		0.06	(455.99, 417.74, 1020.58)	132676	132674
marley	1000180400	0.01	(319.14, 384.19, 996.94)	132675	132674
marley	2112		0.15	(348.97, 513.61, 1524.31)	132674	0
marley	1000190390	0.00	(348.97, 513.61, 1524.31)	132673	0
marley	11		1.83	(348.97, 513.61, 1524.31)	132672	0
Signal Track IDs: 132672; 132673; 132674; 132675; 132676; 132677; 132678; 132679; 132680; 132681; 132688; 132689; 132693; 132694; 132770; 132771; 132773; 132774; [0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Jan-2026 09:43:19 GMT run: 5042 subRun: 0 event: 39680
[33m
Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Jan-2026 09:45:25 GMT run: 5042 subRun: 0 event: 39680
[34mOpFlash PE 63.98 with purity 0.37 time -1.18 plane 1
 - Vertex (266.67, 743.30, 1045.94)
	*** 1st Sanity check: Ratio 0.29 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5

# of OpHits (ophit10ppm): 52249 for times between -4254.42 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 18144 for times between -4254.42 us and 295147919198126080.00 us.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Jan-2026 09:45:27 GMT run: 5042 subRun: 0 event: 39680
[36m
# OpHits (ophit10ppm) in full geometry: 52249
# OpFlashes (solarflash) in full geometry: 18144
# Hits (gaushit) in each view: 6640, 6715, 6651, 0
# Cluster from the hits: 2733, 2835, 5620, 0
# Tracks (pmtracktc) in full geometry: 475[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Jan-2026 10:26:18 GMT run: 5042 subRun: 0 event: 39680
[32m
# ClusterReco: Looping over 5616 matched clusters[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Jan-2026 10:26:18 GMT run: 5042 subRun: 0 event: 39680
[32m-----------------------------------------------------------------------------------------
[0m
%MSG
11-Jan-2026 10:26:19 GMT  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/fardet-vd/aa/da/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T090736Z_gen_003968_supernova_g4stage1_g4stage2_detsim_reco_20250730T195747Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 11-Jan-2026 10:26:19 GMT  ModuleEndJob
[35mFinished running the SolarNuAna module[0m
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          1.59396       1195.91       3931.61       2.18151       1502.94        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00167649     0.022212       0.06993     0.00308827     0.0254014       10     
end_path:solarnuana:SolarNuAna      1.59059       1195.89       3931.56       2.12286       1502.95        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 11-Jan-2026 10:26:19 GMT  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3182.61 MB
  Peak resident set size usage (VmHWM): 2561.31 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 11877.829429 Real = 12017.610775

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3182.61 VmHWM = 2561.31

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===