Jobsub ID 269147.1@dunegpschedd02.fnal.gov

Jobsub ID	269147.1@dunegpschedd02.fnal.gov
Workflow ID	11693
Stage ID	1
User name	smanthey@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-11 18:39:06
Site	UK_Manchester
Entry	UBoone_T2_UK_Manchester_ce02
Last heartbeat	2026-01-11 21:15:37
From worker node	Hostname	wn2208241.tier2.hep.manchester.ac.uk
	cpuinfo	AMD EPYC 7513 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	257400 (71 hours)
	GPU
	Inner Apptainer?	True
Job state	outputting_failed
Started	2026-01-11 18:39:29
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T140107Z_gen_000661_supernova_g4stage1_g4stage2_detsim_reco_20250731T113620Z_reco2.root
Jobscript	Exit code	0
	Real time	2h (9349s)
	CPU time	2h (9221s = 98%)
	Max RSS bytes	2563362816 (2444 MiB)
Outputting started	2026-01-11 21:15:19
Output files
Finished	2026-01-11 21:15:37
List job events Cached HTCondor job logs
Jobscript log (last 10,000 characters)

067 subRun: 0 event: 6609
[32m*** Matched preselection cluster: 3846 from 5481
 - MainTrackID 132528
 - Gen 1 -> marley TPC 110
 - Purity 1.00 Hits 2
 - Charge 153.98 ( MaxHit 94.39 )
 - #AdjCl 1 ( 0 signal ):
    - Cluster 3835 at distance 63.98 with time 2978.23 and charge 35.95 in TPC 104 and hits 1
 - RecoCol  Time,Y,Z ( 2990.17, 504.00, 2061.86 )
 - RecoInd0 Time,Y,Z ( 2990.33, 504.02, 2076.05 )
 - RecoInd1 Time,Y,Z ( 2990.24, 503.99, 2002.74 )
*** Matched flash: 8730 from 17929
 - Purity 0.00 % Plane 0 #Hits 4
 - MainOpHitPE 191.55 (PE);  TotalPE 378.95 vs expected 101.52 (PE)
 - Time -98.56 (us) Fast 97.10 % Residual 2019.69
 - Reco Time,Y,Z ( -98.56, 538.10, 2044.46 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -154.84, 503.98, 2061.90 )
 - Main X,Y,Z ( -155.10, 503.92, 2061.82 )
 - EDep X,Y,Z ( -155.06, 503.94, 2061.87 )
 - Reco X,Y,Z ( -170.90, 504.00, 2061.86 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Jan-2026 21:15:15 GMT run: 5067 subRun: 0 event: 6609
[32m*** Matched preselection cluster: 3870 from 5481
 - MainTrackID 132531
 - Gen 1 -> marley TPC 110
 - Purity 1.00 Hits 1
 - Charge 28.81 ( MaxHit 28.81 )
 - #AdjCl 0 ( 0 signal ):
 - RecoCol  Time,Y,Z ( 3008.05, 695.95, 2063.07 )
 - RecoInd0 Time,Y,Z ( 3003.21, -73.30, 1128.43 )
 - RecoInd1 Time,Y,Z ( 3007.15, 1465.19, 522.72 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -154.84, 503.98, 2061.90 )
 - Main X,Y,Z ( -137.61, 518.14, 2070.17 )
 - EDep X,Y,Z ( -157.91, 504.01, 2063.24 )
 - Reco X,Y,Z ( -1000000.00, 695.95, 2063.07 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Jan-2026 21:15:15 GMT run: 5067 subRun: 0 event: 6609
[32m-----------------------------------------------------------------------------------------
[0m
%MSG
Begin processing the 10th record. run: 5067 subRun: 0 event: 6610 at 11-Jan-2026 21:15:15 GMT
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Jan-2026 21:15:18 GMT run: 5067 subRun: 0 event: 6610
[35m
###################################################
Event:			6610
Flag:			1125938731
Geometry:		dunevd10kt_3view_30deg_v5_refactored_1x8x14ref (VD)
Signal Label:		marley
PDS Frequency in [MHz]:	62.50
PDS Tick in [us]:	0.016
TPC Frequency in [MHz]:	2.00
TPC Tick in [us]:	0.50
TPC Map:		112 TPCs
TPC DriftLength in [cm]:650.07
TPC DriftTime in [us]:	4048.69
Fiducial Volume in [cm]:850.32, 1507.84, 2306.12
###################################################[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Jan-2026 21:15:18 GMT run: 5067 subRun: 0 event: 6610
[91m
There are a total of 132933 Particles in the event

# of particles 37	from gen 1 marley
# of particles 30912	from gen 2 Ar39GenInLAr
# of particles 3683	from gen 3 Kr85GenInLAr
# of particles 2	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 40	from gen 6 Rn222ChainRn222GenInLAr
# of particles 27	from gen 7 Rn222ChainPo218GenInLAr
# of particles 38	from gen 8 Rn222ChainPb214GenInLAr
# of particles 37	from gen 9 Rn222ChainBi214GenInLAr
# of particles 37	from gen 10 Rn222ChainPb210GenInLAr
# of particles 29	from gen 11 Rn220ChainPb212GenInLAr
# of particles 227	from gen 12 K40GenInCathode
# of particles 2979	from gen 13 U238ChainGenInCathode
# of particles 3686	from gen 14 Th232ChainGenInCathode
# of particles 84	from gen 15 K40GenInAnode
# of particles 1327	from gen 16 U238ChainGenInAnode
# of particles 1717	from gen 17 Th232ChainGenInAnode
# of particles 0	from gen 18 Rn222ChainGenInPDS
# of particles 1	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 2	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 9	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 31	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 62	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 34	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 63	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 21	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Jan-2026 21:15:18 GMT run: 5067 subRun: 0 event: 6610
[33m
Number of Signal Particles: 6
Neutrino Interaction: -1
Neutrino Energy: 60.36 MeV
Position (-254.44, 123.69, 333.02) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.11	(-115.05, 397.74, -188.22)	133017	133014
marley	-12		0.05	(-115.05, 397.74, -188.22)	133016	133014
marley	1000060140	0.04	(-115.05, 397.74, -188.22)	133014	132879
marley	2212		0.58	(-115.05, 397.74, -188.22)	133013	132879
marley	2212		0.00	(-127.03, 357.05, -113.45)	132956	132879
marley	1000060120	0.00	(-228.62, 415.45, -109.25)	132929	132879
marley	1000080160	0.00	(-244.69, 414.29, -114.93)	132928	132879
marley	2212		0.00	(-242.78, 419.67, -123.11)	132927	132879
marley	1000060120	0.00	(-241.84, 419.97, -123.34)	132926	132879
marley	2212		0.00	(-245.94, 417.55, -125.97)	132925	132879
marley	2212		0.00	(-248.84, 419.08, -132.53)	132924	132879
marley	2212		0.01	(-249.96, 417.78, -135.53)	132923	132879
marley	2212		0.01	(-242.84, 423.26, -148.88)	132922	132879
marley	2212		0.11	(-241.59, 425.46, -149.51)	132921	132879
marley	2212		0.01	(-241.27, 426.29, -148.41)	132920	132879
marley	2212		0.29	(-231.85, 443.66, -131.45)	132919	132879
marley	1000060120	0.12	(-230.02, 446.45, -132.31)	132918	132879
marley	1000180400	0.01	(-228.29, 420.14, -65.38)	132917	132879
marley	1000180400	0.01	(-221.00, 371.00, -48.59)	132916	132879
marley	1000180400	0.02	(-220.83, 355.71, -59.32)	132915	132879
marley	1000180400	0.04	(-220.36, 336.97, -40.77)	132914	132879
marley	1000180400	0.06	(-226.36, 339.78, -39.26)	132913	132879
marley	1000180400	0.02	(-211.00, 331.82, -32.27)	132912	132879
marley	1000180400	0.02	(-221.07, 290.04, 91.41)	132911	132879
marley	1000180400	0.00	(-203.73, 273.00, 102.52)	132910	132879
marley	1000180400	0.01	(-168.17, 229.38, 157.07)	132909	132879
marley	1000180400	0.08	(-150.90, 185.90, 153.25)	132908	132879
marley	1000180380	0.03	(-162.90, 199.29, 158.95)	132907	132879
marley	1000180360	0.01	(-274.92, 135.81, 303.95)	132906	132879
marley	1000180400	0.06	(-304.91, 131.85, 318.33)	132905	132879
marley	1000180400	0.10	(-295.89, 132.00, 325.48)	132904	132879
marley	1000180400	0.10	(-299.49, 133.16, 322.84)	132903	132879
marley	1000180400	0.09	(-268.28, 103.47, 361.82)	132902	132879
marley	22		2.51	(-254.44, 123.69, 333.02)	132880	0
marley	2112		1.22	(-254.44, 123.69, 333.02)	132879	0
marley	1000190390	0.19	(-254.44, 123.69, 333.02)	132878	0
marley	11		47.14	(-254.44, 123.69, 333.02)	132877	0
Signal Track IDs: 132877; 132878; 132879; 132880; 132902; 132903; 132904; 132905; 132906; 132907; 132908; 132909; 132910; 132911; 132912; 132913; 132914; 132915; 132916; 132917; 132918; 132919; 132920; 132921; 132922; 132923; 132924; 132925; 132926; 132927; 132928; 132929; 132956; 133013; 133014; 133016; 133017; [0m
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Jan-2026 21:15:18 GMT run: 5067 subRun: 0 event: 6610
[31m
Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.
[0m
%MSG
11-Jan-2026 21:15:18 GMT  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/fardet-vd/16/d3/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T140107Z_gen_000661_supernova_g4stage1_g4stage2_detsim_reco_20250731T113620Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 11-Jan-2026 21:15:18 GMT  ModuleEndJob
[35mFinished running the SolarNuAna module[0m
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          0.51043       930.712       1735.5        1271.32       776.67         10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000732676    0.0211835     0.0646478    0.00282422     0.0247294       10     
end_path:solarnuana:SolarNuAna     0.509039       930.691       1735.5        1271.32       776.674        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 11-Jan-2026 21:15:18 GMT  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3181.34 MB
  Peak resident set size usage (VmHWM): 2563.36 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 9210.005231 Real = 9336.642037

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3181.34 VmHWM = 2563.36

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===