Jobsub ID 271672.5@dunegpschedd01.fnal.gov

Jobsub ID	271672.5@dunegpschedd01.fnal.gov
Workflow ID	11518
Stage ID	1
User name	smanthey@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-04 21:37:33
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2026-01-04 21:51:58
From worker node	Hostname	dunegli-8084275-0-fnpc8001.fnal.gov
	cpuinfo	Intel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-04 21:39:18
Input files	fardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250207T182150Z_gen_003868_supernova_g4_detsim_reco_20250724T114612Z_reco2.root
Jobscript	Exit code	0
	Real time	12m (747s)
	CPU time	12m (731s = 97%)
	Max RSS bytes	906006528 (864 MiB)
Outputting started	2026-01-04 21:51:46
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dune10kt_1x2x6_centralAPA/fnal/11518/1/001/fdhd_ana_2026-01-04T_213928Z_hist.root
Finished	2026-01-04 21:51:58
Saved logs	justin-logs:271672.5-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

cles 0	from gen 31 CavernNGammasAtLAr1x2x6lowBgAPA[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  04-Jan-2026 21:51:15 UTC run: 5092 subRun: 0 event: 193400
[33m
Number of Signal Particles: 5
Neutrino Interaction: -1
Neutrino Energy: 16.43 MeV
Position (272.62, 457.19, 261.94) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	1000240540	0.00	(-523.65, -200.89, 299.56)	32950	32874
marley	22		4.58	(-523.65, -200.89, 299.56)	32949	32874
marley	22		5.32	(-523.65, -200.89, 299.56)	32948	32874
marley	22		4.78	(-523.65, -200.89, 299.56)	32947	32874
marley	2212		0.00	(-427.40, -81.26, 179.04)	32928	32874
marley	2212		0.00	(-398.75, -82.09, 166.58)	32926	32874
marley	2212		0.00	(-397.91, -73.28, 168.50)	32925	32874
marley	1000060120	0.00	(-396.26, -71.05, 169.01)	32924	32874
marley	2212		0.00	(-395.19, -68.64, 163.66)	32923	32874
marley	2212		0.00	(-393.98, -62.32, 161.68)	32922	32874
marley	2212		0.00	(-394.06, -58.03, 165.76)	32921	32874
marley	2212		0.00	(-393.56, -57.74, 165.92)	32920	32874
marley	1000180400	0.00	(-373.92, -56.72, 161.39)	32919	32874
marley	1000180400	0.00	(-309.28, -135.70, 178.53)	32918	32874
marley	1000180400	0.00	(-297.89, -134.90, 178.93)	32917	32874
marley	1000180400	0.00	(-204.38, -97.85, 195.90)	32916	32874
marley	1000180360	0.00	(-159.86, 37.96, 177.36)	32915	32874
marley	1000180360	0.00	(94.66, 49.75, 112.20)	32914	32874
marley	1000180360	0.00	(94.62, 49.72, 112.25)	32913	32874
marley	1000180400	0.00	(98.63, 40.81, 113.05)	32912	32874
marley	1000180400	0.00	(88.26, 36.06, 109.66)	32911	32874
marley	1000180400	0.00	(89.44, 82.22, 153.86)	32910	32874
marley	1000180400	0.00	(93.30, 147.44, 173.67)	32909	32874
marley	1000180400	0.00	(87.50, 164.63, 137.62)	32908	32874
marley	1000180360	0.00	(42.97, 131.63, 101.12)	32907	32874
marley	1000180400	0.00	(28.28, 208.35, 80.89)	32906	32874
marley	1000180360	0.00	(36.17, 192.46, 78.13)	32905	32874
marley	1000180400	0.00	(68.44, 474.38, 9.16)	32904	32874
marley	1000180400	0.00	(142.77, 474.10, 217.39)	32903	32874
marley	1000180400	0.00	(141.23, 455.21, 206.29)	32902	32874
marley	1000180400	0.00	(139.83, 403.09, 192.44)	32901	32874
marley	1000180400	0.00	(120.03, 434.54, 298.57)	32900	32874
marley	1000180400	0.00	(93.53, 358.87, 220.11)	32899	32874
marley	1000180400	0.00	(94.77, 361.87, 218.00)	32898	32874
marley	1000180400	0.00	(78.12, 455.64, 204.67)	32897	32874
marley	1000180400	0.00	(70.86, 455.04, 199.36)	32896	32874
marley	1000180400	0.00	(38.56, 609.35, 303.93)	32895	32874
marley	1000180400	0.00	(197.48, 384.74, 245.15)	32894	32874
marley	2212		0.00	(387.73, 421.26, 162.68)	32893	32874
marley	1000060120	0.02	(387.94, 421.38, 162.61)	32892	32874
marley	1000260560	0.00	(378.91, 412.79, 159.93)	32891	32874
marley	1000180400	0.00	(330.25, 396.59, 203.47)	32890	32874
marley	1000180400	0.01	(244.43, 419.28, 315.04)	32889	32874
marley	1000180400	0.00	(261.46, 425.31, 255.98)	32888	32874
marley	1000180400	0.01	(264.29, 432.75, 257.36)	32887	32874
marley	1000180400	0.01	(263.65, 431.17, 258.26)	32886	32874
marley	1000180400	0.01	(260.43, 435.28, 255.38)	32885	32874
marley	1000180400	0.01	(259.80, 435.48, 257.46)	32884	32874
marley	1000180400	0.00	(234.49, 425.19, 244.72)	32883	32874
marley	1000180400	0.00	(229.79, 425.28, 244.99)	32882	32874
marley	1000180400	0.00	(211.90, 394.26, 247.53)	32881	32874
marley	1000180360	0.01	(200.41, 398.63, 238.86)	32880	32874
marley	1000180400	0.01	(216.05, 471.11, 249.70)	32879	32874
marley	1000180400	0.01	(249.06, 430.94, 225.68)	32878	32874
marley	1000180400	0.00	(249.06, 430.94, 225.69)	32877	32874
marley	1000180400	0.01	(266.65, 452.55, 239.80)	32876	32874
marley	1000180400	0.01	(237.88, 441.00, 258.01)	32875	32874
marley	2112		0.15	(272.62, 457.19, 261.94)	32874	0
marley	1000190390	0.00	(272.62, 457.19, 261.94)	32873	0
marley	11		6.97	(272.62, 457.19, 261.94)	32872	0
Signal Track IDs: 32872; 32873; 32874; 32875; 32876; 32877; 32878; 32879; 32880; 32881; 32882; 32883; 32884; 32885; 32886; 32887; 32888; 32889; 32890; 32891; 32892; 32893; 32894; 32895; 32896; 32897; 32898; 32899; 32900; 32901; 32902; 32903; 32904; 32905; 32906; 32907; 32908; 32909; 32910; 32911; 32912; 32913; 32914; 32915; 32916; 32917; 32918; 32919; 32920; 32921; 32922; 32923; 32924; 32925; 32926; 32928; 32947; 32948; 32949; 32950; [0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  04-Jan-2026 21:51:15 UTC run: 5092 subRun: 0 event: 193400
[33m
Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  04-Jan-2026 21:51:25 UTC run: 5092 subRun: 0 event: 193400
[34mOpFlash PE 16.37 with purity 0.35 time -17.75 plane 0
 - Vertex (0.05, 318.79, 322.92)
	*** 1st Sanity check: Ratio 0.24 <= 1.00
	*** 2nd Sanity check: #OpHits 6 >= 6
OpFlash PE 6.37 with purity 0.46 time -16.59 plane 0
 - Vertex (0.03, 225.44, 418.37)
	*** 1st Sanity check: Ratio 0.46 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 3.47 with purity 1.00 time -15.84 plane 0
 - Vertex (0.05, 469.36, 458.37)
	*** 1st Sanity check: Ratio 0.52 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 8.11 with purity 0.64 time -15.12 plane 0
 - Vertex (0.05, 406.37, 412.23)
	*** 1st Sanity check: Ratio 0.32 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 10.41 with purity 0.32 time -14.42 plane 0
 - Vertex (0.05, 31.14, 267.51)
	*** 1st Sanity check: Ratio 0.68 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 3.29 with purity 1.00 time -14.11 plane 0
 - Vertex (0.05, 497.31, 486.65)
	*** 1st Sanity check: Ratio 0.51 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2

# of OpHits (ophitspe): 71767 for times between -2261.74 us and 2227.82 us.
# of OpFlashes (solarflash): 9828 for times between -2261.74 us and 2227.66 us.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  04-Jan-2026 21:51:25 UTC run: 5092 subRun: 0 event: 193400
[36m
# OpHits (ophitspe) in full geometry: 71767
# OpFlashes (solarflash) in full geometry: 9828
# Hits (hitfd) in each view: 210, 213, 501, 0
# Cluster from the hits: 129, 133, 465, 0
# Tracks (pmtracktc) in full geometry: 1[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  04-Jan-2026 21:51:46 UTC run: 5092 subRun: 0 event: 193400
[32m
# ClusterReco: Looping over 291 matched clusters[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  04-Jan-2026 21:51:46 UTC run: 5092 subRun: 0 event: 193400
[32m*** Matched preselection cluster: 205 from 291
 - MainTrackID 32872
 - Gen 1 -> marley TPC 7
 - Purity 1.00 Hits 2
 - Charge 817.39 ( MaxHit 452.51 )
 - #AdjCl 0 ( 0 signal ):
 - RecoCol  Time,Y,Z ( 1680.84, 458.55, 261.99 )
 - RecoInd0 Time,Y,Z ( 1680.87, 458.57, 298.03 )
 - RecoInd1 Time,Y,Z ( 1680.63, 458.53, 347.71 )
*** Matched flash: 4092 from 9828
 - Purity 0.00 % Plane 0 #Hits 7 PE 28.70 MainOpHitPE 5.93
 - Time -395.79 (us) Fast 37.36 % Residual 3.29
 - Reco Time,Y,Z ( -395.79, 460.90, 193.49 )
 - Found valid waveform: false
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 272.62, 457.19, 261.94 )
 - Main X,Y,Z ( 272.00, 458.98, 262.09 )
 - EDep X,Y,Z ( 273.21, 458.47, 261.90 )
 - Reco X,Y,Z ( 333.43, 458.55, 261.99 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  04-Jan-2026 21:51:46 UTC run: 5092 subRun: 0 event: 193400
[32m-----------------------------------------------------------------------------------------
[0m
%MSG
04-Jan-2026 21:51:46 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/7f/b2/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250207T182150Z_gen_003868_supernova_g4_detsim_reco_20250724T114612Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 04-Jan-2026 21:51:46 UTC  ModuleEndJob
[35mFinished running the SolarNuAna module[0m
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          0.30726       12.9451       39.3131      0.840397       15.8363        50     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00134807    0.00743023     0.0604248    0.00201751     0.0126973       50     
end_path:solarnuana:SolarNuAna     0.305271       12.9374       39.3109      0.828709       15.8364        50     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 04-Jan-2026 21:51:46 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1551.84 MB
  Peak resident set size usage (VmHWM): 907.71 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 50 passed = 50 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         50         50          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 688.223535 Real = 701.265758

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1551.84 VmHWM = 907.71

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===