Jobsub ID 276630.0@dunegpschedd01.fnal.gov

Jobsub ID	276630.0@dunegpschedd01.fnal.gov
Workflow ID	11751
Stage ID	1
User name	smanthey@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-13 01:10:44
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat	2026-01-13 01:19:33
From worker node	Hostname	dunegli-8305123-0-fnpc22010.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-13 01:11:54
Input files	fardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250207T102417Z_gen_002512_supernova_g4_detsim_reco_20250724T014001Z_reco2.root
Jobscript	Exit code	0
	Real time	7m (433s)
	CPU time	6m (397s = 91%)
	Max RSS bytes	906051584 (864 MiB)
Outputting started	2026-01-13 01:19:07
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dune10kt_1x2x6_centralAPA/fnal/11751/1/001/fdhd_ana_2026-01-13T_011221Z_hist.root
Finished	2026-01-13 01:19:33
Saved logs	justin-logs:276630.0-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

n 9 Rn222ChainBi214GenInLAr
# of particles 5	from gen 10 Rn222ChainPb210GenInLAr
# of particles 5	from gen 11 Rn220ChainPb212GenInLAr
# of particles 20	from gen 12 K40GenInCPA
# of particles 190	from gen 13 U238ChainGenInCPA
# of particles 338	from gen 14 Th232ChainGenInCPA
# of particles 1	from gen 15 K42From42ArGenInCPA
# of particles 3	from gen 16 Rn222ChainPo218GenInCPA
# of particles 6	from gen 17 Rn222ChainPb214GenInCPA
# of particles 59	from gen 18 Rn222ChainBi214GenInCPA
# of particles 32	from gen 19 Rn222ChainPb210GenInCPA
# of particles 33	from gen 20 Rn222ChainFromBi210GenInCPA
# of particles 24	from gen 21 Rn220ChainFromPb212GenInCPA
# of particles 0	from gen 22 Co60GenInAPA
# of particles 8	from gen 23 U238ChainGenInAPA
# of particles 4	from gen 24 Th232ChainGenInAPA
# of particles 42	from gen 25 U238Th232K40GenInLArAPAboards1x2x6
# of particles 0	from gen 26 Rn222ChainGenInPDS
# of particles 19159	from gen 27 CavernwallGammasAtLAr1x2x6lowBgAPA
# of particles 764	from gen 28 foamGammasAtLAr1x2x6lowBgAPA
# of particles 0	from gen 29 CavernwallNeutronsAtLAr1x2x6lowBgAPA
# of particles 0	from gen 30 CryostatNGammasAtLAr1x2x6lowBgAPA
# of particles 0	from gen 31 CavernNGammasAtLAr1x2x6lowBgAPA[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Jan-2026 01:18:52 UTC run: 5089 subRun: 0 event: 125600
[33m
Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 24.82 MeV
Position (251.01, 235.35, 1114.88) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	22		1.46	(251.01, 235.35, 1114.88)	32902	32845
marley	1000180400	0.00	(251.01, 235.35, 1114.88)	32901	32845
marley	12		0.04	(251.01, 235.35, 1114.88)	32900	32845
marley	11		0.00	(251.01, 235.35, 1114.88)	32898	32845
marley	11		0.00	(251.01, 235.35, 1114.88)	32897	32845
marley	11		0.00	(251.01, 235.35, 1114.88)	32896	32845
marley	11		0.00	(251.01, 235.35, 1114.88)	32895	32845
marley	22		0.03	(251.01, 235.35, 1114.88)	32848	0
marley	22		0.77	(251.01, 235.35, 1114.88)	32847	0
marley	22		4.88	(251.01, 235.35, 1114.88)	32846	0
marley	1000190400	0.01	(251.01, 235.35, 1114.88)	32845	0
marley	11		17.62	(251.01, 235.35, 1114.88)	32844	0
Signal Track IDs: 32844; 32845; 32846; 32847; 32848; 32895; 32896; 32897; 32898; 32900; 32901; 32902; [0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Jan-2026 01:18:52 UTC run: 5089 subRun: 0 event: 125600
[33m
Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Jan-2026 01:18:55 UTC run: 5089 subRun: 0 event: 125600
[34mOpFlash PE 73.30 with purity 1.00 time -17.74 plane 0
 - Vertex (0.05, 247.38, 1040.98)
	*** 1st Sanity check: Ratio 0.14 <= 1.00
	*** 2nd Sanity check: #OpHits 19 >= 19
OpFlash PE 9.60 with purity 1.00 time -17.68 plane 0
 - Vertex (0.01, -152.76, 877.05)
	*** 1st Sanity check: Ratio 0.42 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 43.97 with purity 1.00 time -17.18 plane 0
 - Vertex (0.04, 255.33, 1013.40)
	*** 1st Sanity check: Ratio 0.14 <= 1.00
	*** 2nd Sanity check: #OpHits 15 >= 15
OpFlash PE 13.20 with purity 0.93 time -16.74 plane 0
 - Vertex (0.05, 252.56, 1060.44)
	*** 1st Sanity check: Ratio 0.30 <= 1.00
	*** 2nd Sanity check: #OpHits 6 >= 6
OpFlash PE 32.47 with purity 0.89 time -16.16 plane 0
 - Vertex (0.05, 217.95, 1125.08)
	*** 1st Sanity check: Ratio 0.44 <= 1.00
	*** 2nd Sanity check: #OpHits 9 >= 9
OpFlash PE 22.79 with purity 1.00 time -15.52 plane 0
 - Vertex (0.05, 333.31, 1041.04)
	*** 1st Sanity check: Ratio 0.37 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 71.35 with purity 0.11 time -15.12 plane 0
 - Vertex (0.05, 31.14, 611.50)
	*** 1st Sanity check: Ratio 0.89 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 18.01 with purity 0.77 time -14.74 plane 0
 - Vertex (0.05, 287.71, 908.63)
	*** 1st Sanity check: Ratio 0.21 <= 1.00
	*** 2nd Sanity check: #OpHits 8 >= 8
OpFlash PE 6.99 with purity 0.74 time -14.26 plane 0
 - Vertex (-0.00, -32.68, 1095.47)
	*** 1st Sanity check: Ratio 0.26 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 11.43 with purity 0.47 time -14.27 plane 0
 - Vertex (0.05, 217.95, 548.70)
	*** 1st Sanity check: Ratio 0.70 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 1.99 with purity 1.00 time -13.70 plane 0
 - Vertex (0.05, 467.03, 1076.28)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 1.98 with purity 1.00 time -13.26 plane 0
 - Vertex (0.05, 404.76, 499.90)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 18.79 with purity 0.67 time -12.45 plane 0
 - Vertex (0.05, 93.41, 1197.07)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 1.99 with purity 1.00 time -12.32 plane 0
 - Vertex (-0.05, -529.30, 611.50)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 6.88 with purity 0.21 time -10.46 plane 0
 - Vertex (0.05, 182.38, 1012.04)
	*** 1st Sanity check: Ratio 0.43 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3

# of OpHits (ophitspe): 70698 for times between -2261.86 us and 2227.87 us.
# of OpFlashes (solarflash): 9576 for times between -2261.86 us and 2227.87 us.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Jan-2026 01:18:55 UTC run: 5089 subRun: 0 event: 125600
[36m
# OpHits (ophitspe) in full geometry: 70698
# OpFlashes (solarflash) in full geometry: 9576
# Hits (hitfd) in each view: 177, 182, 436, 0
# Cluster from the hits: 115, 115, 399, 0
# Tracks (pmtracktc) in full geometry: 2[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Jan-2026 01:19:07 UTC run: 5089 subRun: 0 event: 125600
[32m
# ClusterReco: Looping over 222 matched clusters[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Jan-2026 01:19:07 UTC run: 5089 subRun: 0 event: 125600
[32m*** Matched preselection cluster: 112 from 222
 - MainTrackID 32844
 - Gen 1 -> marley TPC 19
 - Purity 1.00 Hits 5
 - Charge 1320.63 ( MaxHit 458.74 )
 - #AdjCl 5 ( 4 signal ):
    - Cluster 92 at distance 95.38 with time 1379.27 and charge 52.79 in TPC 17 and hits 1
    - Cluster 101 at distance 11.59 with time 1510.25 and charge 384.58 in TPC 19 and hits 2
    - Cluster 105 at distance 13.08 with time 1535.06 and charge 85.37 in TPC 19 and hits 1
    - Cluster 133 at distance 27.14 with time 1724.22 and charge 319.94 in TPC 19 and hits 2
    - Cluster 151 at distance 70.16 with time 1952.62 and charge 143.93 in TPC 19 and hits 1
 - RecoCol  Time,Y,Z ( 1557.66, 235.97, 1114.20 )
 - RecoInd0 Time,Y,Z ( 1559.21, 236.16, 1052.68 )
 - RecoInd1 Time,Y,Z ( 1558.12, 235.78, 1044.88 )
*** Matched flash: 4908 from 9576
 - Purity 100.00 % Plane 0 #Hits 19
 - MainOpHitPE 10.47 (PE);  TotalPE 73.30 vs expected 130.99 (PE)
 - Time -17.74 (us) Fast 15.65 % Residual 31.30
 - Reco Time,Y,Z ( -17.74, 247.38, 1040.98 )
 - Found valid waveform: false
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 251.01, 235.35, 1114.88 )
 - Main X,Y,Z ( 255.27, 236.06, 1113.61 )
 - EDep X,Y,Z ( 251.20, 235.47, 1114.78 )
 - Reco X,Y,Z ( 252.95, 235.97, 1114.20 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Jan-2026 01:19:07 UTC run: 5089 subRun: 0 event: 125600
[32m-----------------------------------------------------------------------------------------
[0m
%MSG
13-Jan-2026 01:19:07 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/0f/36/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250207T102417Z_gen_002512_supernova_g4_detsim_reco_20250724T014001Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 13-Jan-2026 01:19:07 UTC  ModuleEndJob
[35mFinished running the SolarNuAna module[0m
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.149295       7.20608       23.8238      0.387248       9.01441        50     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00108089    0.00716213     0.059722     0.00175235     0.0119451       50     
end_path:solarnuana:SolarNuAna      0.14785       7.19877       23.8215      0.378835       9.01522        50     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 13-Jan-2026 01:19:07 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1550.66 MB
  Peak resident set size usage (VmHWM): 904.298 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 50 passed = 50 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         50         50          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 381.153260 Real = 395.034416

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1550.66 VmHWM = 904.298

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===