Jobsub ID 299090.1@dunegpschedd01.fnal.gov

Jobsub ID	299090.1@dunegpschedd01.fnal.gov
Workflow ID	12151
Stage ID	1
User name	smanthey@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-22 07:10:42
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2026-01-22 10:02:28
From worker node	Hostname	dunegli-8241095-0-fnpc22035.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-22 07:11:09
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T102002Z_gen_003248_supernova_g4stage1_g4stage2_detsim_reco_20250626T191316Z_reco2.root
Jobscript	Exit code	0
	Real time	2h (10270s)
	CPU time	2h (10200s = 99%)
	Max RSS bytes	2562998272 (2444 MiB)
Outputting started	2026-01-22 10:02:20
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/12151/1/001/fdhd_ana_2026-01-22T_071115Z_hist.root
Finished	2026-01-22 10:02:28
Saved logs	justin-logs:299090.1-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

09:29:13 UTC run: 4961 subRun: 0 event: 32480
[91m
There are a total of 132459 Particles in the event

# of particles 11	from gen 1 marley
# of particles 31130	from gen 2 Ar39GenInLAr
# of particles 3494	from gen 3 Kr85GenInLAr
# of particles 3	from gen 4 Ar42GenInLAr
# of particles 1	from gen 5 K42From42ArGenInLAr
# of particles 35	from gen 6 Rn222ChainRn222GenInLAr
# of particles 30	from gen 7 Rn222ChainPo218GenInLAr
# of particles 49	from gen 8 Rn222ChainPb214GenInLAr
# of particles 28	from gen 9 Rn222ChainBi214GenInLAr
# of particles 15	from gen 10 Rn222ChainPb210GenInLAr
# of particles 6	from gen 11 Rn220ChainPb212GenInLAr
# of particles 242	from gen 12 K40GenInCathode
# of particles 3037	from gen 13 U238ChainGenInCathode
# of particles 3440	from gen 14 Th232ChainGenInCathode
# of particles 107	from gen 15 K40GenInAnode
# of particles 1378	from gen 16 U238ChainGenInAnode
# of particles 1370	from gen 17 Th232ChainGenInAnode
# of particles 0	from gen 18 Rn222ChainGenInPDS
# of particles 6	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 0	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 40	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 54	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 46	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 45	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 27	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 17	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 09:29:13 UTC run: 4961 subRun: 0 event: 32480
[33m
Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 17.28 MeV
Position (54.76, 68.16, 1133.66) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	22		1.46	(54.76, 68.16, 1133.66)	132473	132434
marley	1000180400	0.00	(54.76, 68.16, 1133.66)	132472	132434
marley	12		0.04	(54.76, 68.16, 1133.66)	132471	132434
marley	11		0.00	(54.76, 68.16, 1133.66)	132469	132434
marley	11		0.00	(54.76, 68.16, 1133.66)	132468	132434
marley	11		0.00	(54.76, 68.16, 1133.66)	132467	132434
marley	22		0.03	(54.76, 68.16, 1133.66)	132437	0
marley	22		2.72	(54.76, 68.16, 1133.66)	132436	0
marley	22		1.64	(54.76, 68.16, 1133.66)	132435	0
marley	1000190400	0.00	(54.76, 68.16, 1133.66)	132434	0
marley	11		11.39	(54.76, 68.16, 1133.66)	132433	0
Signal Track IDs: 132433; 132434; 132435; 132436; 132437; 132467; 132468; 132469; 132471; 132472; 132473; [0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 09:29:13 UTC run: 4961 subRun: 0 event: 32480
[33m
Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 09:30:03 UTC run: 4961 subRun: 0 event: 32480
[34mOpFlash PE 87.85 with purity 0.18 time -0.13 plane 0
 - Vertex (-327.50, 277.07, 1300.41)
	*** 1st Sanity check: Ratio 0.27 <= 1.00
	*** 2nd Sanity check: #OpHits 8 >= 8
OpFlash PE 12.30 with purity 0.33 time 0.66 plane 2
 - Vertex (160.03, -743.30, 946.83)
	*** 1st Sanity check: Ratio 0.67 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 155.18 with purity 0.22 time 0.67 plane 0
 - Vertex (-327.50, 57.96, 1060.46)
	*** 1st Sanity check: Ratio 0.11 <= 1.00
	*** 2nd Sanity check: #OpHits 16 >= 16
OpFlash PE 16.45 with purity 0.62 time 1.77 plane 2
 - Vertex (153.72, -743.30, 748.10)
	*** 1st Sanity check: Ratio 0.38 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 49.45 with purity 0.16 time 1.57 plane 0
 - Vertex (-327.50, 360.99, 1024.19)
	*** 1st Sanity check: Ratio 0.24 <= 1.00
	*** 2nd Sanity check: #OpHits 6 >= 6
OpFlash PE 80.14 with purity 0.15 time 2.22 plane 0
 - Vertex (-327.50, -86.88, 1208.40)
	*** 1st Sanity check: Ratio 0.23 <= 1.00
	*** 2nd Sanity check: #OpHits 9 >= 9
OpFlash PE 56.26 with purity 0.18 time 2.32 plane 1
 - Vertex (188.36, 743.30, 1263.56)
	*** 1st Sanity check: Ratio 0.18 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 21.39 with purity 0.33 time 2.66 plane 0
 - Vertex (-327.50, -206.80, 156.24)
	*** 1st Sanity check: Ratio 0.28 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 31.11 with purity 0.03 time 4.64 plane 0
 - Vertex (-327.50, -261.76, 1270.12)
	*** 1st Sanity check: Ratio 0.21 <= 1.00
	*** 2nd Sanity check: #OpHits 6 >= 6

# of OpHits (ophit10ppm): 51410 for times between -4253.58 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 18114 for times between -4253.58 us and 295147919198126080.00 us.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 09:30:05 UTC run: 4961 subRun: 0 event: 32480
[36m
# OpHits (ophit10ppm) in full geometry: 51410
# OpFlashes (solarflash) in full geometry: 18114
# Hits (gaushit) in each view: 6373, 6352, 6428, 0
# Cluster from the hits: 2663, 2692, 5435, 0
# Tracks (pmtracktc) in full geometry: 447[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 10:02:19 UTC run: 4961 subRun: 0 event: 32480
[32m
# ClusterReco: Looping over 5428 matched clusters[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 10:02:19 UTC run: 4961 subRun: 0 event: 32480
[32m*** Matched preselection cluster: 2057 from 5428
 - MainTrackID 132433
 - Gen 1 -> marley TPC 60
 - Purity 1.00 Hits 9
 - Charge 1324.58 ( MaxHit 237.41 )
 - #AdjCl 10 ( 2 signal ):
    - Cluster 1663 at distance 81.42 with time 1327.14 and charge 24.00 in TPC 56 and hits 1
    - Cluster 1776 at distance 82.32 with time 1419.79 and charge 34.22 in TPC 56 and hits 1
    - Cluster 1935 at distance 34.90 with time 1561.50 and charge 291.86 in TPC 60 and hits 2
    - Cluster 1978 at distance 94.44 with time 1593.43 and charge 32.08 in TPC 58 and hits 1
    - Cluster 2110 at distance 12.41 with time 1722.24 and charge 154.66 in TPC 60 and hits 2
    - Cluster 2312 at distance 74.17 with time 1896.40 and charge 89.12 in TPC 60 and hits 1
    - Cluster 2324 at distance 84.93 with time 1901.47 and charge 24.20 in TPC 60 and hits 1
    - Cluster 2523 at distance 90.01 with time 2055.07 and charge 231.76 in TPC 60 and hits 2
    - Cluster 2676 at distance 87.23 with time 2184.88 and charge 54.08 in TPC 60 and hits 2
    - Cluster 2695 at distance 95.30 with time 2196.39 and charge 51.03 in TPC 60 and hits 1
 - RecoCol  Time,Y,Z ( 1674.40, 66.66, 1135.13 )
 - RecoInd0 Time,Y,Z ( 1674.19, 66.67, 1120.40 )
 - RecoInd1 Time,Y,Z ( 1674.24, 66.66, 1120.40 )
*** Matched flash: 9103 from 18114
 - Purity 21.51 % Plane 0 #Hits 16
 - MainOpHitPE 17.39 (PE);  TotalPE 155.18 vs expected 136.52 (PE)
 - Time 0.67 (us) Fast 33.08 % Residual 54.23
 - Reco Time,Y,Z ( 0.67, 57.96, 1060.46 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 54.76, 68.16, 1133.66 )
 - Main X,Y,Z ( 57.12, 66.20, 1135.21 )
 - EDep X,Y,Z ( 56.86, 66.51, 1135.19 )
 - Reco X,Y,Z ( 56.30, 66.66, 1135.13 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 10:02:19 UTC run: 4961 subRun: 0 event: 32480
[32m-----------------------------------------------------------------------------------------
[0m
%MSG
22-Jan-2026 10:02:19 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/71/a9/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T102002Z_gen_003248_supernova_g4stage1_g4stage2_detsim_reco_20250626T191316Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 22-Jan-2026 10:02:19 UTC  ModuleEndJob
[35mFinished running the SolarNuAna module[0m
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.513619       1022.8        2101.41       994.069       1022.62        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000959552    0.0073834     0.0175704     0.0059459    0.00613897       10     
end_path:solarnuana:SolarNuAna     0.512509       1022.79       2101.39       994.061       1022.61        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 22-Jan-2026 10:02:19 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3188.75 MB
  Peak resident set size usage (VmHWM): 2563 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 10188.154053 Real = 10256.728959

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3188.75 VmHWM = 2563

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===