Jobsub ID 271097.0@dunegpschedd02.fnal.gov

Jobsub ID	271097.0@dunegpschedd02.fnal.gov
Workflow ID	11759
Stage ID	1
User name	smanthey@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-13 07:51:05
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2026-01-13 16:40:37
From worker node	Hostname	dunegli-8149378-0-fnpc18007.fnal.gov
	cpuinfo	AMD EPYC 7551 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-13 07:52:02
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T230906Z_gen_003882_supernova_g4stage1_g4stage2_detsim_reco_20250625T092007Z_reco2.root
Jobscript	Exit code	0
	Real time	8h (31694s)
	CPU time	8h (31303s = 98%)
	Max RSS bytes	2569662464 (2450 MiB)
Outputting started	2026-01-13 16:40:17
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/11759/1/001/fdhd_ana_2026-01-13T_075215Z_hist.root
Finished	2026-01-13 16:40:37
Saved logs	justin-logs:271097.0-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

1000180400	0.03	(227.92, -116.98, 1959.71)	132861	132821
marley	1000180400	0.00	(211.30, -115.24, 1986.94)	132860	132821
marley	1000180400	0.01	(172.33, -139.70, 2030.94)	132859	132821
marley	1000180400	0.01	(104.80, -144.30, 2032.50)	132858	132821
marley	1000180400	0.04	(89.74, -132.48, 2034.19)	132857	132821
marley	1000180400	0.03	(104.67, -125.82, 2038.13)	132856	132821
marley	22		6.05	(109.73, -126.76, 2025.55)	132822	0
marley	2112		0.61	(109.73, -126.76, 2025.55)	132821	0
marley	1000190390	0.02	(109.73, -126.76, 2025.55)	132820	0
marley	11		7.83	(109.73, -126.76, 2025.55)	132819	0
Signal Track IDs: 132819; 132820; 132821; 132822; 132856; 132857; 132858; 132859; 132860; 132861; 132862; 132863; 132864; 132865; 132866; 132867; 132868; 132869; 132870; 132871; 132872; 132873; 132874; 132875; 132876; 132877; 132878; 132879; 132880; 132881; 132882; 132883; 132884; 132885; 132886; 132887; 132888; 132889; 132890; 132891; 132892; 132893; 132894; 132895; 132896; 132897; 132898; 132899; 132900; 132901; 132902; 132903; 132904; 132906; 132907; 132908; 132909; 132910; 132948; 132949; [0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Jan-2026 14:48:01 UTC run: 5038 subRun: 0 event: 38820
[33m
Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Jan-2026 14:50:31 UTC run: 5038 subRun: 0 event: 38820
[34mOpFlash PE 91.20 with purity 0.40 time 0.52 plane 0
 - Vertex (-327.50, 60.74, 1956.82)
	*** 1st Sanity check: Ratio 0.23 <= 1.00
	*** 2nd Sanity check: #OpHits 8 >= 8
OpFlash PE 310.65 with purity 0.12 time 0.30 plane 3
 - Vertex (128.98, -7.43, 2188.38)
	*** 1st Sanity check: Ratio 0.16 <= 1.00
	*** 2nd Sanity check: #OpHits 13 >= 13
OpFlash PE 38.12 with purity 0.34 time 3.17 plane 3
 - Vertex (189.78, 133.79, 2188.38)
	*** 1st Sanity check: Ratio 0.48 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 25.69 with purity 0.20 time 4.89 plane 0
 - Vertex (-327.50, 407.63, 1772.30)
	*** 1st Sanity check: Ratio 0.51 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 53.60 with purity 0.19 time 1296.66 plane 3
 - Vertex (120.50, 220.00, 2188.38)
	*** 1st Sanity check: Ratio 0.54 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3

# of OpHits (ophit10ppm): 52778 for times between -4254.25 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 18148 for times between -4253.86 us and 295147919198126080.00 us.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Jan-2026 14:50:35 UTC run: 5038 subRun: 0 event: 38820
[36m
# OpHits (ophit10ppm) in full geometry: 52778
# OpFlashes (solarflash) in full geometry: 18148
# Hits (gaushit) in each view: 6712, 6712, 6607, 0
# Cluster from the hits: 2805, 2902, 5632, 0
# Tracks (pmtracktc) in full geometry: 467[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Jan-2026 16:40:15 UTC run: 5038 subRun: 0 event: 38820
[32m
# ClusterReco: Looping over 5625 matched clusters[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Jan-2026 16:40:15 UTC run: 5038 subRun: 0 event: 38820
[32m*** Matched preselection cluster: 1671 from 5625
 - MainTrackID 132822
 - Gen 1 -> marley TPC 107
 - Purity 1.00 Hits 3
 - Charge 191.25 ( MaxHit 74.67 )
 - #AdjCl 7 ( 0 signal ):
    - Cluster 1052 at distance 78.30 with time 860.08 and charge 27.75 in TPC 107 and hits 1
    - Cluster 1363 at distance 65.88 with time 1101.72 and charge 64.50 in TPC 109 and hits 1
    - Cluster 1391 at distance 43.12 with time 1112.67 and charge 26.22 in TPC 105 and hits 1
    - Cluster 1410 at distance 80.36 with time 1125.01 and charge 43.87 in TPC 107 and hits 1
    - Cluster 1569 at distance 45.51 with time 1248.46 and charge 42.60 in TPC 105 and hits 1
    - Cluster 1704 at distance 87.49 with time 1341.01 and charge 124.50 in TPC 109 and hits 1
    - Cluster 2003 at distance 48.89 with time 1549.38 and charge 20.35 in TPC 107 and hits 1
 - RecoCol  Time,Y,Z ( 1315.08, 164.44, 2003.03 )
 - RecoInd0 Time,Y,Z ( 1315.56, -143.83, 1993.91 )
 - RecoInd1 Time,Y,Z ( 1310.19, 472.72, 522.72 )
*** Matched flash: 7642 from 18148
 - Purity 0.00 % Plane 0 #Hits 4
 - MainOpHitPE 10.42 (PE);  TotalPE 28.02 vs expected 34.69 (PE)
 - Time -676.55 (us) Fast 64.49 % Residual 12.78
 - Reco Time,Y,Z ( -676.55, 201.50, 1998.17 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 109.73, -126.76, 2025.55 )
 - Main X,Y,Z ( 129.81, -146.07, 1997.97 )
 - EDep X,Y,Z ( 110.99, -140.59, 2004.46 )
 - Reco X,Y,Z ( 5.25, 164.44, 2003.03 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Jan-2026 16:40:15 UTC run: 5038 subRun: 0 event: 38820
[32m*** Matched preselection cluster: 1688 from 5625
 - MainTrackID 132819
 - Gen 1 -> marley TPC 107
 - Purity 1.00 Hits 4
 - Charge 997.61 ( MaxHit 740.89 )
 - #AdjCl 5 ( 0 signal ):
    - Cluster 1128 at distance 83.68 with time 930.02 and charge 36.18 in TPC 109 and hits 1
    - Cluster 1183 at distance 88.23 with time 972.71 and charge 53.25 in TPC 105 and hits 1
    - Cluster 1561 at distance 29.28 with time 1242.06 and charge 49.94 in TPC 107 and hits 1
    - Cluster 1817 at distance 32.59 with time 1420.19 and charge 26.79 in TPC 105 and hits 1
    - Cluster 2106 at distance 80.43 with time 1622.44 and charge 24.04 in TPC 105 and hits 1
 - RecoCol  Time,Y,Z ( 1330.74, -127.68, 2025.77 )
 - RecoInd0 Time,Y,Z ( 1331.32, -127.46, 2016.92 )
 - RecoInd1 Time,Y,Z ( 1330.11, -127.91, 2023.62 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 109.73, -126.76, 2025.55 )
 - Main X,Y,Z ( 112.31, -128.24, 2025.49 )
 - EDep X,Y,Z ( 111.01, -139.80, 2005.30 )
 - Reco X,Y,Z ( -1000000.00, -127.68, 2025.77 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Jan-2026 16:40:15 UTC run: 5038 subRun: 0 event: 38820
[32m*** Matched preselection cluster: 1693 from 5625
 - MainTrackID 132822
 - Gen 1 -> marley TPC 107
 - Purity 1.00 Hits 3
 - Charge 487.91 ( MaxHit 327.66 )
 - #AdjCl 9 ( 0 signal ):
    - Cluster 1111 at distance 75.27 with time 915.09 and charge 26.16 in TPC 105 and hits 1
    - Cluster 1357 at distance 90.20 with time 1099.21 and charge 76.49 in TPC 101 and hits 2
    - Cluster 1410 at distance 79.94 with time 1125.01 and charge 43.87 in TPC 107 and hits 1
    - Cluster 1657 at distance 65.97 with time 1307.70 and charge 42.02 in TPC 107 and hits 1
    - Cluster 1752 at distance 89.80 with time 1378.77 and charge 24.91 in TPC 111 and hits 1
    - Cluster 1873 at distance 23.15 with time 1459.51 and charge 49.30 in TPC 109 and hits 1
    - Cluster 1882 at distance 29.57 with time 1464.82 and charge 53.24 in TPC 109 and hits 2
    - Cluster 2211 at distance 74.10 with time 1692.77 and charge 27.56 in TPC 107 and hits 1
    - Cluster 2373 at distance 84.57 with time 1838.29 and charge 62.10 in TPC 109 and hits 1
 - RecoCol  Time,Y,Z ( 1333.22, 306.80, 2004.53 )
 - RecoInd0 Time,Y,Z ( 1333.32, -140.49, 1997.56 )
 - RecoInd1 Time,Y,Z ( 1340.97, 754.08, 223.88 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 109.73, -126.76, 2025.55 )
 - Main X,Y,Z ( 129.81, -146.07, 1997.97 )
 - EDep X,Y,Z ( 110.99, -140.59, 2004.46 )
 - Reco X,Y,Z ( -1000000.00, 306.80, 2004.53 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Jan-2026 16:40:15 UTC run: 5038 subRun: 0 event: 38820
[32m-----------------------------------------------------------------------------------------
[0m
%MSG
13-Jan-2026 16:40:15 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/c7/01/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T230906Z_gen_003882_supernova_g4stage1_g4stage2_detsim_reco_20250625T092007Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 13-Jan-2026 16:40:15 UTC  ModuleEndJob
[35mFinished running the SolarNuAna module[0m
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          1.85703       3159.49       6823.03       2577.85       3185.77        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00166812     0.0137115     0.0362105    0.00733181     0.0126491       10     
end_path:solarnuana:SolarNuAna      1.85515       3159.47       6823.01       2577.84       3185.77        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 13-Jan-2026 16:40:15 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3189.21 MB
  Peak resident set size usage (VmHWM): 2569.66 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 31271.020960 Real = 31659.065582

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3189.21 VmHWM = 2569.66

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===