Jobsub ID 39826.0@dunegpschedd02.fnal.gov

Jobsub ID	39826.0@dunegpschedd02.fnal.gov
Workflow ID	2587
Stage ID	1
User name	smanthey@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-09-14 23:10:59
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat	2025-09-14 23:31:19
From worker node	Hostname	dunegli-7021461-0-fnpc19131.fnal.gov
	cpuinfo	AMD EPYC 7502 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-09-14 23:11:53
Input files	fardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250207T175132Z_gen_003376_supernova_g4_detsim_reco_20250723T185337Z_reco2.root
Jobscript	Exit code	0
	Real time	19m (1156s)
	CPU time	18m (1139s = 98%)
	Max RSS bytes	924860416 (882 MiB)
Outputting started	2025-09-14 23:31:09
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dune10kt_1x2x6_centralAPA/fnal/02587/1/001/fdhd_ana_2025-09-14T_231202Z_hist.root
Finished	2025-09-14 23:31:19
Saved logs	justin-logs:39826.0-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

1.00
	*** 2nd Sanity check: #OpHits 20 >= 20
OpFlash PE 161.63 with purity 0.48 time 0.03 plane 0
 - Vertex (-0.05, -70.75, 292.34)
	*** 1st Sanity check: Ratio 0.33 <= 1.00
	*** 2nd Sanity check: #OpHits 38 >= 38
OpFlash PE 18.38 with purity 0.79 time 0.08 plane 1
 - Vertex (0.05, 280.22, 316.31)
	*** 1st Sanity check: Ratio 0.68 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4

# of OpFlashes (solarflash) in full geometry: 1581
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  14-Sep-2025 23:30:33 UTC run: 5092 subRun: 0 event: 168799
[36m
# OpHits (ophitspe) in full geometry: 73026
# OpFlashes (solarflash) in full geometry: 1581
# Hits (hitfd) in each view: 192, 183, 438, 0
# Cluster from the hits: 120, 115, 413, 0
# Tracks (pmtracktc) in full geometry: 3[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  14-Sep-2025 23:30:48 UTC run: 5092 subRun: 0 event: 168799
[32m
# ClusterReco: Looping over 263 matched clusters[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  14-Sep-2025 23:30:48 UTC run: 5092 subRun: 0 event: 168799
[32m*** Matched preselection cluster: 142
 - MainTrackID 33010
 - Gen 1 -> marley TPC 4
 - Purity 1.00 Hits 4
 - Charge 1248.91 ( MaxHit 556.99 )
 - #AdjCl 0 ( 0 signal ):
 - RecoCol  Time,Y,Z ( 1575.35, -296.48, 361.48 )
 - RecoInd0 Time,Y,Z ( 1574.35, -296.57, 347.71 )
 - RecoInd1 Time,Y,Z ( 1574.33, -296.39, 347.71 )
*** Matched flash: 
 - Purity 0.00 Plane 0 #Hits 96 PE 783.80 MaxPE 129.65
 - Time -3.16 Fast 0.72 Residual 7888.02
 - Reco Time,Y,Z ( -3.16, -367.99, 453.83 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -255.44, -298.38, 360.50 )
 - Main X,Y,Z ( -256.17, -294.98, 361.68 )
 - EDep X,Y,Z ( -255.62, -297.00, 361.37 )
 - Reco X,Y,Z ( -253.45, -296.48, 361.48 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  14-Sep-2025 23:30:48 UTC run: 5092 subRun: 0 event: 168799
[32m-----------------------------------------------------------------------------------------
[0m
%MSG
Begin processing the 50th record. run: 5092 subRun: 0 event: 168800 at 14-Sep-2025 23:30:48 UTC
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  14-Sep-2025 23:30:48 UTC run: 5092 subRun: 0 event: 168800
[35m
#########################################
Event: 168800 Flag: 1153606385
Geometry: dune10kt_v6_1x2x6 (HD)
PDS Frequency in [MHz]: 62.50
PDS Tick in [us]: 0.016
TPC Frequency in [MHz]: 2.00
TPC Tick in [us]: 0.50
TPC Map: 25 TPCs found
TPC DriftLength in [cm]: 360.37
TPC DriftTime in [us]: 2244.44
Fiducial Volume in [cm]: 759.89, 1357.70, 1746.48
#########################################[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  14-Sep-2025 23:30:49 UTC run: 5092 subRun: 0 event: 168800
[91m
There are a total of 32857 Particles in the event

# of particles 12	from gen 1 marley
# of particles 10959	from gen 2 Ar39GenInLAr
# of particles 1266	from gen 3 Kr85GenInLAr
# of particles 0	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 11	from gen 6 Rn222ChainRn222GenInLAr
# of particles 16	from gen 7 Rn222ChainPo218GenInLAr
# of particles 15	from gen 8 Rn222ChainPb214GenInLAr
# of particles 2	from gen 9 Rn222ChainBi214GenInLAr
# of particles 9	from gen 10 Rn222ChainPb210GenInLAr
# of particles 9	from gen 11 Rn220ChainPb212GenInLAr
# of particles 15	from gen 12 K40GenInCPA
# of particles 203	from gen 13 U238ChainGenInCPA
# of particles 198	from gen 14 Th232ChainGenInCPA
# of particles 3	from gen 15 K42From42ArGenInCPA
# of particles 3	from gen 16 Rn222ChainPo218GenInCPA
# of particles 19	from gen 17 Rn222ChainPb214GenInCPA
# of particles 37	from gen 18 Rn222ChainBi214GenInCPA
# of particles 37	from gen 19 Rn222ChainPb210GenInCPA
# of particles 19	from gen 20 Rn222ChainFromBi210GenInCPA
# of particles 44	from gen 21 Rn220ChainFromPb212GenInCPA
# of particles 9	from gen 22 Co60GenInAPA
# of particles 4	from gen 23 U238ChainGenInAPA
# of particles 2	from gen 24 Th232ChainGenInAPA
# of particles 42	from gen 25 U238Th232K40GenInLArAPAboards1x2x6
# of particles 0	from gen 26 Rn222ChainGenInPDS
# of particles 19159	from gen 27 CavernwallGammasAtLAr1x2x6lowBgAPA
# of particles 764	from gen 28 foamGammasAtLAr1x2x6lowBgAPA
# of particles 0	from gen 29 CavernwallNeutronsAtLAr1x2x6lowBgAPA
# of particles 0	from gen 30 CryostatNGammasAtLAr1x2x6lowBgAPA
# of particles 0	from gen 31 CavernNGammasAtLAr1x2x6lowBgAPA[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  14-Sep-2025 23:30:49 UTC run: 5092 subRun: 0 event: 168800
[33m
Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 14.47 MeV
Position (258.43, 468.30, 779.51) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	22		1.46	(258.43, 468.30, 779.51)	32898	32847
marley	1000180400	0.00	(258.43, 468.30, 779.51)	32897	32847
marley	12		0.04	(258.43, 468.30, 779.51)	32896	32847
marley	11		0.00	(258.43, 468.30, 779.51)	32894	32847
marley	11		0.00	(258.43, 468.30, 779.51)	32893	32847
marley	11		0.00	(258.43, 468.30, 779.51)	32892	32847
marley	11		0.00	(258.43, 468.30, 779.51)	32891	32847
marley	22		0.03	(258.43, 468.30, 779.51)	32850	0
marley	22		1.61	(258.43, 468.30, 779.51)	32849	0
marley	22		0.65	(258.43, 468.30, 779.51)	32848	0
marley	1000190400	0.01	(258.43, 468.30, 779.51)	32847	0
marley	11		10.67	(258.43, 468.30, 779.51)	32846	0
Signal Track IDs: 32846; 32847; 32848; 32849; 32850; 32891; 32892; 32893; 32894; 32896; 32897; 32898; [0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  14-Sep-2025 23:30:53 UTC run: 5092 subRun: 0 event: 168800
[34mOpFlash PE 214.03 with purity 0.76 time 0.01 plane 1
 - Vertex (0.05, 421.42, 532.53)
	*** 1st Sanity check: Ratio 0.28 <= 1.00
	*** 2nd Sanity check: #OpHits 53 >= 53

# of OpFlashes (solarflash) in full geometry: 1585
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  14-Sep-2025 23:30:53 UTC run: 5092 subRun: 0 event: 168800
[36m
# OpHits (ophitspe) in full geometry: 72849
# OpFlashes (solarflash) in full geometry: 1585
# Hits (hitfd) in each view: 207, 220, 492, 0
# Cluster from the hits: 125, 132, 454, 0
# Tracks (pmtracktc) in full geometry: 2[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  14-Sep-2025 23:31:09 UTC run: 5092 subRun: 0 event: 168800
[32m
# ClusterReco: Looping over 298 matched clusters[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  14-Sep-2025 23:31:09 UTC run: 5092 subRun: 0 event: 168800
[32m*** Matched preselection cluster: 192
 - MainTrackID 32846
 - Gen 1 -> marley TPC 15
 - Purity 1.00 Hits 4
 - Charge 1271.10 ( MaxHit 588.82 )
 - #AdjCl 2 ( 1 signal ):
    - Cluster 193 at distance 60.64 with time 1606.86 and charge 81.61 in TPC 15 and hits 1
    - Cluster 196 at distance 21.00 with time 1610.80 and charge 93.79 in TPC 15 and hits 1
 - RecoCol  Time,Y,Z ( 1578.72, 467.52, 780.24 )
 - RecoInd0 Time,Y,Z ( 1578.72, 467.51, 786.33 )
 - RecoInd1 Time,Y,Z ( 1578.92, 467.53, 812.49 )
*** Matched flash: 
 - Purity 0.00 Plane 1 #Hits 79 PE 410.48 MaxPE 72.80
 - Time 4.11 Fast 0.69 Residual 4048.85
 - Reco Time,Y,Z ( 4.11, 412.33, 782.51 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 258.43, 468.30, 779.51 )
 - Main X,Y,Z ( 254.97, 467.67, 780.85 )
 - EDep X,Y,Z ( 254.98, 467.57, 780.81 )
 - Reco X,Y,Z ( 252.82, 467.52, 780.24 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  14-Sep-2025 23:31:09 UTC run: 5092 subRun: 0 event: 168800
[32m-----------------------------------------------------------------------------------------
[0m
%MSG
14-Sep-2025 23:31:09 UTC  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/36/c9/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250207T175132Z_gen_003376_supernova_g4_detsim_reco_20250723T185337Z_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          16.6719       22.0149       27.9976       22.1528       2.21088        50     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00136606    0.00698007     0.0378334    0.00187361    0.00856434       50     
end_path:solarnuana:SolarNuAna      16.6702       22.0077       27.9952       22.1466       2.21074        50     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 14-Sep-2025 23:31:09 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1552.48 MB
  Peak resident set size usage (VmHWM): 902.152 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 50 passed = 50 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         50         50          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1120.868022 Real = 1134.426965

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1552.48 VmHWM = 902.152

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0