Jobsub ID 255676.31@dunegpschedd01.fnal.gov

Jobsub ID	255676.31@dunegpschedd01.fnal.gov
Workflow ID	10532
Stage ID	1
User name	smanthey@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-23 13:40:54
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2025-11-23 14:13:11
From worker node	Hostname	dunegli-7706436-0-fnpc18009.fnal.gov
	cpuinfo	AMD EPYC 7551 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-23 13:41:37
Input files	fardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250208T110704Z_gen_000801_supernova_g4_detsim_reco_20250724T031233Z_reco2.root
Jobscript	Exit code	0
	Real time	31m (1871s)
	CPU time	30m (1833s = 97%)
	Max RSS bytes	910794752 (868 MiB)
Outputting started	2025-11-23 14:12:49
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dune10kt_1x2x6_centralAPA/fnal/10532/1/001/fdhd_ana_2025-11-23T_134150Z_hist.root
Finished	2025-11-23 14:13:11
Saved logs	justin-logs:255676.31-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

n: 5097 subRun: 0 event: 40049
[31mInvalid OpWaveform handle[0m
%MSG
%MSG-e ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 14:11:58 UTC run: 5097 subRun: 0 event: 40049
[31mInvalid OpWaveform handle[0m
%MSG
%MSG-e ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 14:11:58 UTC run: 5097 subRun: 0 event: 40049
[31mInvalid OpWaveform handle[0m
%MSG
%MSG-e ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 14:11:58 UTC run: 5097 subRun: 0 event: 40049
[31mInvalid OpWaveform handle[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 14:11:58 UTC run: 5097 subRun: 0 event: 40049
[34mOpFlash PE 65.59 with purity 0.48 time -28.27 plane 0
 - Vertex (-0.05, -404.76, 892.69)
	*** 1st Sanity check: Ratio 0.96 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 227.56 with purity 0.82 time -17.98 plane 0
 - Vertex (-0.05, -163.45, 543.70)
	*** 1st Sanity check: Ratio 0.28 <= 1.00
	*** 2nd Sanity check: #OpHits 32 >= 32
OpFlash PE 91.62 with purity 0.66 time -16.58 plane 0
 - Vertex (0.00, -8.43, 488.86)
	*** 1st Sanity check: Ratio 0.26 <= 1.00
	*** 2nd Sanity check: #OpHits 23 >= 23
OpFlash PE 11.06 with purity 0.39 time -15.21 plane 0
 - Vertex (-0.05, -94.59, 840.24)
	*** 1st Sanity check: Ratio 0.27 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 27.85 with purity 0.55 time -14.73 plane 0
 - Vertex (-0.05, -118.31, 374.56)
	*** 1st Sanity check: Ratio 0.28 <= 1.00
	*** 2nd Sanity check: #OpHits 9 >= 9
OpFlash PE 8.09 with purity 0.61 time -13.10 plane 0
 - Vertex (-0.05, -154.60, 636.70)
	*** 1st Sanity check: Ratio 0.61 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 47.08 with purity 0.18 time -4.31 plane 0
 - Vertex (0.05, 280.22, 617.46)
	*** 1st Sanity check: Ratio 0.72 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3

# of OpHits (ophitspe): 71275 for times between -2261.79 us and 2227.71 us.
# of OpFlashes (solarflash): 5132 for times between -2261.74 us and 2227.62 us.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 14:11:58 UTC run: 5097 subRun: 0 event: 40049
[36m
# OpHits (ophitspe) in full geometry: 71275
# OpFlashes (solarflash) in full geometry: 5132
# Hits (hitfd) in each view: 185, 178, 431, 0
# Cluster from the hits: 118, 117, 403, 0
# Tracks (pmtracktc) in full geometry: 0[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 14:12:47 UTC run: 5097 subRun: 0 event: 40049
[32m
# ClusterReco: Looping over 251 matched clusters[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 14:12:47 UTC run: 5097 subRun: 0 event: 40049
[32m*** Matched preselection cluster: 22 from 251
 - MainTrackID 33094
 - Gen 1 -> marley TPC 8
 - Purity 1.00 Hits 1
 - Charge 183.44 ( MaxHit 183.44 )
 - #AdjCl 1 ( 1 signal ):
    - Cluster 14 at distance 29.44 with time 165.41 and charge 163.94 in TPC 8 and hits 1
 - RecoCol  Time,Y,Z ( 236.98, -126.66, 534.35 )
 - RecoInd0 Time,Y,Z ( 237.02, -126.56, 580.10 )
 - RecoInd1 Time,Y,Z ( 236.96, -126.76, 544.81 )
*** Matched flash: 2597 from 5132
 - Purity 82.39 % Plane 0 #Hits 32 PE 227.56 MainOpHitPE 63.80
 - Time -17.98 (us) Fast 74.35 % Residual 145.17
 - Reco Time,Y,Z ( -17.98, -163.45, 543.70 )
 - Found valid waveform: false
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -41.18, -126.59, 534.53 )
 - Main X,Y,Z ( -41.00, -126.69, 534.34 )
 - EDep X,Y,Z ( -41.04, -126.71, 534.42 )
 - Reco X,Y,Z ( -40.94, -126.66, 534.35 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 14:12:47 UTC run: 5097 subRun: 0 event: 40049
[32m-----------------------------------------------------------------------------------------
[0m
%MSG
Begin processing the 50th record. run: 5097 subRun: 0 event: 40050 at 23-Nov-2025 14:12:47 UTC
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 14:12:48 UTC run: 5097 subRun: 0 event: 40050
[35m
###################################################
Event:			40050
Flag:			1742958436
Geometry:		dune10kt_v6_1x2x6 (HD)
Signal Label:		marley
PDS Frequency in [MHz]:	62.50
PDS Tick in [us]:	0.016
TPC Frequency in [MHz]:	2.00
TPC Tick in [us]:	0.50
TPC Map:		24 TPCs
TPC DriftLength in [cm]:360.37
TPC DriftTime in [us]:	2244.44
Fiducial Volume in [cm]:759.89, 1357.70, 1746.48
###################################################[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 14:12:49 UTC run: 5097 subRun: 0 event: 40050
[91m
There are a total of 33019 Particles in the event

# of particles 12	from gen 1 marley
# of particles 11007	from gen 2 Ar39GenInLAr
# of particles 1223	from gen 3 Kr85GenInLAr
# of particles 0	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 13	from gen 6 Rn222ChainRn222GenInLAr
# of particles 11	from gen 7 Rn222ChainPo218GenInLAr
# of particles 18	from gen 8 Rn222ChainPb214GenInLAr
# of particles 8	from gen 9 Rn222ChainBi214GenInLAr
# of particles 6	from gen 10 Rn222ChainPb210GenInLAr
# of particles 20	from gen 11 Rn220ChainPb212GenInLAr
# of particles 19	from gen 12 K40GenInCPA
# of particles 260	from gen 13 U238ChainGenInCPA
# of particles 271	from gen 14 Th232ChainGenInCPA
# of particles 0	from gen 15 K42From42ArGenInCPA
# of particles 0	from gen 16 Rn222ChainPo218GenInCPA
# of particles 16	from gen 17 Rn222ChainPb214GenInCPA
# of particles 40	from gen 18 Rn222ChainBi214GenInCPA
# of particles 30	from gen 19 Rn222ChainPb210GenInCPA
# of particles 23	from gen 20 Rn222ChainFromBi210GenInCPA
# of particles 72	from gen 21 Rn220ChainFromPb212GenInCPA
# of particles 0	from gen 22 Co60GenInAPA
# of particles 2	from gen 23 U238ChainGenInAPA
# of particles 2	from gen 24 Th232ChainGenInAPA
# of particles 42	from gen 25 U238Th232K40GenInLArAPAboards1x2x6
# of particles 1	from gen 26 Rn222ChainGenInPDS
# of particles 19159	from gen 27 CavernwallGammasAtLAr1x2x6lowBgAPA
# of particles 764	from gen 28 foamGammasAtLAr1x2x6lowBgAPA
# of particles 0	from gen 29 CavernwallNeutronsAtLAr1x2x6lowBgAPA
# of particles 0	from gen 30 CryostatNGammasAtLAr1x2x6lowBgAPA
# of particles 0	from gen 31 CavernNGammasAtLAr1x2x6lowBgAPA[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 14:12:49 UTC run: 5097 subRun: 0 event: 40050
[33m
Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 38.67 MeV
Position (44.43, 428.82, 265.52) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	22		1.46	(44.43, 428.82, 265.52)	33068	33009
marley	1000180400	0.00	(44.43, 428.82, 265.52)	33067	33009
marley	12		0.04	(44.43, 428.82, 265.52)	33066	33009
marley	11		0.00	(44.43, 428.82, 265.52)	33064	33009
marley	11		0.00	(44.43, 428.82, 265.52)	33063	33009
marley	11		0.00	(44.43, 428.82, 265.52)	33062	33009
marley	11		0.00	(44.43, 428.82, 265.52)	33061	33009
marley	22		0.03	(44.43, 428.82, 265.52)	33012	0
marley	22		1.61	(44.43, 428.82, 265.52)	33011	0
marley	22		0.65	(44.43, 428.82, 265.52)	33010	0
marley	1000190400	0.02	(44.43, 428.82, 265.52)	33009	0
marley	11		34.86	(44.43, 428.82, 265.52)	33008	0
Signal Track IDs: 33008; 33009; 33010; 33011; 33012; 33061; 33062; 33063; 33064; 33066; 33067; 33068; [0m
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 14:12:49 UTC run: 5097 subRun: 0 event: 40050
[31m
Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.
[0m
%MSG
23-Nov-2025 14:12:49 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/94/95/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250208T110704Z_gen_000801_supernova_g4_detsim_reco_20250724T031233Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 23-Nov-2025 14:12:49 UTC  ModuleEndJob
[35mFinished running the SolarNuAna module[0m
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.331575       35.4668       87.3693        50.85        34.2699        50     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00213007    0.00896773     0.0279631    0.00400421    0.00783693       50     
end_path:solarnuana:SolarNuAna     0.328449       35.4575       87.3666       50.8391       34.2701        50     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 23-Nov-2025 14:12:49 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1551.06 MB
  Peak resident set size usage (VmHWM): 903.143 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 50 passed = 50 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         50         50          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1791.345556 Real = 1826.021955

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1551.06 VmHWM = 903.143

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0