Jobsub ID 272179.8@dunegpschedd01.fnal.gov

Jobsub ID	272179.8@dunegpschedd01.fnal.gov
Workflow ID	11565
Stage ID	1
User name	smanthey@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-07 02:07:09
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2026-01-07 02:22:26
From worker node	Hostname	dunegli-8104496-0-fnpc19135.fnal.gov
	cpuinfo	AMD EPYC 7502 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-07 02:08:30
Input files	fardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250205T103440Z_gen_000918_supernova_g4_detsim_reco_20250724T024509Z_reco2.root
Jobscript	Exit code	0
	Real time	13m (828s)
	CPU time	13m (811s = 97%)
	Max RSS bytes	899944448 (858 MiB)
Outputting started	2026-01-07 02:22:18
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dune10kt_1x2x6_centralAPA/fnal/11565/1/001/fdhd_ana_2026-01-07T_020837Z_hist.root
Finished	2026-01-07 02:22:26
Saved logs	justin-logs:272179.8-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

.50
TPC Map:		24 TPCs
TPC DriftLength in [cm]:360.37
TPC DriftTime in [us]:	2244.44
Fiducial Volume in [cm]:759.89, 1357.70, 1746.48
###################################################[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  07-Jan-2026 02:21:59 UTC run: 5064 subRun: 0 event: 45900
[91m
There are a total of 32823 Particles in the event

# of particles 7	from gen 1 marley
# of particles 10771	from gen 2 Ar39GenInLAr
# of particles 1284	from gen 3 Kr85GenInLAr
# of particles 1	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 9	from gen 6 Rn222ChainRn222GenInLAr
# of particles 9	from gen 7 Rn222ChainPo218GenInLAr
# of particles 19	from gen 8 Rn222ChainPb214GenInLAr
# of particles 14	from gen 9 Rn222ChainBi214GenInLAr
# of particles 10	from gen 10 Rn222ChainPb210GenInLAr
# of particles 4	from gen 11 Rn220ChainPb212GenInLAr
# of particles 12	from gen 12 K40GenInCPA
# of particles 207	from gen 13 U238ChainGenInCPA
# of particles 297	from gen 14 Th232ChainGenInCPA
# of particles 0	from gen 15 K42From42ArGenInCPA
# of particles 2	from gen 16 Rn222ChainPo218GenInCPA
# of particles 16	from gen 17 Rn222ChainPb214GenInCPA
# of particles 76	from gen 18 Rn222ChainBi214GenInCPA
# of particles 39	from gen 19 Rn222ChainPb210GenInCPA
# of particles 28	from gen 20 Rn222ChainFromBi210GenInCPA
# of particles 46	from gen 21 Rn220ChainFromPb212GenInCPA
# of particles 3	from gen 22 Co60GenInAPA
# of particles 0	from gen 23 U238ChainGenInAPA
# of particles 3	from gen 24 Th232ChainGenInAPA
# of particles 42	from gen 25 U238Th232K40GenInLArAPAboards1x2x6
# of particles 1	from gen 26 Rn222ChainGenInPDS
# of particles 19159	from gen 27 CavernwallGammasAtLAr1x2x6lowBgAPA
# of particles 764	from gen 28 foamGammasAtLAr1x2x6lowBgAPA
# of particles 0	from gen 29 CavernwallNeutronsAtLAr1x2x6lowBgAPA
# of particles 0	from gen 30 CryostatNGammasAtLAr1x2x6lowBgAPA
# of particles 0	from gen 31 CavernNGammasAtLAr1x2x6lowBgAPA[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  07-Jan-2026 02:21:59 UTC run: 5064 subRun: 0 event: 45900
[33m
Number of Signal Particles: 6
Neutrino Interaction: -1
Neutrino Energy: 15.84 MeV
Position (-145.58, -461.34, 807.24) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.91	(-145.58, -461.34, 807.24)	32875	32818
marley	-12		0.41	(-145.58, -461.34, 807.24)	32874	32818
marley	1000200400	0.00	(-145.58, -461.34, 807.24)	32873	32818
marley	22		2.75	(-145.58, -461.34, 807.24)	32820	0
marley	22		1.64	(-145.58, -461.34, 807.24)	32819	0
marley	1000190400	0.00	(-145.58, -461.34, 807.24)	32818	0
marley	11		9.95	(-145.58, -461.34, 807.24)	32817	0
Signal Track IDs: 32817; 32818; 32819; 32820; 32873; 32874; 32875; [0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  07-Jan-2026 02:21:59 UTC run: 5064 subRun: 0 event: 45900
[33m
Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  07-Jan-2026 02:22:04 UTC run: 5064 subRun: 0 event: 45900
[34mOpFlash PE 277.00 with purity 0.91 time -18.00 plane 0
 - Vertex (-0.05, -280.22, 1197.07)
	*** 1st Sanity check: Ratio 0.23 <= 1.00
	*** 2nd Sanity check: #OpHits 37 >= 37
OpFlash PE 46.31 with purity 1.00 time -17.24 plane 0
 - Vertex (-0.05, -401.86, 851.85)
	*** 1st Sanity check: Ratio 0.23 <= 1.00
	*** 2nd Sanity check: #OpHits 14 >= 14
OpFlash PE 38.72 with purity 1.00 time -16.70 plane 0
 - Vertex (-0.05, -481.57, 832.14)
	*** 1st Sanity check: Ratio 0.24 <= 1.00
	*** 2nd Sanity check: #OpHits 12 >= 12
OpFlash PE 3.54 with purity 0.73 time -16.51 plane 0
 - Vertex (0.00, 55.06, 626.99)
	*** 1st Sanity check: Ratio 0.55 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 34.14 with purity 1.00 time -16.30 plane 0
 - Vertex (-0.05, -461.28, 826.50)
	*** 1st Sanity check: Ratio 0.18 <= 1.00
	*** 2nd Sanity check: #OpHits 11 >= 11
OpFlash PE 14.10 with purity 1.00 time -15.91 plane 0
 - Vertex (-0.05, -416.90, 845.83)
	*** 1st Sanity check: Ratio 0.26 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 5.22 with purity 0.64 time -15.73 plane 0
 - Vertex (-0.01, -67.40, 1009.50)
	*** 1st Sanity check: Ratio 0.36 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 19.15 with purity 0.82 time -14.91 plane 0
 - Vertex (-0.05, -93.41, 892.69)
	*** 1st Sanity check: Ratio 0.54 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 5.92 with purity 1.00 time -14.47 plane 0
 - Vertex (-0.05, -544.23, 637.18)
	*** 1st Sanity check: Ratio 0.48 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 9.13 with purity 0.16 time -14.21 plane 0
 - Vertex (-0.05, -436.34, 1173.63)
	*** 1st Sanity check: Ratio 0.33 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 6.26 with purity 0.63 time -13.11 plane 0
 - Vertex (-0.05, -472.26, 1128.07)
	*** 1st Sanity check: Ratio 0.37 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 10.43 with purity 0.46 time -11.99 plane 0
 - Vertex (-0.05, -382.89, 1016.91)
	*** 1st Sanity check: Ratio 0.39 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 4.57 with purity 0.46 time -10.11 plane 0
 - Vertex (-0.05, -404.76, 1113.17)
	*** 1st Sanity check: Ratio 0.54 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 7.23 with purity 0.33 time -7.71 plane 0
 - Vertex (-0.05, -591.57, 548.70)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1

# of OpHits (ophitspe): 72139 for times between -2261.82 us and 2227.38 us.
# of OpFlashes (solarflash): 9706 for times between -2261.74 us and 2227.22 us.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  07-Jan-2026 02:22:04 UTC run: 5064 subRun: 0 event: 45900
[36m
# OpHits (ophitspe) in full geometry: 72139
# OpFlashes (solarflash) in full geometry: 9706
# Hits (hitfd) in each view: 189, 170, 445, 0
# Cluster from the hits: 125, 112, 413, 0
# Tracks (pmtracktc) in full geometry: 1[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  07-Jan-2026 02:22:18 UTC run: 5064 subRun: 0 event: 45900
[32m
# ClusterReco: Looping over 270 matched clusters[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  07-Jan-2026 02:22:18 UTC run: 5064 subRun: 0 event: 45900
[32m*** Matched preselection cluster: 103 from 270
 - MainTrackID 32817
 - Gen 1 -> marley TPC 12
 - Purity 1.00 Hits 3
 - Charge 1298.75 ( MaxHit 726.57 )
 - #AdjCl 2 ( 2 signal ):
    - Cluster 98 at distance 38.53 with time 803.73 and charge 70.39 in TPC 12 and hits 1
    - Cluster 101 at distance 20.54 with time 854.71 and charge 161.48 in TPC 12 and hits 2
 - RecoCol  Time,Y,Z ( 891.49, -463.48, 807.22 )
 - RecoInd0 Time,Y,Z ( 891.55, -463.49, 801.26 )
 - RecoInd1 Time,Y,Z ( 891.65, -463.47, 818.27 )
*** Matched flash: 4814 from 9706
 - Purity 100.00 % Plane 0 #Hits 14 PE 46.31 MainOpHitPE 10.82
 - Time -17.24 (us) Fast 29.40 % Residual 18.64
 - Reco Time,Y,Z ( -17.24, -401.86, 851.85 )
 - Found valid waveform: false
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -145.58, -461.34, 807.24 )
 - Main X,Y,Z ( -146.09, -464.27, 807.61 )
 - EDep X,Y,Z ( -145.61, -462.02, 807.01 )
 - Reco X,Y,Z ( -145.91, -463.48, 807.22 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  07-Jan-2026 02:22:18 UTC run: 5064 subRun: 0 event: 45900
[32m-----------------------------------------------------------------------------------------
[0m
%MSG
07-Jan-2026 02:22:18 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/72/29/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250205T103440Z_gen_000918_supernova_g4_detsim_reco_20250724T024509Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 07-Jan-2026 02:22:18 UTC  ModuleEndJob
[35mFinished running the SolarNuAna module[0m
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.216747       15.2149       49.5757      0.789113       17.8076        50     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00143484    0.00982745     0.0307852    0.00526537     0.0083176       50     
end_path:solarnuana:SolarNuAna     0.210887       15.2049        49.57       0.774473       17.8075        50     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 07-Jan-2026 02:22:18 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1549.95 MB
  Peak resident set size usage (VmHWM): 902.906 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 50 passed = 50 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         50         50          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 785.005026 Real = 797.293459

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1549.95 VmHWM = 902.967

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===