Jobsub ID 293856.0@dunegpschedd02.fnal.gov

Jobsub ID	293856.0@dunegpschedd02.fnal.gov
Workflow ID	12257
Stage ID	1
User name	smanthey@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-22 21:33:27
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2026-01-23 11:24:17
From worker node	Hostname	dunegli-8249188-0-fnpc22006.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-23 06:45:28
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250127T124138Z_gen_001947_supernova_g4stage1_g4stage2_detsim_reco_20250610T210736Z_reco2.root
Jobscript	Exit code	0
	Real time	4h (16713s)
	CPU time	4h (16578s = 99%)
	Max RSS bytes	2565201920 (2446 MiB)
Outputting started	2026-01-23 11:24:02
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/12257/1/001/fdhd_ana_2026-01-23T_064535Z_hist.root
Finished	2026-01-23 11:24:17
Saved logs	justin-logs:293856.0-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

1x8x14ref (VD)
Signal Label:		marley
PDS Frequency in [MHz]:	62.50
PDS Tick in [us]:	0.016
TPC Frequency in [MHz]:	2.00
TPC Tick in [us]:	0.50
TPC Map:		112 TPCs
TPC DriftLength in [cm]:650.07
TPC DriftTime in [us]:	4048.69
Fiducial Volume in [cm]:850.32, 1507.84, 2306.12
###################################################[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 10:47:40 UTC run: 4941 subRun: 0 event: 19470
[91m
There are a total of 132845 Particles in the event

# of particles 15	from gen 1 marley
# of particles 31244	from gen 2 Ar39GenInLAr
# of particles 3442	from gen 3 Kr85GenInLAr
# of particles 5	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 44	from gen 6 Rn222ChainRn222GenInLAr
# of particles 21	from gen 7 Rn222ChainPo218GenInLAr
# of particles 53	from gen 8 Rn222ChainPb214GenInLAr
# of particles 30	from gen 9 Rn222ChainBi214GenInLAr
# of particles 9	from gen 10 Rn222ChainPb210GenInLAr
# of particles 34	from gen 11 Rn220ChainPb212GenInLAr
# of particles 261	from gen 12 K40GenInCathode
# of particles 2917	from gen 13 U238ChainGenInCathode
# of particles 3707	from gen 14 Th232ChainGenInCathode
# of particles 95	from gen 15 K40GenInAnode
# of particles 1308	from gen 16 U238ChainGenInAnode
# of particles 1571	from gen 17 Th232ChainGenInAnode
# of particles 4	from gen 18 Rn222ChainGenInPDS
# of particles 3	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 3	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 22	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 53	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 67	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 39	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 37	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 13	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 10:47:40 UTC run: 4941 subRun: 0 event: 19470
[33m
Number of Signal Particles: 5
Neutrino Interaction: -1
Neutrino Energy: 18.25 MeV
Position (-108.09, 299.63, 1088.30) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.04	(506.25, 319.39, 1028.48)	132850	132847
marley	-12		0.12	(506.25, 319.39, 1028.48)	132849	132847
marley	1000060140	0.04	(506.25, 319.39, 1028.48)	132847	132820
marley	2212		0.58	(506.25, 319.39, 1028.48)	132846	132820
marley	2212		0.00	(442.55, 332.95, 918.98)	132828	132820
marley	2212		0.01	(441.99, 343.17, 913.74)	132827	132820
marley	2212		0.02	(433.62, 344.20, 889.57)	132826	132820
marley	1000260560	0.00	(425.18, 342.94, 887.67)	132825	132820
marley	1000060120	0.00	(429.55, 342.19, 887.39)	132824	132820
marley	2212		0.03	(432.73, 351.52, 872.42)	132823	132820
marley	2212		0.09	(429.99, 354.72, 869.45)	132822	132820
marley	1000180400	0.00	(173.43, 431.19, 885.81)	132821	132820
marley	2112		0.16	(-108.09, 299.63, 1088.30)	132820	0
marley	1000190390	0.00	(-108.09, 299.63, 1088.30)	132819	0
marley	11		8.78	(-108.09, 299.63, 1088.30)	132818	0
Signal Track IDs: 132818; 132819; 132820; 132821; 132822; 132823; 132824; 132825; 132826; 132827; 132828; 132846; 132847; 132849; 132850; [0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 10:47:40 UTC run: 4941 subRun: 0 event: 19470
[33m
Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 10:48:48 UTC run: 4941 subRun: 0 event: 19470
[34mOpFlash PE 14.72 with purity 0.17 time -1.34 plane 3
 - Vertex (210.07, 220.00, 2188.38)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 32.94 with purity 0.28 time -0.70 plane 0
 - Vertex (-327.50, -346.27, 1660.42)
	*** 1st Sanity check: Ratio 0.37 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 28.37 with purity 0.16 time 0.34 plane 0
 - Vertex (-327.50, -210.78, 522.05)
	*** 1st Sanity check: Ratio 0.34 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 302.57 with purity 0.02 time 0.26 plane 0
 - Vertex (-327.50, 268.34, 1028.39)
	*** 1st Sanity check: Ratio 0.12 <= 1.00
	*** 2nd Sanity check: #OpHits 25 >= 25

# of OpHits (ophit10ppm): 53122 for times between -4253.43 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 18311 for times between -4253.43 us and 295147919198126080.00 us.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 10:48:50 UTC run: 4941 subRun: 0 event: 19470
[36m
# OpHits (ophit10ppm) in full geometry: 53122
# OpFlashes (solarflash) in full geometry: 18311
# Hits (gaushit) in each view: 6752, 6724, 6634, 0
# Cluster from the hits: 2808, 2883, 5644, 0
# Tracks (pmtracktc) in full geometry: 466[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 11:24:01 UTC run: 4941 subRun: 0 event: 19470
[32m
# ClusterReco: Looping over 5623 matched clusters[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 11:24:01 UTC run: 4941 subRun: 0 event: 19470
[32m*** Matched preselection cluster: 3558 from 5623
 - MainTrackID 132818
 - Gen 1 -> marley TPC 61
 - Purity 1.00 Hits 6
 - Charge 961.05 ( MaxHit 229.90 )
 - #AdjCl 11 ( 0 signal ):
    - Cluster 2855 at distance 99.13 with time 2175.69 and charge 58.20 in TPC 61 and hits 1
    - Cluster 3364 at distance 79.47 with time 2559.80 and charge 41.25 in TPC 63 and hits 1
    - Cluster 3405 at distance 44.66 with time 2588.68 and charge 60.25 in TPC 63 and hits 2
    - Cluster 3479 at distance 89.99 with time 2637.63 and charge 33.70 in TPC 53 and hits 1
    - Cluster 3671 at distance 18.53 with time 2785.72 and charge 28.71 in TPC 59 and hits 1
    - Cluster 3672 at distance 32.62 with time 2786.23 and charge 42.39 in TPC 63 and hits 1
    - Cluster 3984 at distance 88.58 with time 3029.73 and charge 160.78 in TPC 53 and hits 3
    - Cluster 4009 at distance 65.02 with time 3050.10 and charge 53.13 in TPC 59 and hits 2
    - Cluster 4040 at distance 65.12 with time 3073.53 and charge 33.84 in TPC 63 and hits 1
    - Cluster 4260 at distance 85.73 with time 3227.50 and charge 50.08 in TPC 61 and hits 1
    - Cluster 4264 at distance 91.08 with time 3228.80 and charge 44.55 in TPC 61 and hits 1
 - RecoCol  Time,Y,Z ( 2700.42, 298.35, 1089.37 )
 - RecoInd0 Time,Y,Z ( 2700.40, 298.38, 1120.40 )
 - RecoInd1 Time,Y,Z ( 2700.39, 298.32, 1100.26 )
*** Matched flash: 8640 from 18311
 - Purity 0.00 % Plane 0 #Hits 12
 - MainOpHitPE 107.68 (PE);  TotalPE 302.75 vs expected 297.62 (PE)
 - Time -270.35 (us) Fast 41.81 % Residual 3397.13
 - Reco Time,Y,Z ( -270.35, 293.40, 1004.94 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -108.09, 299.63, 1088.30 )
 - Main X,Y,Z ( -108.46, 297.94, 1090.51 )
 - EDep X,Y,Z ( -108.59, 298.11, 1089.43 )
 - Reco X,Y,Z ( -151.96, 298.35, 1089.37 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 11:24:01 UTC run: 4941 subRun: 0 event: 19470
[32m-----------------------------------------------------------------------------------------
[0m
%MSG
23-Jan-2026 11:24:01 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/82/bb/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250127T124138Z_gen_001947_supernova_g4stage1_g4stage2_detsim_reco_20250610T210736Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 23-Jan-2026 11:24:01 UTC  ModuleEndJob
[35mFinished running the SolarNuAna module[0m
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.668026       1667.18       2987.3        2205.86       1141.06        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000809029   0.00917605     0.0206537    0.00739331    0.00730374       10     
end_path:solarnuana:SolarNuAna     0.651356       1667.17       2987.3        2205.85       1141.06        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 23-Jan-2026 11:24:01 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3190.26 MB
  Peak resident set size usage (VmHWM): 2565.2 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 16564.966769 Real = 16697.938220

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3190.26 VmHWM = 2565.2

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===