Jobsub ID 255167.0@dunegpschedd02.fnal.gov

Jobsub ID	255167.0@dunegpschedd02.fnal.gov
Workflow ID	10895
Stage ID	1
User name	smanthey@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-29 08:02:53
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2025-11-29 14:36:53
From worker node	Hostname	dunegli-7772774-0-fnpc18009.fnal.gov
	cpuinfo	AMD EPYC 7551 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-29 08:04:15
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T221816Z_gen_003039_supernova_g4stage1_g4stage2_detsim_reco_20250701T144703Z_reco2.root
Jobscript	Exit code	0
	Real time	6h (23513s)
	CPU time	6h (23262s = 98%)
	Max RSS bytes	2559344640 (2440 MiB)
Outputting started	2025-11-29 14:36:09
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/10895/1/001/fdhd_ana_2025-11-29T_080442Z_hist.root
Finished	2025-11-29 14:36:53
Saved logs	justin-logs:255167.0-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

57	from gen 9 Rn222ChainBi214GenInLAr
# of particles 30	from gen 10 Rn222ChainPb210GenInLAr
# of particles 47	from gen 11 Rn220ChainPb212GenInLAr
# of particles 242	from gen 12 K40GenInCathode
# of particles 3174	from gen 13 U238ChainGenInCathode
# of particles 3651	from gen 14 Th232ChainGenInCathode
# of particles 104	from gen 15 K40GenInAnode
# of particles 1352	from gen 16 U238ChainGenInAnode
# of particles 1594	from gen 17 Th232ChainGenInAnode
# of particles 2	from gen 18 Rn222ChainGenInPDS
# of particles 3	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 2	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 9	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 62	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 24	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 55	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 48	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 8	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  29-Nov-2025 13:07:19 UTC run: 5038 subRun: 0 event: 30390
[33m
Number of Signal Particles: 8
Neutrino Interaction: -1
Neutrino Energy: 14.14 MeV
Position (-39.47, -79.85, 1000.43) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.61	(-39.47, -79.85, 1000.43)	133185	133131
marley	-12		0.70	(-39.47, -79.85, 1000.43)	133184	133131
marley	1000200400	0.00	(-39.47, -79.85, 1000.43)	133183	133131
marley	22		0.03	(-39.47, -79.85, 1000.43)	133135	0
marley	22		0.77	(-39.47, -79.85, 1000.43)	133134	0
marley	22		1.49	(-39.47, -79.85, 1000.43)	133133	0
marley	22		2.09	(-39.47, -79.85, 1000.43)	133132	0
marley	1000190400	0.00	(-39.47, -79.85, 1000.43)	133131	0
marley	11		8.25	(-39.47, -79.85, 1000.43)	133130	0
Signal Track IDs: 133130; 133131; 133132; 133133; 133134; 133135; 133183; 133184; 133185; [0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  29-Nov-2025 13:07:19 UTC run: 5038 subRun: 0 event: 30390
[33m
Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  29-Nov-2025 13:08:52 UTC run: 5038 subRun: 0 event: 30390
[34mOpFlash PE 3946.54 with purity 0.28 time 0.25 plane 2
 - Vertex (231.67, -743.30, 662.33)
	*** 1st Sanity check: Ratio 0.24 <= 1.00
	*** 2nd Sanity check: #OpHits 23 >= 23
OpFlash PE 261.79 with purity 0.27 time 0.56 plane 0
 - Vertex (-327.50, -50.93, 936.95)
	*** 1st Sanity check: Ratio 0.10 <= 1.00
	*** 2nd Sanity check: #OpHits 28 >= 28
OpFlash PE 10.56 with purity 0.31 time 2.98 plane 3
 - Vertex (106.83, -220.00, 2188.38)
	*** 1st Sanity check: Ratio 0.62 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 79.50 with purity 0.08 time 3.99 plane 0
 - Vertex (-327.50, -380.84, 1545.42)
	*** 1st Sanity check: Ratio 0.26 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7

# of OpHits (ophit10ppm): 53667 for times between -4254.46 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 12437 for times between -4254.46 us and 295147919198126080.00 us.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  29-Nov-2025 13:08:55 UTC run: 5038 subRun: 0 event: 30390
[36m
# OpHits (ophit10ppm) in full geometry: 53667
# OpFlashes (solarflash) in full geometry: 12437
# Hits (gaushit) in each view: 6615, 6636, 6628, 0
# Cluster from the hits: 2752, 2855, 5656, 0
# Tracks (pmtracktc) in full geometry: 432[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  29-Nov-2025 14:36:07 UTC run: 5038 subRun: 0 event: 30390
[32m
# ClusterReco: Looping over 5643 matched clusters[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  29-Nov-2025 14:36:07 UTC run: 5038 subRun: 0 event: 30390
[32m*** Matched preselection cluster: 3050 from 5643
 - MainTrackID 133130
 - Gen 1 -> marley TPC 51
 - Purity 1.00 Hits 8
 - Charge 1068.99 ( MaxHit 302.36 )
 - #AdjCl 12 ( 1 signal ):
    - Cluster 2538 at distance 73.11 with time 1900.77 and charge 46.55 in TPC 51 and hits 1
    - Cluster 2796 at distance 96.16 with time 2094.78 and charge 37.95 in TPC 53 and hits 1
    - Cluster 2859 at distance 37.64 with time 2136.88 and charge 27.74 in TPC 51 and hits 1
    - Cluster 2880 at distance 99.91 with time 2150.72 and charge 40.53 in TPC 49 and hits 1
    - Cluster 2888 at distance 94.73 with time 2153.76 and charge 31.68 in TPC 49 and hits 1
    - Cluster 2896 at distance 76.93 with time 2158.81 and charge 27.66 in TPC 59 and hits 1
    - Cluster 2954 at distance 51.72 with time 2216.01 and charge 41.81 in TPC 49 and hits 1
    - Cluster 2991 at distance 12.21 with time 2243.93 and charge 51.19 in TPC 51 and hits 2
    - Cluster 3100 at distance 38.49 with time 2312.09 and charge 133.65 in TPC 51 and hits 1
    - Cluster 3105 at distance 53.42 with time 2315.83 and charge 136.64 in TPC 51 and hits 2
    - Cluster 3143 at distance 89.34 with time 2345.50 and charge 54.79 in TPC 61 and hits 1
    - Cluster 3554 at distance 88.30 with time 2648.64 and charge 319.42 in TPC 51 and hits 2
 - RecoCol  Time,Y,Z ( 2276.11, -79.95, 1000.21 )
 - RecoInd0 Time,Y,Z ( 2278.31, -79.88, 971.48 )
 - RecoInd1 Time,Y,Z ( 2278.38, -80.03, 971.48 )
*** Matched flash: 4970 from 12437
 - Purity 0.00 % Plane 0 #Hits 27 PE 949.36 MainOpHitPE 229.95
 - Time -881.65 (us) Fast 68.92 % Residual 12752.12
 - Reco Time,Y,Z ( -881.65, -155.41, 935.98 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -39.47, -79.85, 1000.43 )
 - Main X,Y,Z ( -41.16, -79.11, 1000.25 )
 - EDep X,Y,Z ( -41.13, -79.54, 1000.43 )
 - Reco X,Y,Z ( -181.98, -79.95, 1000.21 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  29-Nov-2025 14:36:07 UTC run: 5038 subRun: 0 event: 30390
[32m*** Matched preselection cluster: 3101 from 5643
 - MainTrackID 133133
 - Gen 1 -> marley TPC 51
 - Purity 1.00 Hits 2
 - Charge 101.22 ( MaxHit 53.65 )
 - #AdjCl 4 ( 0 signal ):
    - Cluster 2417 at distance 81.95 with time 1817.12 and charge 49.25 in TPC 51 and hits 1
    - Cluster 3162 at distance 7.54 with time 2357.60 and charge 29.25 in TPC 49 and hits 1
    - Cluster 3484 at distance 84.67 with time 2607.13 and charge 28.71 in TPC 49 and hits 1
    - Cluster 3653 at distance 82.58 with time 2734.29 and charge 100.08 in TPC 49 and hits 2
 - RecoCol  Time,Y,Z ( 2312.17, -312.38, 1001.55 )
 - RecoInd0 Time,Y,Z ( 2310.74, -594.90, 796.19 )
 - RecoInd1 Time,Y,Z ( 2312.06, -29.86, 971.48 )
*** Matched flash: 9179 from 12437
 - Purity 0.00 % Plane 0 #Hits 28 PE 8208.87 MainOpHitPE 2639.50
 - Time 2023.38 (us) Fast 64.45 % Residual 2494192.00
 - Reco Time,Y,Z ( 2023.38, -377.40, 1004.94 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -39.47, -79.85, 1000.43 )
 - Main X,Y,Z ( -31.23, -70.44, 995.80 )
 - EDep X,Y,Z ( -41.14, -79.33, 1000.45 )
 - Reco X,Y,Z ( 278.67, -312.38, 1001.55 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  29-Nov-2025 14:36:07 UTC run: 5038 subRun: 0 event: 30390
[32m-----------------------------------------------------------------------------------------
[0m
%MSG
29-Nov-2025 14:36:08 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/36/13/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T221816Z_gen_003039_supernova_g4stage1_g4stage2_detsim_reco_20250701T144703Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 29-Nov-2025 14:36:08 UTC  ModuleEndJob
[35mFinished running the SolarNuAna module[0m
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          1.18311       2340.66       6311.95       3.54165       2874.29        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00131414    0.00796165     0.0182532     0.0058315    0.00659733       10     
end_path:solarnuana:SolarNuAna      1.18118       2340.65       6311.95       3.52631       2874.3         10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 29-Nov-2025 14:36:08 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3182.84 MB
  Peak resident set size usage (VmHWM): 2559.34 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 23222.885583 Real = 23457.527142

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3182.84 VmHWM = 2559.34

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===