Jobsub ID 300674.0@dunegpschedd01.fnal.gov

Jobsub ID	300674.0@dunegpschedd01.fnal.gov
Workflow ID	12375
Stage ID	1
User name	smanthey@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-25 13:34:52
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2026-01-25 18:22:12
From worker node	Hostname	dunegli-8272724-0-fnpc19122.fnal.gov
	cpuinfo	AMD EPYC 7502 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-25 13:35:05
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T224509Z_gen_004641_supernova_g4stage1_g4stage2_detsim_reco_20250728T210218Z_reco2.root
Jobscript	Exit code	0
	Real time	4h (17216s)
	CPU time	4h (17067s = 99%)
	Max RSS bytes	2561449984 (2442 MiB)
Outputting started	2026-01-25 18:22:01
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/12375/1/001/fdhd_ana_2026-01-25T_133524Z_hist.root
Finished	2026-01-25 18:22:12
Saved logs	justin-logs:300674.0-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

rnuana@BeginModule  25-Jan-2026 17:39:04 UTC run: 5052 subRun: 0 event: 46410
[91m
There are a total of 132659 Particles in the event

# of particles 12	from gen 1 marley
# of particles 31108	from gen 2 Ar39GenInLAr
# of particles 3551	from gen 3 Kr85GenInLAr
# of particles 2	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 32	from gen 6 Rn222ChainRn222GenInLAr
# of particles 19	from gen 7 Rn222ChainPo218GenInLAr
# of particles 62	from gen 8 Rn222ChainPb214GenInLAr
# of particles 41	from gen 9 Rn222ChainBi214GenInLAr
# of particles 12	from gen 10 Rn222ChainPb210GenInLAr
# of particles 21	from gen 11 Rn220ChainPb212GenInLAr
# of particles 188	from gen 12 K40GenInCathode
# of particles 2949	from gen 13 U238ChainGenInCathode
# of particles 3597	from gen 14 Th232ChainGenInCathode
# of particles 87	from gen 15 K40GenInAnode
# of particles 1335	from gen 16 U238ChainGenInAnode
# of particles 1571	from gen 17 Th232ChainGenInAnode
# of particles 2	from gen 18 Rn222ChainGenInPDS
# of particles 2	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 1	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 16	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 49	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 33	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 50	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 57	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 14	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 17:39:04 UTC run: 5052 subRun: 0 event: 46410
[33m
Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 20.01 MeV
Position (191.63, 92.00, 645.29) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	22		1.46	(191.63, 92.00, 645.29)	132713	132636
marley	1000180400	0.00	(191.63, 92.00, 645.29)	132712	132636
marley	12		0.04	(191.63, 92.00, 645.29)	132711	132636
marley	11		0.00	(191.63, 92.00, 645.29)	132709	132636
marley	11		0.00	(191.63, 92.00, 645.29)	132708	132636
marley	11		0.00	(191.63, 92.00, 645.29)	132707	132636
marley	11		0.00	(191.63, 92.00, 645.29)	132706	132636
marley	22		0.03	(191.63, 92.00, 645.29)	132639	0
marley	22		0.77	(191.63, 92.00, 645.29)	132638	0
marley	22		3.04	(191.63, 92.00, 645.29)	132637	0
marley	1000190400	0.01	(191.63, 92.00, 645.29)	132636	0
marley	11		14.66	(191.63, 92.00, 645.29)	132635	0
Signal Track IDs: 132635; 132636; 132637; 132638; 132639; 132706; 132707; 132708; 132709; 132711; 132712; 132713; [0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 17:39:04 UTC run: 5052 subRun: 0 event: 46410
[33m
Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 17:40:09 UTC run: 5052 subRun: 0 event: 46410
[34mOpFlash PE 21.48 with purity 0.27 time -0.98 plane 1
 - Vertex (165.18, 743.30, 212.21)
	*** 1st Sanity check: Ratio 0.40 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 5.65 with purity 1.00 time -0.10 plane 4
 - Vertex (210.07, 220.00, -96.50)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 62.30 with purity 0.04 time 0.95 plane 0
 - Vertex (-327.50, -372.28, 1507.66)
	*** 1st Sanity check: Ratio 0.18 <= 1.00
	*** 2nd Sanity check: #OpHits 8 >= 8
OpFlash PE 112.73 with purity 0.46 time 0.60 plane 0
 - Vertex (-327.50, -137.81, 774.34)
	*** 1st Sanity check: Ratio 0.17 <= 1.00
	*** 2nd Sanity check: #OpHits 14 >= 14
OpFlash PE 92.79 with purity 0.03 time 0.69 plane 0
 - Vertex (-327.50, 210.11, 1475.63)
	*** 1st Sanity check: Ratio 0.19 <= 1.00
	*** 2nd Sanity check: #OpHits 12 >= 12
OpFlash PE 68.21 with purity 0.15 time 1.02 plane 1
 - Vertex (78.53, 743.30, 1125.48)
	*** 1st Sanity check: Ratio 0.18 <= 1.00
	*** 2nd Sanity check: #OpHits 9 >= 9
OpFlash PE 91.59 with purity 0.53 time 0.75 plane 0
 - Vertex (-327.50, -36.98, 283.97)
	*** 1st Sanity check: Ratio 0.14 <= 1.00
	*** 2nd Sanity check: #OpHits 12 >= 12
OpFlash PE 39.59 with purity 0.16 time 1.65 plane 1
 - Vertex (173.08, 743.30, 639.93)
	*** 1st Sanity check: Ratio 0.23 <= 1.00
	*** 2nd Sanity check: #OpHits 6 >= 6

# of OpHits (ophit10ppm): 52038 for times between -4254.49 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 18078 for times between -4254.46 us and 295147919198126080.00 us.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 17:40:12 UTC run: 5052 subRun: 0 event: 46410
[36m
# OpHits (ophit10ppm) in full geometry: 52038
# OpFlashes (solarflash) in full geometry: 18078
# Hits (gaushit) in each view: 6681, 6585, 6538, 0
# Cluster from the hits: 2782, 2797, 5573, 0
# Tracks (pmtracktc) in full geometry: 473[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 18:22:00 UTC run: 5052 subRun: 0 event: 46410
[32m
# ClusterReco: Looping over 5556 matched clusters[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 18:22:00 UTC run: 5052 subRun: 0 event: 46410
[32m*** Matched preselection cluster: 1026 from 5556
 - MainTrackID 132635
 - Gen 1 -> marley TPC 36
 - Purity 1.00 Hits 9
 - Charge 1380.43 ( MaxHit 274.85 )
 - #AdjCl 11 ( 4 signal ):
    - Cluster 444 at distance 80.96 with time 385.31 and charge 36.79 in TPC 32 and hits 1
    - Cluster 549 at distance 94.73 with time 468.62 and charge 50.91 in TPC 38 and hits 2
    - Cluster 551 at distance 86.77 with time 468.96 and charge 164.39 in TPC 28 and hits 2
    - Cluster 558 at distance 98.19 with time 474.61 and charge 39.50 in TPC 34 and hits 1
    - Cluster 640 at distance 80.49 with time 539.81 and charge 109.01 in TPC 36 and hits 1
    - Cluster 896 at distance 49.28 with time 741.97 and charge 134.92 in TPC 36 and hits 1
    - Cluster 939 at distance 56.89 with time 780.73 and charge 53.24 in TPC 26 and hits 2
    - Cluster 1077 at distance 6.91 with time 873.69 and charge 108.10 in TPC 36 and hits 1
    - Cluster 1234 at distance 27.23 with time 984.70 and charge 341.29 in TPC 36 and hits 2
    - Cluster 1260 at distance 28.59 with time 1004.79 and charge 128.50 in TPC 36 and hits 2
    - Cluster 1413 at distance 49.03 with time 1134.38 and charge 22.30 in TPC 36 and hits 1
 - RecoCol  Time,Y,Z ( 845.91, 92.63, 644.43 )
 - RecoInd0 Time,Y,Z ( 845.35, 92.55, 672.64 )
 - RecoInd1 Time,Y,Z ( 846.29, 92.71, 672.64 )
*** Matched flash: 9065 from 18078
 - Purity 0.00 % Plane 0 #Hits 9
 - MainOpHitPE 12.46 (PE);  TotalPE 75.60 vs expected 64.25 (PE)
 - Time 12.91 (us) Fast 17.81 % Residual 50.50
 - Reco Time,Y,Z ( 12.91, 134.44, 576.51 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 191.63, 92.00, 645.29 )
 - Main X,Y,Z ( 187.27, 93.01, 643.66 )
 - EDep X,Y,Z ( 187.33, 93.05, 643.67 )
 - Reco X,Y,Z ( 191.29, 92.63, 644.43 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 18:22:00 UTC run: 5052 subRun: 0 event: 46410
[32m-----------------------------------------------------------------------------------------
[0m
%MSG
25-Jan-2026 18:22:00 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/24/e1/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T224509Z_gen_004641_supernova_g4stage1_g4stage2_detsim_reco_20250728T210218Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 25-Jan-2026 18:22:00 UTC  ModuleEndJob
[35mFinished running the SolarNuAna module[0m
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.932239       1715.1        3251.03       2569.61       1417.2         10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00106932     0.0117363     0.0529523    0.00781133     0.014683        10     
end_path:solarnuana:SolarNuAna     0.919598       1715.09       3251.02       2569.61       1417.21        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 25-Jan-2026 18:22:00 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3186.86 MB
  Peak resident set size usage (VmHWM): 2561.45 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 17050.269917 Real = 17186.209571

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3186.86 VmHWM = 2561.45

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===