Jobsub ID 255304.0@dunegpschedd02.fnal.gov

Jobsub ID	255304.0@dunegpschedd02.fnal.gov
Workflow ID	10893
Stage ID	1
User name	smanthey@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-11-29 18:05:26
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2025-11-30 05:48:00
From worker node	Hostname	dunegli-7772648-0-fnpc18002.fnal.gov
	cpuinfo	AMD EPYC 7551 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-29 18:06:51
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T135423Z_gen_002384_supernova_g4stage1_g4stage2_detsim_reco_20250611T054532Z_reco2.root
Jobscript	Exit code	0
	Real time	11h (42045s)
	CPU time	11h (41952s = 99%)
	Max RSS bytes	2552348672 (2434 MiB)
Outputting started	2025-11-30 05:47:36
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/10893/1/001/fdhd_ana_2025-11-29T_180727Z_hist.root
Finished	2025-11-30 05:48:00
Saved logs	justin-logs:255304.0-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

arNuAna:solarnuana@BeginModule  30-Nov-2025 04:37:37 UTC run: 4966 subRun: 0 event: 23840
[91m
There are a total of 132654 Particles in the event

# of particles 9	from gen 1 marley
# of particles 31096	from gen 2 Ar39GenInLAr
# of particles 3593	from gen 3 Kr85GenInLAr
# of particles 1	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 26	from gen 6 Rn222ChainRn222GenInLAr
# of particles 21	from gen 7 Rn222ChainPo218GenInLAr
# of particles 41	from gen 8 Rn222ChainPb214GenInLAr
# of particles 39	from gen 9 Rn222ChainBi214GenInLAr
# of particles 6	from gen 10 Rn222ChainPb210GenInLAr
# of particles 26	from gen 11 Rn220ChainPb212GenInLAr
# of particles 209	from gen 12 K40GenInCathode
# of particles 2923	from gen 13 U238ChainGenInCathode
# of particles 3529	from gen 14 Th232ChainGenInCathode
# of particles 96	from gen 15 K40GenInAnode
# of particles 1372	from gen 16 U238ChainGenInAnode
# of particles 1559	from gen 17 Th232ChainGenInAnode
# of particles 0	from gen 18 Rn222ChainGenInPDS
# of particles 1	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 2	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 39	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 44	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 42	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 38	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 51	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 43	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  30-Nov-2025 04:37:37 UTC run: 4966 subRun: 0 event: 23840
[33m
Number of Signal Particles: 8
Neutrino Interaction: -1
Neutrino Energy: 24.92 MeV
Position (147.18, 384.52, 828.47) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.75	(147.18, 384.52, 828.47)	132659	132605
marley	-12		0.56	(147.18, 384.52, 828.47)	132658	132605
marley	1000200400	0.00	(147.18, 384.52, 828.47)	132657	132605
marley	22		0.03	(147.18, 384.52, 828.47)	132609	0
marley	22		1.61	(147.18, 384.52, 828.47)	132608	0
marley	22		0.65	(147.18, 384.52, 828.47)	132607	0
marley	22		2.09	(147.18, 384.52, 828.47)	132606	0
marley	1000190400	0.00	(147.18, 384.52, 828.47)	132605	0
marley	11		19.03	(147.18, 384.52, 828.47)	132604	0
Signal Track IDs: 132604; 132605; 132606; 132607; 132608; 132609; 132657; 132658; 132659; [0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  30-Nov-2025 04:37:37 UTC run: 4966 subRun: 0 event: 23840
[33m
Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  30-Nov-2025 04:39:04 UTC run: 4966 subRun: 0 event: 23840
[34mOpFlash PE 339.74 with purity 0.23 time -2.68 plane 4
 - Vertex (60.07, 220.00, -96.50)
	*** 1st Sanity check: Ratio 0.35 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 113.76 with purity 0.31 time 0.42 plane 0
 - Vertex (-327.50, 323.40, 925.91)
	*** 1st Sanity check: Ratio 0.22 <= 1.00
	*** 2nd Sanity check: #OpHits 10 >= 10
OpFlash PE 231.88 with purity 0.03 time 0.37 plane 2
 - Vertex (210.07, -743.30, 748.10)
	*** 1st Sanity check: Ratio 0.46 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 220.83 with purity 0.53 time 1.00 plane 1
 - Vertex (139.32, 743.30, 824.19)
	*** 1st Sanity check: Ratio 0.11 <= 1.00
	*** 2nd Sanity check: #OpHits 20 >= 20
OpFlash PE 79.23 with purity 0.08 time 5.35 plane 1
 - Vertex (138.23, 743.30, 1309.86)
	*** 1st Sanity check: Ratio 0.20 <= 1.00
	*** 2nd Sanity check: #OpHits 8 >= 8

# of OpHits (ophit10ppm): 52953 for times between -4253.19 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 12214 for times between -4252.08 us and 295147919198126080.00 us.
[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  30-Nov-2025 04:39:08 UTC run: 4966 subRun: 0 event: 23840
[36m
# OpHits (ophit10ppm) in full geometry: 52953
# OpFlashes (solarflash) in full geometry: 12214
# Hits (gaushit) in each view: 6697, 6585, 6566, 0
# Cluster from the hits: 2793, 2805, 5558, 0
# Tracks (pmtracktc) in full geometry: 486[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  30-Nov-2025 05:47:34 UTC run: 4966 subRun: 0 event: 23840
[32m
# ClusterReco: Looping over 5546 matched clusters[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  30-Nov-2025 05:47:34 UTC run: 4966 subRun: 0 event: 23840
[32m*** Matched preselection cluster: 911 from 5546
 - MainTrackID 132604
 - Gen 1 -> marley TPC 46
 - Purity 1.00 Hits 1
 - Charge 28.46 ( MaxHit 28.46 )
 - #AdjCl 0 ( 0 signal ):
 - RecoCol  Time,Y,Z ( 702.51, -792.43, 869.76 )
 - RecoInd0 Time,Y,Z ( 702.25, -840.61, 218.65 )
 - RecoInd1 Time,Y,Z ( 699.95, -744.24, 1120.40 )
*** Matched flash: 5405 from 12214
 - Purity 0.00 % Plane 2 #Hits 11 PE 156.30 MainOpHitPE 31.89
 - Time -525.31 (us) Fast 21.04 % Residual 225.08
 - Reco Time,Y,Z ( -525.31, -743.30, 884.26 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 147.18, 384.52, 828.47 )
 - Main X,Y,Z ( 151.68, 384.29, 830.90 )
 - EDep X,Y,Z ( 215.42, 376.41, 871.43 )
 - Reco X,Y,Z ( 127.89, -792.43, 869.76 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  30-Nov-2025 05:47:34 UTC run: 4966 subRun: 0 event: 23840
[32m*** Matched preselection cluster: 1433 from 5546
 - MainTrackID 132604
 - Gen 1 -> marley TPC 46
 - Purity 1.00 Hits 8
 - Charge 1932.56 ( MaxHit 438.02 )
 - #AdjCl 9 ( 4 signal ):
    - Cluster 881 at distance 92.24 with time 678.13 and charge 30.16 in TPC 46 and hits 1
    - Cluster 889 at distance 78.02 with time 683.59 and charge 397.53 in TPC 46 and hits 3
    - Cluster 1005 at distance 60.61 with time 775.33 and charge 83.02 in TPC 46 and hits 1
    - Cluster 1075 at distance 53.33 with time 824.28 and charge 117.97 in TPC 46 and hits 1
    - Cluster 1359 at distance 37.87 with time 1035.93 and charge 80.75 in TPC 40 and hits 2
    - Cluster 1481 at distance 34.84 with time 1126.64 and charge 83.44 in TPC 46 and hits 1
    - Cluster 1494 at distance 94.82 with time 1138.22 and charge 35.39 in TPC 46 and hits 1
    - Cluster 1603 at distance 62.57 with time 1244.68 and charge 46.36 in TPC 46 and hits 1
    - Cluster 1621 at distance 79.61 with time 1256.87 and charge 60.20 in TPC 46 and hits 1
 - RecoCol  Time,Y,Z ( 1090.64, 384.33, 829.45 )
 - RecoInd0 Time,Y,Z ( 1090.32, 384.12, 821.56 )
 - RecoInd1 Time,Y,Z ( 1092.42, 384.53, 821.91 )
*** Matched flash: 7568 from 12214
 - Purity 0.00 % Plane 0 #Hits 8 PE 76.56 MainOpHitPE 19.46
 - Time 993.81 (us) Fast 52.15 % Residual 48.72
 - Reco Time,Y,Z ( 993.81, 437.07, 872.12 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 147.18, 384.52, 828.47 )
 - Main X,Y,Z ( 151.68, 384.29, 830.90 )
 - EDep X,Y,Z ( 215.42, 376.41, 871.43 )
 - Reco X,Y,Z ( 309.49, 384.33, 829.45 )[0m
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  30-Nov-2025 05:47:34 UTC run: 4966 subRun: 0 event: 23840
[32m-----------------------------------------------------------------------------------------
[0m
%MSG
30-Nov-2025 05:47:35 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/b7/37/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T135423Z_gen_002384_supernova_g4stage1_g4stage2_detsim_reco_20250611T054532Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 30-Nov-2025 05:47:35 UTC  ModuleEndJob
[35mFinished running the SolarNuAna module[0m
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          1.90294       4191.94       7742.54       5094.3        2936.3         10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00212293     0.011539      0.0347508    0.00957027     0.010024        10     
end_path:solarnuana:SolarNuAna      1.8871        4191.93       7742.53       5094.29       2936.29        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 30-Nov-2025 05:47:35 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3166.98 MB
  Peak resident set size usage (VmHWM): 2552.35 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 41913.507099 Real = 41980.271148

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3166.98 VmHWM = 2552.35

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===