justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 263328.1@dunegpschedd01.fnal.gov

Jobsub ID263328.1@dunegpschedd01.fnal.gov
Workflow ID10949
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-04 06:27:13
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-04 16:14:03
From worker nodeHostnamedunegli-7969970-0-fnpc18007.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-04 06:28:46
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T151234Z_gen_002023_supernova_g4stage1_g4stage2_detsim_reco_20250701T100243Z_reco2.root
JobscriptExit code0
Real time9h (35082s)
CPU time9h (34657s = 98%)
Max RSS bytes2564042752 (2445 MiB)
Outputting started2025-12-04 16:13:29
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/10949/1/001/fdhd_ana_2025-12-04T_062900Z_hist.root
Finished2025-12-04 16:14:03
Saved logsjustin-logs:263328.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

(54.83, -314.76, 1586.42)	133199	0
marley	22		0.65	(54.83, -314.76, 1586.42)	133198	0
marley	22		2.09	(54.83, -314.76, 1586.42)	133197	0
marley	1000190400	0.00	(54.83, -314.76, 1586.42)	133196	0
marley	11		9.42	(54.83, -314.76, 1586.42)	133195	0
Signal Track IDs: 133195; 133196; 133197; 133198; 133199; 133200; 133201; 133271; 133272; 133273; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  04-Dec-2025 15:26:03 UTC run: 5057 subRun: 0 event: 20230

Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  04-Dec-2025 15:27:45 UTC run: 5057 subRun: 0 event: 20230
OpFlash PE 31.39 with purity 0.34 time -0.13 plane 0
 - Vertex (-327.50, 425.38, 1960.85)
	*** 1st Sanity check: Ratio 0.43 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 30.50 with purity 0.12 time 0.74 plane 0
 - Vertex (-327.50, 216.62, 262.24)
	*** 1st Sanity check: Ratio 0.27 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 369.34 with purity 0.47 time 0.20 plane 2
 - Vertex (135.07, -743.30, 1939.46)
	*** 1st Sanity check: Ratio 0.40 <= 1.00
	*** 2nd Sanity check: #OpHits 12 >= 12
OpFlash PE 264.72 with purity 0.27 time 0.89 plane 0
 - Vertex (-327.50, -251.50, 1448.71)
	*** 1st Sanity check: Ratio 0.07 <= 1.00
	*** 2nd Sanity check: #OpHits 29 >= 29
OpFlash PE 294.68 with purity 0.09 time 0.27 plane 1
 - Vertex (245.46, 743.30, 152.42)
	*** 1st Sanity check: Ratio 0.22 <= 1.00
	*** 2nd Sanity check: #OpHits 9 >= 9
OpFlash PE 11.26 with purity 0.33 time 3.82 plane 1
 - Vertex (285.07, 743.30, 152.42)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 44.71 with purity 0.20 time 5.12 plane 0
 - Vertex (-327.50, -258.07, 1740.90)
	*** 1st Sanity check: Ratio 0.24 <= 1.00
	*** 2nd Sanity check: #OpHits 6 >= 6

# of OpHits (ophit10ppm): 53008 for times between -4252.46 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 12259 for times between -4252.32 us and 295147919198126080.00 us.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  04-Dec-2025 15:27:48 UTC run: 5057 subRun: 0 event: 20230

# OpHits (ophit10ppm) in full geometry: 53008
# OpFlashes (solarflash) in full geometry: 12259
# Hits (gaushit) in each view: 6797, 6785, 6699, 0
# Cluster from the hits: 2834, 2904, 5677, 0
# Tracks (pmtracktc) in full geometry: 483
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  04-Dec-2025 16:13:22 UTC run: 5057 subRun: 0 event: 20230

# ClusterReco: Looping over 5665 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  04-Dec-2025 16:13:22 UTC run: 5057 subRun: 0 event: 20230
*** Matched preselection cluster: 2019 from 5665
 - MainTrackID 133200
 - Gen 1 -> marley TPC 81
 - Purity 1.00 Hits 1
 - Charge 30.51 ( MaxHit 30.51 )
 - #AdjCl 0 ( 0 signal ):
 - RecoCol  Time,Y,Z ( 1552.89, -629.22, 1579.61 )
 - RecoInd0 Time,Y,Z ( 1553.14, -759.49, 1386.75 )
 - RecoInd1 Time,Y,Z ( 1552.96, -498.94, 1419.24 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 54.83, -314.76, 1586.42 )
 - Main X,Y,Z ( 76.69, -337.82, 1578.00 )
 - EDep X,Y,Z ( 75.71, -342.07, 1579.67 )
 - Reco X,Y,Z ( -1000000.00, -629.22, 1579.61 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  04-Dec-2025 16:13:22 UTC run: 5057 subRun: 0 event: 20230
*** Matched preselection cluster: 2077 from 5665
 - MainTrackID 75310
 - Gen 26 -> CavernwallGammasAtLAr1x8x14 TPC 82
 - Purity 0.74 Hits 4
 - Charge 378.35 ( MaxHit 248.13 )
 - #AdjCl 2 ( 2 signal ):
    - Cluster 1877 at distance 80.41 with time 1441.12 and charge 133.63 in TPC 94 and hits 1
    - Cluster 2558 at distance 84.48 with time 1979.05 and charge 242.42 in TPC 86 and hits 2
 - RecoCol  Time,Y,Z ( 1606.15, 537.33, 1586.86 )
 - RecoInd0 Time,Y,Z ( 1605.18, 629.52, 1718.08 )
 - RecoInd1 Time,Y,Z ( 1605.16, 445.15, 1741.13 )
*** Matched flash: 3148 from 12259
 - Purity 0.00 % Plane 0 #Hits 17 PE 207.80 MainOpHitPE 30.21
 - Time -2067.47 (us) Fast 21.68 % Residual 204.52
 - Reco Time,Y,Z ( -2067.47, 543.77, 1519.43 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 0.00, 0.00, 0.00 )
 - Main X,Y,Z ( 0.00, 0.00, 0.00 )
 - EDep X,Y,Z ( 0.00, 0.00, 0.00 )
 - Reco X,Y,Z ( -264.81, 537.33, 1586.86 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  04-Dec-2025 16:13:22 UTC run: 5057 subRun: 0 event: 20230
*** Matched preselection cluster: 2173 from 5665
 - MainTrackID 133197
 - Gen 1 -> marley TPC 82
 - Purity 1.00 Hits 3
 - Charge 220.74 ( MaxHit 166.31 )
 - #AdjCl 3 ( 0 signal ):
    - Cluster 1449 at distance 87.11 with time 1136.61 and charge 35.27 in TPC 84 and hits 1
    - Cluster 1568 at distance 83.67 with time 1221.79 and charge 24.74 in TPC 82 and hits 1
    - Cluster 2692 at distance 69.93 with time 2073.99 and charge 22.05 in TPC 84 and hits 1
 - RecoCol  Time,Y,Z ( 1673.46, 262.21, 1582.14 )
 - RecoInd0 Time,Y,Z ( 1673.74, -642.26, 74.96 )
 - RecoInd1 Time,Y,Z ( 1673.66, 1166.67, 71.91 )
*** Matched flash: 4252 from 12259
 - Purity 0.00 % Plane 0 #Hits 6 PE 238.06 MainOpHitPE 102.16
 - Time -1301.22 (us) Fast 43.33 % Residual 214.17
 - Reco Time,Y,Z ( -1301.22, 293.40, 1600.62 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 54.83, -314.76, 1586.42 )
 - Main X,Y,Z ( 53.67, -342.12, 1596.11 )
 - EDep X,Y,Z ( 56.37, -315.18, 1582.13 )
 - Reco X,Y,Z ( -152.59, 262.21, 1582.14 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  04-Dec-2025 16:13:22 UTC run: 5057 subRun: 0 event: 20230
*** Matched preselection cluster: 2178 from 5665
 - MainTrackID 133195
 - Gen 1 -> marley TPC 82
 - Purity 1.00 Hits 7
 - Charge 1041.81 ( MaxHit 269.75 )
 - #AdjCl 9 ( 0 signal ):
    - Cluster 1724 at distance 86.34 with time 1327.94 and charge 33.03 in TPC 86 and hits 1
    - Cluster 1835 at distance 92.99 with time 1415.82 and charge 26.25 in TPC 90 and hits 1
    - Cluster 1871 at distance 78.28 with time 1437.25 and charge 91.04 in TPC 82 and hits 1
    - Cluster 2271 at distance 84.24 with time 1746.88 and charge 143.45 in TPC 82 and hits 1
    - Cluster 2287 at distance 87.63 with time 1753.13 and charge 28.48 in TPC 84 and hits 1
    - Cluster 2485 at distance 97.26 with time 1909.64 and charge 59.22 in TPC 82 and hits 2
    - Cluster 2682 at distance 87.67 with time 2067.51 and charge 262.63 in TPC 90 and hits 3
    - Cluster 2767 at distance 72.96 with time 2128.91 and charge 32.13 in TPC 82 and hits 1
    - Cluster 2806 at distance 82.65 with time 2169.84 and charge 37.09 in TPC 86 and hits 1
 - RecoCol  Time,Y,Z ( 1677.16, -314.11, 1587.49 )
 - RecoInd0 Time,Y,Z ( 1676.38, -314.56, 1559.63 )
 - RecoInd1 Time,Y,Z ( 1676.58, -313.65, 1596.23 )
*** Matched flash: 7003 from 12259
 - Purity 0.00 % Plane 0 #Hits 7 PE 610.86 MainOpHitPE 318.35
 - Time 594.23 (us) Fast 94.76 % Residual 19402.82
 - Reco Time,Y,Z ( 594.23, -297.40, 1675.62 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 54.83, -314.76, 1586.42 )
 - Main X,Y,Z ( 56.50, -312.80, 1587.93 )
 - EDep X,Y,Z ( 56.54, -313.06, 1587.89 )
 - Reco X,Y,Z ( 151.16, -314.11, 1587.49 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  04-Dec-2025 16:13:22 UTC run: 5057 subRun: 0 event: 20230
-----------------------------------------------------------------------------------------

%MSG
04-Dec-2025 16:13:24 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/2e/c4/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T151234Z_gen_002023_supernova_g4stage1_g4stage2_detsim_reco_20250701T100243Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 04-Dec-2025 16:13:24 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          1.19949       3498.73       6449.31       4635.88       2461.32        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00113893    0.00845927     0.0162866    0.00808255    0.00599186       10     
end_path:solarnuana:SolarNuAna      1.19794       3498.72       6449.31       4635.87       2461.31        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 04-Dec-2025 16:13:24 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3175.1 MB
  Peak resident set size usage (VmHWM): 2564.04 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 34627.256028 Real = 35044.195256

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3175.1 VmHWM = 2564.04

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-07 23:39:22 UTC       justIN version: 01.06.00