justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 294214.0@dunegpschedd02.fnal.gov

Jobsub ID294214.0@dunegpschedd02.fnal.gov
Workflow ID12260
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-23 10:10:07
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2026-01-23 14:10:14
From worker nodeHostnamedunegli-8249607-0-fnpc19113.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-23 10:11:41
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250126T213606Z_gen_001380_supernova_g4stage1_g4stage2_detsim_reco_20250625T091926Z_reco2.root
JobscriptExit code0
Real time3h (14304s)
CPU time3h (14202s = 99%)
Max RSS bytes2569527296 (2450 MiB)
Outputting started2026-01-23 14:10:05
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/12260/1/001/fdhd_ana_2026-01-23T_101148Z_hist.root
Finished2026-01-23 14:10:14
Saved logsjustin-logs:294214.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

otherID
--------------------------------------------------------------------------------
marley	11		0.79	(306.87, 286.28, 1700.62)	133025	132980
marley	-12		0.52	(306.87, 286.28, 1700.62)	133024	132980
marley	1000200400	0.00	(306.87, 286.28, 1700.62)	133023	132980
marley	22		0.03	(306.87, 286.28, 1700.62)	132983	0
marley	22		2.07	(306.87, 286.28, 1700.62)	132982	0
marley	22		3.58	(306.87, 286.28, 1700.62)	132981	0
marley	1000190400	0.01	(306.87, 286.28, 1700.62)	132980	0
marley	11		9.08	(306.87, 286.28, 1700.62)	132979	0
Signal Track IDs: 132979; 132980; 132981; 132982; 132983; 133023; 133024; 133025; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 13:36:47 UTC run: 4924 subRun: 0 event: 13800

Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 13:37:52 UTC run: 4924 subRun: 0 event: 13800
OpFlash PE 377.97 with purity 0.06 time -2.04 plane 3
 - Vertex (161.86, 20.06, 2188.38)
	*** 1st Sanity check: Ratio 0.14 <= 1.00
	*** 2nd Sanity check: #OpHits 17 >= 17
OpFlash PE 40.08 with purity 0.10 time 0.28 plane 1
 - Vertex (285.07, 743.30, 1673.58)
	*** 1st Sanity check: Ratio 0.48 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 34.72 with purity 0.43 time 0.37 plane 0
 - Vertex (-327.50, 185.22, 598.19)
	*** 1st Sanity check: Ratio 0.31 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4

# of OpHits (ophit10ppm): 53050 for times between -4254.44 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 18350 for times between -4254.30 us and 295147919198126080.00 us.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 13:37:55 UTC run: 4924 subRun: 0 event: 13800

# OpHits (ophit10ppm) in full geometry: 53050
# OpFlashes (solarflash) in full geometry: 18350
# Hits (gaushit) in each view: 7055, 6957, 6836, 0
# Cluster from the hits: 2936, 2952, 5771, 0
# Tracks (pmtracktc) in full geometry: 508
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 14:10:05 UTC run: 4924 subRun: 0 event: 13800

# ClusterReco: Looping over 5759 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 14:10:05 UTC run: 4924 subRun: 0 event: 13800
*** Matched preselection cluster: 82 from 5759
 - MainTrackID 132979
 - Gen 1 -> marley TPC 93
 - Purity 1.00 Hits 7
 - Charge 1163.74 ( MaxHit 362.15 )
 - #AdjCl 5 ( 1 signal ):
    - Cluster 148 at distance 83.33 with time 155.28 and charge 36.50 in TPC 87 and hits 1
    - Cluster 175 at distance 13.23 with time 171.79 and charge 128.24 in TPC 93 and hits 2
    - Cluster 402 at distance 88.03 with time 342.10 and charge 179.17 in TPC 93 and hits 1
    - Cluster 470 at distance 48.55 with time 385.89 and charge 45.28 in TPC 91 and hits 1
    - Cluster 649 at distance 71.88 with time 518.07 and charge 48.24 in TPC 89 and hits 2
 - RecoCol  Time,Y,Z ( 110.85, 287.46, 1701.98 )
 - RecoInd0 Time,Y,Z ( 110.83, 287.42, 1718.08 )
 - RecoInd1 Time,Y,Z ( 110.83, 287.49, 1714.78 )
*** Matched flash: 3370 from 18350
 - Purity 0.00 % Plane 0 #Hits 11
 - MainOpHitPE 688.89 (PE);  TotalPE 1435.44 vs expected 305.31 (PE)
 - Time -2643.32 (us) Fast 92.61 % Residual 86424.03
 - Reco Time,Y,Z ( -2643.32, 373.40, 1675.62 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 306.87, 286.28, 1700.62 )
 - Main X,Y,Z ( 306.89, 288.08, 1702.50 )
 - EDep X,Y,Z ( 307.55, 287.39, 1701.54 )
 - Reco X,Y,Z ( -117.18, 287.46, 1701.98 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 14:10:05 UTC run: 4924 subRun: 0 event: 13800
*** Matched preselection cluster: 265 from 5759
 - MainTrackID 132982
 - Gen 1 -> marley TPC 93
 - Purity 1.00 Hits 1
 - Charge 37.02 ( MaxHit 37.02 )
 - #AdjCl 0 ( 0 signal ):
 - RecoCol  Time,Y,Z ( 238.63, -531.23, 1721.91 )
 - RecoInd0 Time,Y,Z ( 233.30, -1025.39, 971.48 )
 - RecoInd1 Time,Y,Z ( 232.24, -37.08, 1419.24 )
*** Matched flash: 2443 from 18350
 - Purity 0.00 % Plane 0 #Hits 7
 - MainOpHitPE 41.19 (PE);  TotalPE 137.77 vs expected 108.47 (PE)
 - Time -3097.08 (us) Fast 37.98 % Residual 521.59
 - Reco Time,Y,Z ( -3097.08, -561.15, 1706.51 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 306.87, 286.28, 1700.62 )
 - Main X,Y,Z ( 297.16, 281.54, 1724.23 )
 - EDep X,Y,Z ( 300.62, 288.71, 1714.24 )
 - Reco X,Y,Z ( -210.56, -531.23, 1721.91 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 14:10:05 UTC run: 4924 subRun: 0 event: 13800
*** Matched preselection cluster: 280 from 5759
 - MainTrackID 132981
 - Gen 1 -> marley TPC 93
 - Purity 1.00 Hits 4
 - Charge 216.55 ( MaxHit 108.95 )
 - #AdjCl 9 ( 1 signal ):
    - Cluster 141 at distance 94.29 with time 152.10 and charge 111.89 in TPC 93 and hits 1
    - Cluster 148 at distance 84.67 with time 155.28 and charge 36.50 in TPC 87 and hits 1
    - Cluster 224 at distance 96.75 with time 215.88 and charge 41.40 in TPC 87 and hits 2
    - Cluster 286 at distance 72.48 with time 256.14 and charge 25.97 in TPC 87 and hits 1
    - Cluster 402 at distance 30.62 with time 342.10 and charge 179.17 in TPC 93 and hits 1
    - Cluster 447 at distance 61.50 with time 364.83 and charge 35.15 in TPC 85 and hits 1
    - Cluster 626 at distance 76.05 with time 501.38 and charge 36.28 in TPC 87 and hits 1
    - Cluster 756 at distance 78.86 with time 601.51 and charge 22.78 in TPC 93 and hits 1
    - Cluster 762 at distance 79.51 with time 604.07 and charge 32.30 in TPC 89 and hits 1
 - RecoCol  Time,Y,Z ( 253.08, 182.34, 1689.57 )
 - RecoInd0 Time,Y,Z ( 253.10, -492.37, 1751.59 )
 - RecoInd1 Time,Y,Z ( 253.09, 857.06, 373.80 )
*** Matched flash: 2735 from 18350
 - Purity 0.00 % Plane 0 #Hits 10
 - MainOpHitPE 19.77 (PE);  TotalPE 102.97 vs expected 130.53 (PE)
 - Time -2958.60 (us) Fast 20.17 % Residual 44.37
 - Reco Time,Y,Z ( -2958.60, 247.45, 1693.67 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 306.87, 286.28, 1700.62 )
 - Main X,Y,Z ( 267.68, 300.19, 1684.27 )
 - EDep X,Y,Z ( 297.49, 291.25, 1694.06 )
 - Reco X,Y,Z ( -190.64, 182.34, 1689.57 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 14:10:05 UTC run: 4924 subRun: 0 event: 13800
*** Matched preselection cluster: 340 from 5759
 - MainTrackID 132981
 - Gen 1 -> marley TPC 93
 - Purity 1.00 Hits 1
 - Charge 76.46 ( MaxHit 76.46 )
 - #AdjCl 1 ( 0 signal ):
    - Cluster 644 at distance 97.75 with time 514.82 and charge 30.10 in TPC 93 and hits 1
 - RecoCol  Time,Y,Z ( 302.84, 722.25, 1683.66 )
 - RecoInd0 Time,Y,Z ( 302.89, 300.91, 1718.08 )
 - RecoInd1 Time,Y,Z ( 303.08, 1143.58, 373.80 )
*** Matched flash: 9506 from 18350
 - Purity 0.00 % Plane 1 #Hits 7
 - MainOpHitPE 36.27 (PE);  TotalPE 120.44 vs expected 5.93 (PE)
 - Time 164.10 (us) Fast 61.07 % Residual 208.39
 - Reco Time,Y,Z ( 164.10, 743.30, 1641.62 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 306.87, 286.28, 1700.62 )
 - Main X,Y,Z ( 267.68, 300.19, 1684.27 )
 - EDep X,Y,Z ( 297.49, 291.25, 1694.06 )
 - Reco X,Y,Z ( 302.76, 722.25, 1683.66 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Jan-2026 14:10:05 UTC run: 4924 subRun: 0 event: 13800
-----------------------------------------------------------------------------------------

%MSG
23-Jan-2026 14:10:05 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/de/7c/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250126T213606Z_gen_001380_supernova_g4stage1_g4stage2_detsim_reco_20250625T091926Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 23-Jan-2026 14:10:05 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.858816       1425.59       2723.55       2092.72       1178.58        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)             0.002192     0.00716688     0.0161691    0.00564227    0.00506822       10     
end_path:solarnuana:SolarNuAna     0.845271       1425.58       2723.53       2092.71       1178.58        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 23-Jan-2026 14:10:05 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3200.09 MB
  Peak resident set size usage (VmHWM): 2569.53 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 14188.492910 Real = 14288.258974

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3200.09 VmHWM = 2569.53

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-05 08:28:54 UTC       justIN version: 01.06.00