justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301076.0@dunegpschedd01.fnal.gov

Jobsub ID301076.0@dunegpschedd01.fnal.gov
Workflow ID12396
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-26 07:41:51
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2026-01-26 21:43:45
From worker nodeHostnamedunegli-8279330-0-fnpc23047.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-26 18:34:00
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T161718Z_gen_000627_supernova_g4stage1_g4stage2_detsim_reco_20250701T232852Z_reco2.root
JobscriptExit code0
Real time3h (11378s)
CPU time3h (11304s = 99%)
Max RSS bytes2569146368 (2450 MiB)
Outputting started2026-01-26 21:43:38
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/12396/1/001/fdhd_ana_2026-01-26T_183404Z_hist.root
Finished2026-01-26 21:43:45
Saved logsjustin-logs:301076.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

08)	133048	133037
marley	1000180400	0.08	(-50.03, -335.84, 1226.29)	133047	133037
marley	1000180400	0.09	(-50.53, -341.21, 1225.70)	133046	133037
marley	22		1.46	(-48.18, -338.81, 1226.19)	133039	132980
marley	1000180400	0.12	(-48.18, -338.81, 1226.19)	133038	132980
marley	2112		1.06	(-48.18, -338.81, 1226.19)	133037	132980
marley	1000180400	0.18	(-52.14, -337.26, 1222.27)	133036	132980
marley	22		3.60	(-33.36, -349.60, 1208.84)	132982	0
marley	22		1.95	(-33.36, -349.60, 1208.84)	132981	0
marley	2112		2.82	(-33.36, -349.60, 1208.84)	132980	0
marley	1000190390	0.08	(-33.36, -349.60, 1208.84)	132979	0
marley	11		10.96	(-33.36, -349.60, 1208.84)	132978	0
Signal Track IDs: 132978; 132979; 132980; 132981; 132982; 133036; 133037; 133038; 133039; 133046; 133047; 133048; 133049; 133050; 133051; 133052; 133053; 133054; 133055; 133056; 133057; 133058; 133059; 133060; 133061; 133062; 133063; 133064; 133065; 133066; 133067; 133068; 133069; 133070; 133071; 133072; 133073; 133074; 133075; 133076; 133077; 133078; 133079; 133080; 133081; 133082; 133083; 133084; 133085; 133086; 133087; 133088; 133089; 133090; 133091; 133092; 133093; 133094; 133095; 133096; 133097; 133098; 133099; 133100; 133101; 133102; 133103; 133104; 133105; 133106; 133107; 133108; 133109; 133110; 133111; 133112; 133113; 133114; 133115; 133116; 133131; 133132; 133134; 133135; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 21:16:57 UTC run: 5025 subRun: 0 event: 6270

Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 21:17:41 UTC run: 5025 subRun: 0 event: 6270
OpFlash PE 88.66 with purity 0.47 time -0.85 plane 1
 - Vertex (60.07, 743.30, 450.26)
	*** 1st Sanity check: Ratio 0.54 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 552.58 with purity 0.40 time 0.30 plane 0
 - Vertex (-327.50, -278.96, 1299.96)
	*** 1st Sanity check: Ratio 0.08 <= 1.00
	*** 2nd Sanity check: #OpHits 34 >= 34
OpFlash PE 20.55 with purity 0.33 time 1.46 plane 0
 - Vertex (-327.50, 425.91, 190.48)
	*** 1st Sanity check: Ratio 0.46 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 629.31 with purity 0.19 time 1.79 plane 1
 - Vertex (215.50, 743.30, 450.26)
	*** 1st Sanity check: Ratio 0.18 <= 1.00
	*** 2nd Sanity check: #OpHits 8 >= 8
OpFlash PE 145.93 with purity 0.63 time 1.80 plane 2
 - Vertex (147.95, -743.30, 784.79)
	*** 1st Sanity check: Ratio 0.33 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 8.88 with purity 0.37 time 1.68 plane 0
 - Vertex (-327.50, 425.29, 1542.01)
	*** 1st Sanity check: Ratio 0.54 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 29.49 with purity 0.18 time 1.97 plane 3
 - Vertex (132.98, 220.00, 2188.38)
	*** 1st Sanity check: Ratio 0.48 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 108.96 with purity 0.45 time 2.39 plane 0
 - Vertex (-327.50, -340.64, 1077.87)
	*** 1st Sanity check: Ratio 0.17 <= 1.00
	*** 2nd Sanity check: #OpHits 13 >= 13
OpFlash PE 11.68 with purity 0.30 time 3.43 plane 0
 - Vertex (-327.50, -329.21, 1764.22)
	*** 1st Sanity check: Ratio 0.60 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 26.17 with purity 0.58 time 5.82 plane 2
 - Vertex (116.48, -743.30, 1261.43)
	*** 1st Sanity check: Ratio 0.49 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3

# of OpHits (ophit10ppm): 53417 for times between -4254.41 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 18303 for times between -4254.41 us and 295147919198126080.00 us.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 21:17:43 UTC run: 5025 subRun: 0 event: 6270

# OpHits (ophit10ppm) in full geometry: 53417
# OpFlashes (solarflash) in full geometry: 18303
# Hits (gaushit) in each view: 6694, 6596, 6661, 0
# Cluster from the hits: 2787, 2810, 5682, 0
# Tracks (pmtracktc) in full geometry: 434
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 21:43:38 UTC run: 5025 subRun: 0 event: 6270

# ClusterReco: Looping over 5678 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 21:43:38 UTC run: 5025 subRun: 0 event: 6270
*** Matched preselection cluster: 2687 from 5678
 - MainTrackID 132982
 - Gen 1 -> marley TPC 58
 - Purity 1.00 Hits 2
 - Charge 59.61 ( MaxHit 40.23 )
 - #AdjCl 5 ( 0 signal ):
    - Cluster 2115 at distance 95.80 with time 1598.02 and charge 32.45 in TPC 60 and hits 1
    - Cluster 2224 at distance 65.10 with time 1693.45 and charge 38.28 in TPC 56 and hits 1
    - Cluster 2517 at distance 57.48 with time 1951.88 and charge 22.27 in TPC 62 and hits 1
    - Cluster 2862 at distance 78.07 with time 2198.54 and charge 35.79 in TPC 58 and hits 1
    - Cluster 3497 at distance 99.36 with time 2672.73 and charge 37.38 in TPC 58 and hits 2
 - RecoCol  Time,Y,Z ( 2071.47, -51.12, 1173.53 )
 - RecoInd0 Time,Y,Z ( 2071.80, -272.70, 944.83 )
 - RecoInd1 Time,Y,Z ( 2071.70, 170.47, 373.80 )
*** Matched flash: 9181 from 18303
 - Purity 0.00 % Plane 0 #Hits 7
 - MainOpHitPE 8.79 (PE);  TotalPE 43.88 vs expected 29.04 (PE)
 - Time -18.13 (us) Fast 39.91 % Residual 387.25
 - Reco Time,Y,Z ( -18.13, -39.99, 1166.85 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -33.36, -349.60, 1208.84 )
 - Main X,Y,Z ( -3.46, -292.22, 1158.72 )
 - EDep X,Y,Z ( -18.97, -337.92, 1206.13 )
 - Reco X,Y,Z ( -10.48, -51.12, 1173.53 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 21:43:38 UTC run: 5025 subRun: 0 event: 6270
*** Matched preselection cluster: 2918 from 5678
 - MainTrackID 132978
 - Gen 1 -> marley TPC 65
 - Purity 1.00 Hits 6
 - Charge 699.05 ( MaxHit 158.35 )
 - #AdjCl 9 ( 2 signal ):
    - Cluster 2379 at distance 77.72 with time 1846.43 and charge 33.04 in TPC 65 and hits 1
    - Cluster 2536 at distance 77.47 with time 1958.73 and charge 25.30 in TPC 71 and hits 1
    - Cluster 2658 at distance 32.25 with time 2055.78 and charge 55.08 in TPC 65 and hits 2
    - Cluster 2869 at distance 90.45 with time 2203.16 and charge 52.89 in TPC 59 and hits 1
    - Cluster 3086 at distance 31.04 with time 2368.46 and charge 34.50 in TPC 65 and hits 1
    - Cluster 3272 at distance 76.14 with time 2512.27 and charge 164.97 in TPC 67 and hits 1
    - Cluster 3346 at distance 77.20 with time 2561.08 and charge 49.72 in TPC 65 and hits 1
    - Cluster 3405 at distance 91.23 with time 2603.38 and charge 382.67 in TPC 65 and hits 2
    - Cluster 3494 at distance 86.20 with time 2671.29 and charge 25.14 in TPC 59 and hits 1
 - RecoCol  Time,Y,Z ( 2238.24, -349.63, 1210.11 )
 - RecoInd0 Time,Y,Z ( 2238.53, -349.64, 1270.32 )
 - RecoInd1 Time,Y,Z ( 2238.35, -349.62, 1214.06 )
*** Matched flash: 11308 from 18303
 - Purity 0.00 % Plane 0 #Hits 7
 - MainOpHitPE 8.50 (PE);  TotalPE 43.58 vs expected 42.11 (PE)
 - Time 987.26 (us) Fast 21.79 % Residual 25.00
 - Reco Time,Y,Z ( 987.26, -363.63, 1142.07 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -33.36, -349.60, 1208.84 )
 - Main X,Y,Z ( -35.06, -349.57, 1211.03 )
 - EDep X,Y,Z ( -93.11, -350.47, 1280.02 )
 - Reco X,Y,Z ( 124.17, -349.63, 1210.11 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Jan-2026 21:43:38 UTC run: 5025 subRun: 0 event: 6270
-----------------------------------------------------------------------------------------

%MSG
26-Jan-2026 21:43:38 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/f4/cd/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T161718Z_gen_000627_supernova_g4stage1_g4stage2_detsim_reco_20250701T232852Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 26-Jan-2026 21:43:38 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          0.52402       1134.35       1850.21       1565.39       755.014        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00136766    0.00866372     0.0230975    0.00646625     0.0074823       10     
end_path:solarnuana:SolarNuAna     0.522453       1134.34       1850.2        1565.38       755.014        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 26-Jan-2026 21:43:38 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3195.7 MB
  Peak resident set size usage (VmHWM): 2569.15 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 11295.550783 Real = 11366.857499

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3195.7 VmHWM = 2569.15

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-04 13:19:32 UTC       justIN version: 01.06.00