justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 250009.8@dunegpschedd02.fnal.gov

Jobsub ID250009.8@dunegpschedd02.fnal.gov
Workflow ID10476
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-23 12:18:50
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-11-23 15:59:20
From worker nodeHostnamedunegli-7706500-0-fnpc23039.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-23 13:19:02
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T230906Z_gen_003882_supernova_g4stage1_g4stage2_detsim_reco_20250625T092007Z_reco2.root
JobscriptExit code0
Real time2h (9195s)
CPU time2h (9101s = 98%)
Max RSS bytes2550226944 (2432 MiB)
Outputting started2025-11-23 15:52:17
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/10476/1/001/fdhd_ana_2025-11-23T_131913Z_hist.root
Finished2025-11-23 15:59:20
Saved logsjustin-logs:250009.8-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

9.71)	132861	132821
marley	1000180400	0.00	(211.30, -115.24, 1986.94)	132860	132821
marley	1000180400	0.01	(172.33, -139.70, 2030.94)	132859	132821
marley	1000180400	0.01	(104.80, -144.30, 2032.50)	132858	132821
marley	1000180400	0.04	(89.74, -132.48, 2034.19)	132857	132821
marley	1000180400	0.03	(104.67, -125.82, 2038.13)	132856	132821
marley	22		6.05	(109.73, -126.76, 2025.55)	132822	0
marley	2112		0.61	(109.73, -126.76, 2025.55)	132821	0
marley	1000190390	0.02	(109.73, -126.76, 2025.55)	132820	0
marley	11		7.83	(109.73, -126.76, 2025.55)	132819	0
Signal Track IDs: 132819; 132820; 132821; 132822; 132856; 132857; 132858; 132859; 132860; 132861; 132862; 132863; 132864; 132865; 132866; 132867; 132868; 132869; 132870; 132871; 132872; 132873; 132874; 132875; 132876; 132877; 132878; 132879; 132880; 132881; 132882; 132883; 132884; 132885; 132886; 132887; 132888; 132889; 132890; 132891; 132892; 132893; 132894; 132895; 132896; 132897; 132898; 132899; 132900; 132901; 132902; 132903; 132904; 132906; 132907; 132908; 132909; 132910; 132948; 132949; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 15:32:03 UTC run: 5038 subRun: 0 event: 38820

Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 15:32:40 UTC run: 5038 subRun: 0 event: 38820
OpFlash PE 119.20 with purity 0.40 time 0.87 plane 0
 - Vertex (-327.50, 77.15, 1929.97)
	*** 1st Sanity check: Ratio 0.17 <= 1.00
	*** 2nd Sanity check: #OpHits 12 >= 12
OpFlash PE 366.56 with purity 0.13 time 0.60 plane 3
 - Vertex (134.10, 6.93, 2188.38)
	*** 1st Sanity check: Ratio 0.14 <= 1.00
	*** 2nd Sanity check: #OpHits 18 >= 18
OpFlash PE 52.13 with purity 0.10 time 5.99 plane 0
 - Vertex (-327.50, 436.60, 1604.90)
	*** 1st Sanity check: Ratio 0.25 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 79.90 with purity 0.13 time 1297.41 plane 3
 - Vertex (125.29, 220.00, 2188.38)
	*** 1st Sanity check: Ratio 0.36 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5

# of OpHits (ophit10ppm): 52778 for times between -4254.25 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 12246 for times between -4253.86 us and 295147919198126080.00 us.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 15:32:42 UTC run: 5038 subRun: 0 event: 38820

# OpHits (ophit10ppm) in full geometry: 52778
# OpFlashes (solarflash) in full geometry: 12246
# Hits (gaushit) in each view: 6712, 6712, 6607, 0
# Cluster from the hits: 2805, 2902, 5632, 0
# Tracks (pmtracktc) in full geometry: 467
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 15:52:16 UTC run: 5038 subRun: 0 event: 38820

# ClusterReco: Looping over 5625 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 15:52:16 UTC run: 5038 subRun: 0 event: 38820
*** Matched preselection cluster: 1671 from 5625
 - MainTrackID 132822
 - Gen 1 -> marley TPC 107
 - Purity 1.00 Hits 3
 - Charge 191.25 ( MaxHit 74.67 )
 - #AdjCl 7 ( 0 signal ):
    - Cluster 1052 at distance 78.30 with time 860.08 and charge 27.75 in TPC 107 and hits 1
    - Cluster 1363 at distance 65.88 with time 1101.72 and charge 64.50 in TPC 109 and hits 1
    - Cluster 1391 at distance 43.12 with time 1112.67 and charge 26.22 in TPC 105 and hits 1
    - Cluster 1410 at distance 80.36 with time 1125.01 and charge 43.87 in TPC 107 and hits 1
    - Cluster 1569 at distance 45.51 with time 1248.46 and charge 42.60 in TPC 105 and hits 1
    - Cluster 1704 at distance 87.49 with time 1341.01 and charge 124.50 in TPC 109 and hits 1
    - Cluster 2003 at distance 48.89 with time 1549.38 and charge 20.35 in TPC 107 and hits 1
 - RecoCol  Time,Y,Z ( 1315.08, 164.44, 2003.03 )
 - RecoInd0 Time,Y,Z ( 1315.56, -143.83, 1993.91 )
 - RecoInd1 Time,Y,Z ( 1310.19, 472.72, 522.72 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 109.73, -126.76, 2025.55 )
 - Main X,Y,Z ( 129.81, -146.07, 1997.97 )
 - EDep X,Y,Z ( 110.99, -140.59, 2004.46 )
 - Reco X,Y,Z ( -1000000.00, 164.44, 2003.03 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 15:52:16 UTC run: 5038 subRun: 0 event: 38820
*** Matched preselection cluster: 1688 from 5625
 - MainTrackID 132819
 - Gen 1 -> marley TPC 107
 - Purity 1.00 Hits 4
 - Charge 997.61 ( MaxHit 740.89 )
 - #AdjCl 5 ( 0 signal ):
    - Cluster 1128 at distance 83.68 with time 930.02 and charge 36.18 in TPC 109 and hits 1
    - Cluster 1183 at distance 88.23 with time 972.71 and charge 53.25 in TPC 105 and hits 1
    - Cluster 1561 at distance 29.28 with time 1242.06 and charge 49.94 in TPC 107 and hits 1
    - Cluster 1817 at distance 32.59 with time 1420.19 and charge 26.79 in TPC 105 and hits 1
    - Cluster 2106 at distance 80.43 with time 1622.44 and charge 24.04 in TPC 105 and hits 1
 - RecoCol  Time,Y,Z ( 1330.74, -127.68, 2025.77 )
 - RecoInd0 Time,Y,Z ( 1331.32, -127.46, 2016.92 )
 - RecoInd1 Time,Y,Z ( 1330.11, -127.91, 2023.62 )
*** Matched flash: 7253 from 12246
 - Purity 0.00 % Plane 0 #Hits 12 PE 2723.36 MainOpHitPE 907.84
 - Time 778.95 (us) Fast 97.52 % Residual 161759.03
 - Reco Time,Y,Z ( 778.95, -132.70, 2044.46 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 109.73, -126.76, 2025.55 )
 - Main X,Y,Z ( 112.31, -128.24, 2025.49 )
 - EDep X,Y,Z ( 111.01, -139.80, 2005.30 )
 - Reco X,Y,Z ( 236.44, -127.68, 2025.77 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 15:52:16 UTC run: 5038 subRun: 0 event: 38820
*** Matched preselection cluster: 1693 from 5625
 - MainTrackID 132822
 - Gen 1 -> marley TPC 107
 - Purity 1.00 Hits 3
 - Charge 487.91 ( MaxHit 327.66 )
 - #AdjCl 9 ( 0 signal ):
    - Cluster 1111 at distance 75.27 with time 915.09 and charge 26.16 in TPC 105 and hits 1
    - Cluster 1357 at distance 90.20 with time 1099.21 and charge 76.49 in TPC 101 and hits 2
    - Cluster 1410 at distance 79.94 with time 1125.01 and charge 43.87 in TPC 107 and hits 1
    - Cluster 1657 at distance 65.97 with time 1307.70 and charge 42.02 in TPC 107 and hits 1
    - Cluster 1752 at distance 89.80 with time 1378.77 and charge 24.91 in TPC 111 and hits 1
    - Cluster 1873 at distance 23.15 with time 1459.51 and charge 49.30 in TPC 109 and hits 1
    - Cluster 1882 at distance 29.57 with time 1464.82 and charge 53.24 in TPC 109 and hits 2
    - Cluster 2211 at distance 74.10 with time 1692.77 and charge 27.56 in TPC 107 and hits 1
    - Cluster 2373 at distance 84.57 with time 1838.29 and charge 62.10 in TPC 109 and hits 1
 - RecoCol  Time,Y,Z ( 1333.22, 306.80, 2004.53 )
 - RecoInd0 Time,Y,Z ( 1333.32, -140.49, 1997.56 )
 - RecoInd1 Time,Y,Z ( 1340.97, 754.08, 223.88 )
*** Matched flash: 2677 from 12246
 - Purity 0.00 % Plane 0 #Hits 6 PE 74.47 MainOpHitPE 25.33
 - Time -2401.87 (us) Fast 61.01 % Residual 166.06
 - Reco Time,Y,Z ( -2401.87, 308.40, 1983.56 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 109.73, -126.76, 2025.55 )
 - Main X,Y,Z ( 129.81, -146.07, 1997.97 )
 - EDep X,Y,Z ( 110.99, -140.59, 2004.46 )
 - Reco X,Y,Z ( -274.68, 306.80, 2004.53 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 15:52:16 UTC run: 5038 subRun: 0 event: 38820
-----------------------------------------------------------------------------------------

%MSG
23-Nov-2025 15:52:16 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/c7/01/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T230906Z_gen_003882_supernova_g4stage1_g4stage2_detsim_reco_20250625T092007Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 23-Nov-2025 15:52:16 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.490059       914.962       2095.23       607.33        944.741        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000622391   0.00838793     0.0201414    0.00399123    0.00799443       10     
end_path:solarnuana:SolarNuAna     0.489334       914.953       2095.21       607.328       944.736        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 23-Nov-2025 15:52:16 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3169.06 MB
  Peak resident set size usage (VmHWM): 2550.23 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 9088.316720 Real = 9174.501455

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3169.06 VmHWM = 2550.23

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-09 00:36:10 UTC       justIN version: 01.06.00