justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 233177.13@dunegpschedd02.fnal.gov

Jobsub ID233177.13@dunegpschedd02.fnal.gov
Workflow ID9319
Stage ID1
User namesmanthey@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-10-27 01:32:18
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-10-27 01:43:08
From worker nodeHostnamedunegli-7377409-0-fnpc8209.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-10-27 01:32:44
Input filesfardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250210T080004Z_gen_004543_supernova_g4_halfActiveVol_detsim_reco_20250724T185510Z_reco2.root
JobscriptExit code0
Real time10m (607s)
CPU time10m (601s = 99%)
Max RSS bytes850518016 (811 MiB)
Outputting started2025-10-27 01:42:52
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dune10kt_1x2x6_lateralAPA/fnal/09319/1/010/fdhd_ana_2025-10-27T_013251Z_hist.root
Finished2025-10-27 01:43:08
Saved logsjustin-logs:233177.13-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

254; 33255; 33256; 33257; 33259; 33260; 33262; 33268; 33270; 33274; 33279; 33280; 33281; 33282; 33283; 33284; 33285; 33286; 33287; 33288; 33289; 33290; 33291; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  27-Oct-2025 01:42:22 UTC run: 5102 subRun: 0 event: 227150

Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  27-Oct-2025 01:42:27 UTC run: 5102 subRun: 0 event: 227150
OpFlash PE 336.59 with purity 0.95 time 0.00 plane 0
 - Vertex (-0.05, -394.88, 1275.48)
	*** 1st Sanity check: Ratio 0.24 <= 1.00
	*** 2nd Sanity check: #OpHits 31 >= 31
OpFlash PE 1.63 with purity 1.00 time 0.01 plane 0
 - Vertex (-0.05, -591.57, 660.30)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 94.62 with purity 0.96 time 0.01 plane 0
 - Vertex (-0.05, -346.06, 1148.41)
	*** 1st Sanity check: Ratio 0.17 <= 1.00
	*** 2nd Sanity check: #OpHits 18 >= 18
OpFlash PE 37.55 with purity 0.93 time 0.03 plane 0
 - Vertex (-0.05, -364.56, 1295.73)
	*** 1st Sanity check: Ratio 0.19 <= 1.00
	*** 2nd Sanity check: #OpHits 13 >= 13
OpFlash PE 5.51 with purity 0.28 time 0.03 plane 0
 - Vertex (0.05, 570.21, 864.95)
	*** 1st Sanity check: Ratio 0.37 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 11.42 with purity 0.88 time 0.06 plane 0
 - Vertex (-0.05, -360.63, 1250.17)
	*** 1st Sanity check: Ratio 0.46 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 3.68 with purity 1.00 time 0.06 plane 0
 - Vertex (-0.05, -330.43, 1015.08)
	*** 1st Sanity check: Ratio 0.55 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 83.96 with purity 0.98 time 0.08 plane 0
 - Vertex (-0.05, -404.76, 1245.87)
	*** 1st Sanity check: Ratio 0.93 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 8.91 with purity 0.23 time 0.09 plane 0
 - Vertex (-0.05, -171.26, 1141.51)
	*** 1st Sanity check: Ratio 0.32 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 2.03 with purity 1.00 time 0.20 plane 0
 - Vertex (-0.05, -31.14, 1125.08)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 400.84 with purity 1.00 time 0.27 plane 0
 - Vertex (-0.05, -431.91, 1308.67)
	*** 1st Sanity check: Ratio 0.56 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 1.99 with purity 0.50 time 1.09 plane 0
 - Vertex (-0.05, -217.95, 843.89)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 10.54 with purity 1.00 time 1.09 plane 0
 - Vertex (-0.05, -178.95, 1268.32)
	*** 1st Sanity check: Ratio 0.28 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 5.83 with purity 1.00 time 1.09 plane 0
 - Vertex (0.05, 237.25, 1057.01)
	*** 1st Sanity check: Ratio 0.35 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 10.06 with purity 1.00 time 1.10 plane 0
 - Vertex (0.00, -24.39, 1266.73)
	*** 1st Sanity check: Ratio 0.33 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 5.89 with purity 1.00 time 1.11 plane 0
 - Vertex (0.02, 73.64, 1227.53)
	*** 1st Sanity check: Ratio 0.35 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 1.90 with purity 1.00 time 1.12 plane 0
 - Vertex (-0.05, -467.03, 1308.67)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 24.85 with purity 0.38 time 1.12 plane 0
 - Vertex (-0.05, -93.41, 1076.28)
	*** 1st Sanity check: Ratio 0.92 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 10.15 with purity 0.50 time 1.21 plane 0
 - Vertex (-0.05, -31.14, 1197.07)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1

# of OpFlashes (solarflash) in full geometry: 5410

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  27-Oct-2025 01:42:27 UTC run: 5102 subRun: 0 event: 227150

# OpHits (ophitspe) in full geometry: 40549
# OpFlashes (solarflash) in full geometry: 5410
# Hits (hitfd) in each view: 163, 158, 295, 0
# Cluster from the hits: 98, 97, 263, 0
# Tracks (pmtracktc) in full geometry: 2
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  27-Oct-2025 01:42:51 UTC run: 5102 subRun: 0 event: 227150

# ClusterReco: Looping over 166 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  27-Oct-2025 01:42:51 UTC run: 5102 subRun: 0 event: 227150
*** Matched preselection cluster: 18
 - MainTrackID 32889
 - Gen 1 -> marley TPC 21
 - Purity 1.00 Hits 6
 - Charge 921.10 ( MaxHit 283.68 )
 - #AdjCl 1 ( 1 signal ):
    - Cluster 17 at distance 13.21 with time 138.26 and charge 128.75 in TPC 21 and hits 1
 - RecoCol  Time,Y,Z ( 161.57, -402.94, 1275.46 )
 - RecoInd0 Time,Y,Z ( 161.71, -403.13, 1277.27 )
 - RecoInd1 Time,Y,Z ( 161.84, -402.75, 1277.27 )
*** Matched flash: 
 - Purity 0.95 Plane 0 #Hits 31 PE 336.59 MaxPE 82.41
 - Time -18.10 Fast 0.77 Residual 78.45
 - Reco Time,Y,Z ( -18.10, -394.88, 1275.48 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 29.43, -402.22, 1274.50 )
 - Main X,Y,Z ( 28.84, -403.18, 1276.33 )
 - EDep X,Y,Z ( 29.14, -402.69, 1275.25 )
 - Reco X,Y,Z ( 28.85, -402.94, 1275.46 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  27-Oct-2025 01:42:51 UTC run: 5102 subRun: 0 event: 227150
*** Matched preselection cluster: 117
 - MainTrackID 32889
 - Gen 1 -> marley TPC 21
 - Purity 1.00 Hits 2
 - Charge 267.47 ( MaxHit 146.56 )
 - #AdjCl 2 ( 2 signal ):
    - Cluster 116 at distance 13.01 with time 1991.71 and charge 65.48 in TPC 21 and hits 1
    - Cluster 119 at distance 10.43 with time 2041.52 and charge 142.45 in TPC 21 and hits 1
 - RecoCol  Time,Y,Z ( 2011.89, -96.47, 1388.37 )
 - RecoInd0 Time,Y,Z ( 2011.99, -96.43, 1277.27 )
 - RecoInd1 Time,Y,Z ( 2011.74, -96.50, 1356.11 )
*** Matched flash: 
 - Purity 0.00 Plane 0 #Hits 17 PE 83.44 MaxPE 20.02
 - Time 16.23 Fast 0.75 Residual 184.49
 - Reco Time,Y,Z ( 16.23, -121.39, 1315.37 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 29.43, -402.22, 1274.50 )
 - Main X,Y,Z ( 28.84, -403.18, 1276.33 )
 - EDep X,Y,Z ( 29.14, -402.69, 1275.25 )
 - Reco X,Y,Z ( 320.43, -96.47, 1388.37 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  27-Oct-2025 01:42:51 UTC run: 5102 subRun: 0 event: 227150
*** Matched preselection cluster: 120
 - MainTrackID 32889
 - Gen 1 -> marley TPC 21
 - Purity 1.00 Hits 1
 - Charge 189.86 ( MaxHit 189.86 )
 - #AdjCl 3 ( 0 signal ):
    - Cluster 142 at distance 98.39 with time 2341.52 and charge 74.18 in TPC 21 and hits 1
    - Cluster 143 at distance 74.97 with time 2348.53 and charge 70.82 in TPC 23 and hits 1
    - Cluster 146 at distance 84.66 with time 2378.23 and charge 117.83 in TPC 23 and hits 1
 - RecoCol  Time,Y,Z ( 2046.88, 351.23, 1372.83 )
 - RecoInd0 Time,Y,Z ( 2056.60, 820.12, 1188.28 )
 - RecoInd1 Time,Y,Z ( 2046.99, -117.66, 1340.73 )
*** Matched flash: 
 - Purity 0.00 Plane 0 #Hits 14 PE 89.67 MaxPE 32.10
 - Time 14.18 Fast 0.72 Residual 587.11
 - Reco Time,Y,Z ( 14.18, 280.22, 1322.52 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 29.43, -402.22, 1274.50 )
 - Main X,Y,Z ( 28.84, -403.18, 1276.33 )
 - EDep X,Y,Z ( 29.14, -402.69, 1275.25 )
 - Reco X,Y,Z ( 326.38, 351.23, 1372.83 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  27-Oct-2025 01:42:51 UTC run: 5102 subRun: 0 event: 227150
-----------------------------------------------------------------------------------------

%MSG
27-Oct-2025 01:42:51 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/af/a8/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250210T080004Z_gen_004543_supernova_g4_halfActiveVol_detsim_reco_20250724T185510Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 27-Oct-2025 01:42:51 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.336469       10.8264       31.2491      0.719808       11.8538        50     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00142261    0.00195003    0.00297522    0.00190529    0.000347164      50     
end_path:solarnuana:SolarNuAna     0.334756       10.8243       31.2469      0.717208       11.8539        50     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 27-Oct-2025 01:42:51 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1490.65 MB
  Peak resident set size usage (VmHWM): 844.304 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 50 passed = 50 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         50         50          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 566.055015 Real = 569.641981

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1490.65 VmHWM = 844.304

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2025-11-04 15:55:01 UTC       justIN version: 01.05.01