justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 19546.0@dunegpschedd01.fnal.gov

Jobsub ID19546.0@dunegpschedd01.fnal.gov
Workflow ID130
Stage ID1
User namesmanthey@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-07-30 20:50:59
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-07-31 09:56:56
From worker nodeHostnamedunegli-6242796-0-fnpc22037.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-07-30 20:51:47
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T211530Z_gen_003797_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time13h (47098s)
CPU time12h (46583s = 98%)
Max RSS bytes1785966592 (1703 MiB)
Outputting started2025-07-31 09:56:45
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg/fnal/00130/1/001/fdhd_ana_2025-07-30T_205156Z_hist.root
Finished2025-07-31 09:56:56
Saved logsjustin-logs:19546.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

---------------------
marley	11		1.69	 (63.62, -312.56, 930.92)	132647
marley	-12		0.13	 (4271.52, -5033.92, -1187.97)	132647
marley	1000200400	37214.71 (63.63, -312.56, 930.79)	132647
marley	22		0.03	 (63.51, -312.90, 930.84)	0
marley	22		0.77	 (53.09, -329.20, 920.55)	0
marley	22		5.99	 (65.53, -290.37, 932.52)	0
marley	1000190400	37216.54 (63.63, -312.56, 930.79)	0
marley	11		44.13	 (57.38, -314.59, 937.35)	0
Signal Track IDs: 132646; 132647; 132648; 132649; 132650; 132716; 132717; 132718; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  31-Jul-2025 09:05:30 UTC run: 5068 subRun: 0 event: 37970
OpFlash PE 16.64 with purity 0.00 time -2.72 plane 1
 - Vertex (124.74, 743.30, 1343.78)
	*** 1st Sanity check: Ratio 0.36 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 53.31 with purity 0.32 time -1.53 plane 0
 - Vertex (-327.50, -392.38, 1027.62)
	*** 1st Sanity check: Ratio 0.32 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 21.84 with purity 0.33 time 0.07 plane 0
 - Vertex (-327.50, 20.32, 1659.15)
	*** 1st Sanity check: Ratio 0.56 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 73.97 with purity 0.64 time 0.50 plane 1
 - Vertex (114.41, 743.30, 1093.34)
	*** 1st Sanity check: Ratio 0.26 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 38.80 with purity 0.16 time 1.38 plane 2
 - Vertex (109.65, -743.30, 523.58)
	*** 1st Sanity check: Ratio 0.30 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 620.94 with purity 0.16 time 1.26 plane 0
 - Vertex (-327.50, -324.57, 990.50)
	*** 1st Sanity check: Ratio 0.12 <= 1.00
	*** 2nd Sanity check: #OpHits 21 >= 21
OpFlash PE 36.25 with purity 0.00 time 1.33 plane 0
 - Vertex (-327.50, -220.64, 1360.24)
	*** 1st Sanity check: Ratio 0.30 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 41.79 with purity 0.30 time 0.94 plane 2
 - Vertex (93.26, -743.30, 1549.01)
	*** 1st Sanity check: Ratio 0.25 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 139.75 with purity 0.00 time 1.08 plane 2
 - Vertex (171.29, -743.30, 867.29)
	*** 1st Sanity check: Ratio 0.22 <= 1.00
	*** 2nd Sanity check: #OpHits 6 >= 6
OpFlash PE 135.16 with purity 0.45 time 1.40 plane 2
 - Vertex (126.27, -743.30, 1035.75)
	*** 1st Sanity check: Ratio 0.22 <= 1.00
	*** 2nd Sanity check: #OpHits 8 >= 8
OpFlash PE 52.89 with purity 0.00 time 1.22 plane 2
 - Vertex (230.77, -743.30, 748.10)
	*** 1st Sanity check: Ratio 0.48 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 137.69 with purity 0.30 time 1.68 plane 0
 - Vertex (-327.50, 10.27, 885.69)
	*** 1st Sanity check: Ratio 0.26 <= 1.00
	*** 2nd Sanity check: #OpHits 10 >= 10
OpFlash PE 186.19 with purity 0.26 time 1.51 plane 0
 - Vertex (-327.50, -406.99, 837.03)
	*** 1st Sanity check: Ratio 0.25 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 60.58 with purity 0.15 time 1.58 plane 0
 - Vertex (-327.50, 147.21, 491.76)
	*** 1st Sanity check: Ratio 0.20 <= 1.00
	*** 2nd Sanity check: #OpHits 6 >= 6
OpFlash PE 85.17 with purity 0.20 time 1.61 plane 0
 - Vertex (-327.50, -328.50, 1050.79)
	*** 1st Sanity check: Ratio 0.55 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 62.82 with purity 0.00 time 2.14 plane 0
 - Vertex (-327.50, -337.96, 728.20)
	*** 1st Sanity check: Ratio 0.67 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 28.38 with purity 0.00 time 2.08 plane 0
 - Vertex (-327.50, -236.34, 1363.36)
	*** 1st Sanity check: Ratio 0.48 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 128.22 with purity 0.20 time 2.35 plane 0
 - Vertex (-327.50, -541.81, 1053.22)
	*** 1st Sanity check: Ratio 0.36 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 57.74 with purity 0.00 time 2.32 plane 2
 - Vertex (90.11, -743.30, 748.10)
	*** 1st Sanity check: Ratio 0.40 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 57.70 with purity 0.00 time 2.41 plane 0
 - Vertex (-327.50, -632.80, 1079.94)
	*** 1st Sanity check: Ratio 0.65 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 38.29 with purity 0.08 time 2.65 plane 0
 - Vertex (-327.50, -367.97, 258.99)
	*** 1st Sanity check: Ratio 0.26 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 61.14 with purity 0.00 time 2.73 plane 0
 - Vertex (-327.50, 128.70, 1529.62)
	*** 1st Sanity check: Ratio 0.78 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  31-Jul-2025 09:05:33 UTC run: 5068 subRun: 0 event: 37970

# OpHits (ophit10ppm) in full geometry: 52868
# OpFlashes (solarflash) in full geometry: 4198
# Hits (gaushit) in each view: 6919, 6791, 6746, 0
# Cluster from the hits: 2825, 2873, 5672, 0
# Tracks (pmtracktc) in full geometry: 0
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  31-Jul-2025 09:56:44 UTC run: 5068 subRun: 0 event: 37970

# ClusterReco: Looping over 5661 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  31-Jul-2025 09:56:44 UTC run: 5068 subRun: 0 event: 37970
*** Matched preselection cluster: 2148
 - MainTrackID 132646
 - Gen 1 -> marley TPC 50
 - Purity 1.00 Hits 18
 - #AdjCl 22 ( 7 signal ):
    - Cluster 1775 at distance 73.95 with time 1389.00 and charge 88.42 in TPC 49 and hits 1
    - Cluster 1785 at distance 95.08 with time 1397.85 and charge 38.22 in TPC 41 and hits 1
    - Cluster 1848 at distance 66.07 with time 1440.95 and charge 44.87 in TPC 55 and hits 1
    - Cluster 1907 at distance 52.36 with time 1475.76 and charge 34.53 in TPC 54 and hits 1
    - Cluster 1910 at distance 74.09 with time 1477.13 and charge 53.21 in TPC 49 and hits 1
    - Cluster 1990 at distance 60.04 with time 1537.89 and charge 167.17 in TPC 49 and hits 2
    - Cluster 2013 at distance 80.73 with time 1552.57 and charge 35.36 in TPC 51 and hits 1
    - Cluster 2060 at distance 28.58 with time 1590.53 and charge 47.02 in TPC 50 and hits 1
    - Cluster 2097 at distance 25.05 with time 1615.73 and charge 540.23 in TPC 50 and hits 3
    - Cluster 2258 at distance 82.77 with time 1737.53 and charge 34.29 in TPC 41 and hits 1
    - Cluster 2268 at distance 96.67 with time 1742.32 and charge 95.32 in TPC 49 and hits 1
    - Cluster 2299 at distance 96.99 with time 1764.99 and charge 62.77 in TPC 49 and hits 1
    - Cluster 2357 at distance 27.31 with time 1801.88 and charge 89.62 in TPC 50 and hits 2
    - Cluster 2428 at distance 38.36 with time 1859.89 and charge 194.64 in TPC 50 and hits 2
    - Cluster 2515 at distance 44.55 with time 1921.25 and charge 47.88 in TPC 50 and hits 1
    - Cluster 2518 at distance 81.71 with time 1928.66 and charge 98.77 in TPC 50 and hits 1
    - Cluster 2527 at distance 49.82 with time 1933.80 and charge 105.18 in TPC 50 and hits 2
    - Cluster 2529 at distance 81.68 with time 1935.02 and charge 24.70 in TPC 49 and hits 1
    - Cluster 2647 at distance 64.67 with time 2026.33 and charge 50.29 in TPC 50 and hits 1
    - Cluster 2685 at distance 97.08 with time 2055.19 and charge 119.55 in TPC 50 and hits 2
    - Cluster 2788 at distance 77.09 with time 2121.77 and charge 35.99 in TPC 52 and hits 1
    - Cluster 2933 at distance 99.61 with time 2231.24 and charge 54.15 in TPC 53 and hits 2
 - RecoCol  Time,Y,Z ( 1651.96, -314.19, 934.79 )
 - RecoInd0 Time,Y,Z ( 1650.91, -314.30, 934.67 )
 - RecoInd1 Time,Y,Z ( 1649.88, -314.09, 972.23 )
*** Matched flash: 
 - Purity 0.00 Plane 0 #Hits 4 PE 794.09 MaxPE 267.24
 - Time 219.86 Fast 0.36 Residual 5224.62
 - Reco Time,Y,Z ( 219.86, -377.40, 1004.94 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 63.63, -312.56, 930.79 )
 - Reco X,Y,Z ( 95.09, -314.19, 934.79 )
%MSG
31-Jul-2025 09:56:45 UTC  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/49/5d/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T211530Z_gen_003797_supernova_g4stage1_g4stage2_detsim_reco.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          2757.06       4704.54       6541.2        4808.97       1214.35        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000659128   0.00274113    0.00981907    0.00125983    0.00346195       10     
end_path:solarnuana:SolarNuAna      2757.06       4704.54       6541.19       4808.97       1214.35        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 31-Jul-2025 09:56:45 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2502.71 MB
  Peak resident set size usage (VmHWM): 1785.97 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 46567.087762 Real = 47079.646812

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 2502.71 VmHWM = 1785.97

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2025-08-05 09:02:19 UTC       justIN version: 01.04.00