justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 252577.3@dunegpschedd02.fnal.gov

Jobsub ID252577.3@dunegpschedd02.fnal.gov
Workflow ID10693
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-26 03:51:06
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-11-26 12:32:00
From worker nodeHostnamedunegli-7738144-0-fnpc18002.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-26 03:52:18
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T123113Z_gen_001670_supernova_g4stage1_g4stage2_detsim_reco_20250730T174937Z_reco2.root
JobscriptExit code0
Real time8h (31157s)
CPU time8h (30993s = 99%)
Max RSS bytes2559115264 (2440 MiB)
Outputting started2025-11-26 12:31:36
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/10693/1/001/fdhd_ana_2025-11-26T_035239Z_hist.root
Finished2025-11-26 12:32:00
Saved logsjustin-logs:252577.3-dunegpschedd02.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

.22)	132944	132907
marley	2212		0.00	(-329.60, -333.03, 1250.67)	132938	132907
marley	2212		0.00	(-328.68, -334.08, 1249.52)	132936	132907
marley	2212		0.00	(-327.74, -333.84, 1249.25)	132935	132907
marley	2212		0.00	(-327.76, -333.69, 1249.19)	132934	132907
marley	2212		0.01	(-326.76, -333.03, 1247.70)	132933	132907
marley	2212		0.03	(-326.48, -333.23, 1247.45)	132932	132907
marley	2212		0.01	(-326.89, -333.57, 1244.86)	132931	132907
marley	1000140280	0.01	(-326.61, -334.00, 1243.64)	132930	132907
marley	1000180360	0.00	(-36.46, 137.29, 1495.71)	132929	132907
marley	1000180400	0.00	(-30.57, 138.00, 1491.68)	132928	132907
marley	1000180360	0.00	(-18.59, 67.28, 1485.02)	132927	132907
marley	1000180400	0.00	(-19.20, 65.42, 1486.83)	132926	132907
marley	1000180400	0.00	(-28.93, 63.37, 1490.00)	132925	132907
marley	1000180400	0.00	(-30.93, 56.70, 1493.75)	132924	132907
marley	1000180400	0.00	(-31.12, 56.73, 1493.66)	132923	132907
marley	1000180400	0.00	(-31.45, 56.62, 1493.53)	132922	132907
marley	1000180400	0.01	(-30.86, 53.88, 1495.67)	132921	132907
marley	1000180360	0.00	(-31.29, 54.20, 1495.96)	132920	132907
marley	1000180360	0.00	(-45.91, 55.95, 1495.59)	132919	132907
marley	1000180400	0.00	(-47.43, 55.90, 1494.90)	132918	132907
marley	1000180400	0.00	(-65.05, 32.68, 1503.69)	132917	132907
marley	1000180400	0.00	(-93.64, 36.01, 1479.95)	132916	132907
marley	1000180400	0.01	(-93.73, 35.97, 1479.96)	132915	132907
marley	1000180400	0.00	(-91.96, 38.48, 1465.19)	132914	132907
marley	1000180400	0.01	(-91.36, 38.47, 1465.06)	132913	132907
marley	1000180400	0.01	(-95.14, 34.82, 1467.63)	132912	132907
marley	1000180400	0.00	(-81.50, 18.82, 1439.33)	132911	132907
marley	1000180400	0.01	(-23.45, -11.44, 1401.41)	132910	132907
marley	1000180400	0.01	(-28.23, 48.37, 1481.32)	132909	132907
marley	1000180400	0.01	(-26.91, 48.47, 1481.16)	132908	132907
marley	2112		0.15	(-41.15, 62.88, 1482.33)	132907	0
marley	1000190390	0.01	(-41.15, 62.88, 1482.33)	132906	0
marley	11		7.79	(-41.15, 62.88, 1482.33)	132905	0
Signal Track IDs: 132905; 132906; 132907; 132908; 132909; 132910; 132911; 132912; 132913; 132914; 132915; 132916; 132917; 132918; 132919; 132920; 132921; 132922; 132923; 132924; 132925; 132926; 132927; 132928; 132929; 132930; 132931; 132932; 132933; 132934; 132935; 132936; 132938; 132944; 132945; 132946; 132947; 132948; 132949; 132952; 132953; 132954; 132955; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Nov-2025 11:37:44 UTC run: 4962 subRun: 0 event: 16700

Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Nov-2025 11:39:17 UTC run: 4962 subRun: 0 event: 16700
OpFlash PE 178.93 with purity 0.28 time -0.82 plane 3
 - Vertex (285.07, -220.00, 2188.38)
	*** 1st Sanity check: Ratio 0.62 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 167.64 with purity 0.07 time 0.39 plane 0
 - Vertex (-327.50, 149.44, 1307.90)
	*** 1st Sanity check: Ratio 0.14 <= 1.00
	*** 2nd Sanity check: #OpHits 12 >= 12
OpFlash PE 31.18 with purity 0.50 time 1.47 plane 1
 - Vertex (285.07, 743.30, 1641.62)
	*** 1st Sanity check: Ratio 0.25 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 21.14 with purity 0.28 time 0.87 plane 0
 - Vertex (-327.50, -215.81, 478.34)
	*** 1st Sanity check: Ratio 0.28 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 18.24 with purity 0.62 time 4.19 plane 0
 - Vertex (-327.50, -429.76, 917.29)
	*** 1st Sanity check: Ratio 0.58 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 579.92 with purity 0.23 time 83.15 plane 2
 - Vertex (135.07, -743.30, 1343.78)
	*** 1st Sanity check: Ratio 0.32 <= 1.00
	*** 2nd Sanity check: #OpHits 11 >= 11
OpFlash PE 13.93 with purity 0.12 time 85.92 plane 3
 - Vertex (60.07, -220.00, 2188.38)
	*** 1st Sanity check: Ratio 0.51 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 370.75 with purity 0.70 time 86.35 plane 0
 - Vertex (-327.50, -377.40, 1302.78)
	*** 1st Sanity check: Ratio 0.19 <= 1.00
	*** 2nd Sanity check: #OpHits 24 >= 24
OpFlash PE 6.69 with purity 0.40 time 87.82 plane 0
 - Vertex (-327.50, 373.40, 1079.94)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 10.84 with purity 0.66 time 88.82 plane 2
 - Vertex (135.07, -743.30, 1180.59)
	*** 1st Sanity check: Ratio 0.55 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2

# of OpHits (ophit10ppm): 53023 for times between -4254.36 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 12369 for times between -4253.81 us and 295147919198126080.00 us.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Nov-2025 11:39:20 UTC run: 4962 subRun: 0 event: 16700

# OpHits (ophit10ppm) in full geometry: 53023
# OpFlashes (solarflash) in full geometry: 12369
# Hits (gaushit) in each view: 6607, 6691, 6639, 0
# Cluster from the hits: 2766, 2860, 5654, 0
# Tracks (pmtracktc) in full geometry: 435
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Nov-2025 12:31:33 UTC run: 4962 subRun: 0 event: 16700

# ClusterReco: Looping over 5652 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Nov-2025 12:31:33 UTC run: 4962 subRun: 0 event: 16700
*** Matched preselection cluster: 2983 from 5652
 - MainTrackID 132905
 - Gen 1 -> marley TPC 76
 - Purity 1.00 Hits 6
 - Charge 863.74 ( MaxHit 218.51 )
 - #AdjCl 13 ( 0 signal ):
    - Cluster 2192 at distance 98.73 with time 1674.43 and charge 24.80 in TPC 80 and hits 1
    - Cluster 2337 at distance 87.26 with time 1784.29 and charge 43.05 in TPC 76 and hits 1
    - Cluster 2642 at distance 54.98 with time 1998.51 and charge 38.11 in TPC 72 and hits 1
    - Cluster 2712 at distance 43.53 with time 2046.65 and charge 91.04 in TPC 76 and hits 1
    - Cluster 2903 at distance 95.33 with time 2205.07 and charge 43.73 in TPC 72 and hits 1
    - Cluster 2905 at distance 48.06 with time 2207.26 and charge 47.03 in TPC 78 and hits 2
    - Cluster 2957 at distance 97.98 with time 2255.72 and charge 129.46 in TPC 84 and hits 1
    - Cluster 2958 at distance 58.15 with time 2256.19 and charge 63.65 in TPC 84 and hits 1
    - Cluster 3127 at distance 62.15 with time 2386.13 and charge 30.61 in TPC 74 and hits 1
    - Cluster 3158 at distance 54.41 with time 2410.98 and charge 74.72 in TPC 74 and hits 2
    - Cluster 3224 at distance 77.74 with time 2467.84 and charge 28.60 in TPC 76 and hits 1
    - Cluster 3533 at distance 86.74 with time 2689.62 and charge 25.64 in TPC 80 and hits 1
    - Cluster 3731 at distance 96.66 with time 2845.91 and charge 57.85 in TPC 80 and hits 1
 - RecoCol  Time,Y,Z ( 2281.85, 62.06, 1483.79 )
 - RecoInd0 Time,Y,Z ( 2281.78, 62.06, 1419.24 )
 - RecoInd1 Time,Y,Z ( 2281.83, 62.06, 1435.37 )
*** Matched flash: 7716 from 12369
 - Purity 0.00 % Plane 0 #Hits 19 PE 143.52 MainOpHitPE 15.14
 - Time 1050.50 (us) Fast 20.59 % Residual 1166.90
 - Reco Time,Y,Z ( 1050.50, 101.04, 1538.13 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -41.15, 62.88, 1482.33 )
 - Main X,Y,Z ( -41.69, 61.50, 1484.69 )
 - EDep X,Y,Z ( -41.23, 62.22, 1483.56 )
 - Reco X,Y,Z ( 127.33, 62.06, 1483.79 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Nov-2025 12:31:33 UTC run: 4962 subRun: 0 event: 16700
-----------------------------------------------------------------------------------------

%MSG
26-Nov-2025 12:31:35 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/5b/1a/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T123113Z_gen_001670_supernova_g4stage1_g4stage2_detsim_reco_20250730T174937Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 26-Nov-2025 12:31:35 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          1.07739       3105.66       5013.64       3337.94        1681          10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00178071     0.0142044     0.0405086     0.0118575     0.0125394       10     
end_path:solarnuana:SolarNuAna      1.07519       3105.65       5013.62       3337.93        1681          10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 26-Nov-2025 12:31:35 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3168.95 MB
  Peak resident set size usage (VmHWM): 2559.12 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 30967.161072 Real = 31119.878156

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3168.95 VmHWM = 2559.12

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-08 12:10:34 UTC       justIN version: 01.06.00