justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 46460.2@dunegpschedd01.fnal.gov

Jobsub ID46460.2@dunegpschedd01.fnal.gov
Workflow ID2589
Stage ID1
User namesmanthey@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-09-14 23:38:59
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-09-15 00:02:53
From worker nodeHostnamedunegli-6866713-0-fnpc17117.fnal.gov
cpuinfoIntel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-14 23:39:48
Input filesfardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250207T154606Z_gen_000065_supernova_g4_detsim_reco_20250724T112915Z_reco2.root
JobscriptExit code0
Real time22m (1371s)
CPU time22m (1352s = 98%)
Max RSS bytes922521600 (879 MiB)
Outputting started2025-09-15 00:02:39
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dune10kt_1x2x6_centralAPA/fnal/02589/1/001/fdhd_ana_2025-09-14T_233955Z_hist.root
Finished2025-09-15 00:02:53
Saved logsjustin-logs:46460.2-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

33050	33026
marley	2212		0.00	(381.89, -425.90, 620.99)	33048	33026
marley	1000260560	0.00	(379.93, -425.38, 620.27)	33047	33026
marley	1000080160	0.00	(389.08, -432.21, 620.84)	33046	33026
marley	2212		0.01	(389.08, -432.18, 620.79)	33045	33026
marley	2212		0.01	(392.70, -432.37, 619.72)	33044	33026
marley	2212		0.02	(406.96, -419.62, 623.80)	33043	33026
marley	1000060120	0.01	(407.34, -414.10, 624.05)	33042	33026
marley	2212		0.15	(402.27, -463.29, 647.80)	33041	33026
marley	1000260570	0.00	(379.06, -470.98, 656.05)	33028	32976
marley	22		0.01	(379.06, -470.98, 656.05)	33027	32976
marley	2112		0.20	(379.06, -470.98, 656.05)	33026	32976
marley	1000180400	0.00	(351.67, -494.03, 677.71)	33025	32976
marley	1000180400	0.00	(350.67, -498.69, 677.30)	33024	32976
marley	1000180400	0.01	(347.93, -502.67, 671.58)	33023	32976
marley	1000180400	0.00	(289.14, -465.63, 685.91)	33022	32976
marley	1000180400	0.01	(235.51, -408.69, 659.63)	33021	32976
marley	1000180400	0.00	(273.71, -367.86, 466.77)	33020	32976
marley	1000180400	0.01	(273.97, -367.60, 466.26)	33019	32976
marley	1000180400	0.02	(274.59, -366.61, 466.25)	33018	32976
marley	1000180400	0.03	(282.90, -373.75, 464.21)	33017	32976
marley	1000180400	0.03	(269.74, -370.77, 466.70)	33016	32976
marley	1000180400	0.02	(285.39, -373.69, 436.42)	33015	32976
marley	1000180360	0.02	(285.29, -378.68, 439.16)	33014	32976
marley	1000180360	0.03	(306.44, -380.72, 442.89)	33013	32976
marley	1000180360	0.00	(295.19, -353.79, 468.91)	33012	32976
marley	1000180400	0.02	(276.96, -323.53, 482.47)	33011	32976
marley	1000180360	0.03	(237.89, -373.41, 503.52)	33010	32976
marley	1000180400	0.04	(236.84, -334.17, 528.04)	33009	32976
marley	1000180400	0.02	(239.71, -356.02, 531.92)	33008	32976
marley	1000180400	0.02	(314.01, -362.27, 561.40)	33007	32976
marley	1000180400	0.03	(313.58, -362.41, 563.26)	33006	32976
marley	1000180400	0.05	(328.44, -370.79, 565.29)	33005	32976
marley	1000180400	0.01	(316.89, -351.75, 551.58)	33004	32976
marley	1000180400	0.06	(309.06, -348.40, 540.28)	33003	32976
marley	22		0.00	(291.72, -411.81, 664.03)	32980	32917
marley	22		0.00	(291.72, -411.81, 664.03)	32979	32917
marley	22		4.47	(291.72, -411.81, 664.03)	32978	32917
marley	1000180400	0.21	(291.72, -411.81, 664.03)	32977	32917
marley	2112		0.67	(291.72, -411.81, 664.03)	32976	32917
marley	22		2.51	(296.55, -400.70, 661.69)	32919	0
marley	22		4.97	(296.55, -400.70, 661.69)	32918	0
marley	2112		5.36	(296.55, -400.70, 661.69)	32917	0
marley	1000190390	0.36	(296.55, -400.70, 661.69)	32916	0
marley	11		21.96	(296.55, -400.70, 661.69)	32915	0
Signal Track IDs: 32915; 32916; 32917; 32918; 32919; 32976; 32977; 32978; 32979; 32980; 33003; 33004; 33005; 33006; 33007; 33008; 33009; 33010; 33011; 33012; 33013; 33014; 33015; 33016; 33017; 33018; 33019; 33020; 33021; 33022; 33023; 33024; 33025; 33026; 33027; 33028; 33041; 33042; 33043; 33044; 33045; 33046; 33047; 33048; 33050; 33056; 33057; 33058; 33059; 33060; 33061; 33062; 33063; 33064; 33065; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Sep-2025 00:02:20 UTC run: 5092 subRun: 0 event: 3250
OpFlash PE 93.18 with purity 0.28 time -0.22 plane 0
 - Vertex (-0.05, -155.68, 427.91)
	*** 1st Sanity check: Ratio 0.84 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 24.30 with purity 0.04 time -0.06 plane 1
 - Vertex (0.05, 314.58, 1145.71)
	*** 1st Sanity check: Ratio 0.16 <= 1.00
	*** 2nd Sanity check: #OpHits 10 >= 10
OpFlash PE 416.40 with purity 0.78 time 0.00 plane 0
 - Vertex (-0.05, -548.09, 606.00)
	*** 1st Sanity check: Ratio 0.10 <= 1.00
	*** 2nd Sanity check: #OpHits 120 >= 120
OpFlash PE 122.19 with purity 0.06 time 0.03 plane 1
 - Vertex (0.05, 444.07, 620.26)
	*** 1st Sanity check: Ratio 0.10 <= 1.00
	*** 2nd Sanity check: #OpHits 44 >= 44
OpFlash PE 53.55 with purity 0.22 time 0.10 plane 0
 - Vertex (-0.05, -31.14, 548.70)
	*** 1st Sanity check: Ratio 0.28 <= 1.00
	*** 2nd Sanity check: #OpHits 21 >= 21
OpFlash PE 74.94 with purity 0.48 time 0.10 plane 0
 - Vertex (-0.05, -561.30, 632.31)
	*** 1st Sanity check: Ratio 0.46 <= 1.00
	*** 2nd Sanity check: #OpHits 16 >= 16
OpFlash PE 15.67 with purity 0.34 time 4.04 plane 1
 - Vertex (0.05, 292.97, 552.02)
	*** 1st Sanity check: Ratio 0.13 <= 1.00
	*** 2nd Sanity check: #OpHits 8 >= 8
OpFlash PE 59.62 with purity 0.54 time 4.04 plane 0
 - Vertex (-0.05, -167.86, 787.30)
	*** 1st Sanity check: Ratio 0.13 <= 1.00
	*** 2nd Sanity check: #OpHits 24 >= 24
OpFlash PE 18.50 with purity 0.69 time 4.08 plane 0
 - Vertex (-0.05, -529.30, 427.91)
	*** 1st Sanity check: Ratio 0.41 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7

# of OpFlashes (solarflash) in full geometry: 1565

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Sep-2025 00:02:20 UTC run: 5092 subRun: 0 event: 3250

# OpHits (ophitspe) in full geometry: 70318
# OpFlashes (solarflash) in full geometry: 1565
# Hits (hitfd) in each view: 215, 210, 455, 0
# Cluster from the hits: 126, 123, 412, 0
# Tracks (pmtracktc) in full geometry: 2
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Sep-2025 00:02:37 UTC run: 5092 subRun: 0 event: 3250

# ClusterReco: Looping over 245 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Sep-2025 00:02:37 UTC run: 5092 subRun: 0 event: 3250
*** Matched preselection cluster: 183
 - MainTrackID 32915
 - Gen 1 -> marley TPC 9
 - Purity 1.00 Hits 7
 - Charge 2059.54 ( MaxHit 580.04 )
 - #AdjCl 5 ( 5 signal ):
    - Cluster 146 at distance 76.14 with time 1606.49 and charge 191.80 in TPC 9 and hits 2
    - Cluster 173 at distance 46.07 with time 1784.24 and charge 466.43 in TPC 9 and hits 3
    - Cluster 186 at distance 16.06 with time 1850.92 and charge 310.37 in TPC 9 and hits 2
    - Cluster 190 at distance 28.77 with time 1937.85 and charge 487.24 in TPC 9 and hits 2
    - Cluster 209 at distance 77.86 with time 2283.53 and charge 164.95 in TPC 9 and hits 1
 - RecoCol  Time,Y,Z ( 1823.57, -403.82, 660.75 )
 - RecoInd0 Time,Y,Z ( 1824.01, -403.78, 607.55 )
 - RecoInd1 Time,Y,Z ( 1823.44, -403.86, 580.10 )
*** Matched flash: 
 - Purity 0.00 Plane 0 #Hits 27 PE 118.77 MaxPE 32.76
 - Time -29.65 Fast 0.78 Residual 552.27
 - Reco Time,Y,Z ( -29.65, -366.90, 645.13 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 296.55, -400.70, 661.69 )
 - Main X,Y,Z ( 293.71, -404.23, 659.68 )
 - EDep X,Y,Z ( 296.61, -402.57, 661.28 )
 - Reco X,Y,Z ( -297.56, -403.82, 660.75 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Sep-2025 00:02:37 UTC run: 5092 subRun: 0 event: 3250
*** Matched preselection cluster: 218
 - MainTrackID 33056
 - Gen 1 -> marley TPC 9
 - Purity 1.00 Hits 1
 - Charge 241.85 ( MaxHit 241.85 )
 - #AdjCl 3 ( 3 signal ):
    - Cluster 209 at distance 82.70 with time 2283.53 and charge 164.95 in TPC 9 and hits 1
    - Cluster 219 at distance 34.67 with time 2480.22 and charge 139.31 in TPC 9 and hits 2
    - Cluster 222 at distance 34.51 with time 2486.01 and charge 100.05 in TPC 9 and hits 1
 - RecoCol  Time,Y,Z ( 2409.77, -495.78, 657.46 )
 - RecoInd0 Time,Y,Z ( 2409.75, -495.90, 639.01 )
 - RecoInd1 Time,Y,Z ( 2409.77, -495.66, 580.10 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 296.55, -400.70, 661.69 )
 - Main X,Y,Z ( 291.72, -411.81, 664.03 )
 - EDep X,Y,Z ( 349.62, -495.72, 657.50 )
 - Reco X,Y,Z ( -1000000.00, -495.78, 657.46 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Sep-2025 00:02:37 UTC run: 5092 subRun: 0 event: 3250
-----------------------------------------------------------------------------------------

%MSG
15-Sep-2025 00:02:37 UTC  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/63/c9/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250207T154606Z_gen_000065_supernova_g4_detsim_reco_20250724T112915Z_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          23.0855       26.0576       31.2354       25.8496       1.72715        50     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00140076    0.00627188     0.0254326     0.0019051    0.00707801       50     
end_path:solarnuana:SolarNuAna      23.0739       26.0511       31.2096       25.8435       1.72467        50     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 15-Sep-2025 00:02:37 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1553.3 MB
  Peak resident set size usage (VmHWM): 905.077 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 50 passed = 50 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         50         50          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1322.608217 Real = 1337.689016

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1553.3 VmHWM = 905.077

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2025-09-19 09:29:07 UTC       justIN version: 01.05.00