justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258498.7@dunegpschedd02.fnal.gov

Jobsub ID258498.7@dunegpschedd02.fnal.gov
Workflow ID10955
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-06 11:05:54
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-06 20:59:10
From worker nodeHostnamedunegli-7832231-0-fnpc18004.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 11:07:00
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250124T143134Z_gen_000786_supernova_g4stage1_g4stage2_detsim_reco_20250701T175641Z_reco2.root
JobscriptExit code0
Real time9h (35512s)
CPU time9h (34791s = 97%)
Max RSS bytes2556272640 (2437 MiB)
Outputting started2025-12-06 20:58:53
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/10955/1/001/fdhd_ana_2025-12-06T_110740Z_hist.root
Finished2025-12-06 20:59:10
Saved logsjustin-logs:258498.7-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

49.04, 799.96)	133100	133097
marley	-12		0.65	(-29.37, -749.04, 799.96)	133099	133097
marley	1000190419	0.00	(-29.37, -749.04, 799.96)	133098	133097
marley	1000180410	0.00	(-29.37, -749.04, 799.96)	133097	132959
marley	22		1.70	(-29.37, -749.04, 799.96)	133096	132959
marley	22		1.95	(-29.37, -749.04, 799.96)	133095	132959
marley	22		2.98	(-29.37, -749.04, 799.96)	133094	132959
marley	22		1.95	(-29.37, -749.04, 799.96)	133093	132959
marley	22		2.98	(-29.37, -749.04, 799.96)	133092	132959
marley	22		1.55	(-29.37, -749.04, 799.96)	133091	132959
marley	22		2.15	(-29.37, -749.04, 799.96)	133090	132959
marley	22		2.48	(-29.37, -749.04, 799.96)	133089	132959
marley	22		3.30	(-29.37, -749.04, 799.96)	133088	132959
marley	2212		0.00	(74.59, -792.28, 888.18)	133023	132959
marley	2212		0.00	(71.21, -799.36, 902.81)	133022	132959
marley	2212		0.00	(68.47, -791.77, 910.97)	133021	132959
marley	2212		0.00	(65.31, -788.29, 913.26)	133020	132959
marley	2212		0.00	(67.16, -783.24, 918.82)	133019	132959
marley	1000080160	0.00	(61.91, -782.77, 928.18)	133018	132959
marley	2212		0.00	(72.91, -792.82, 967.77)	133016	132959
marley	2212		0.00	(83.58, -795.08, 974.55)	133015	132959
marley	2212		0.00	(84.78, -795.19, 974.73)	133014	132959
marley	1000060120	0.00	(89.64, -799.20, 979.43)	133013	132959
marley	1000060120	0.00	(104.75, -819.71, 970.26)	133012	132959
marley	2212		0.01	(104.23, -819.62, 970.57)	133011	132959
marley	1000060120	0.00	(102.54, -816.72, 974.95)	133010	132959
marley	2212		0.00	(83.02, -807.12, 995.17)	133009	132959
marley	2212		0.00	(69.80, -795.21, 1003.36)	133008	132959
marley	2212		0.01	(66.78, -790.17, 1008.69)	133007	132959
marley	1000060120	0.01	(65.22, -786.39, 1009.87)	133006	132959
marley	2212		0.05	(63.77, -788.30, 1008.93)	133005	132959
marley	1000070140	0.02	(73.59, -835.76, 999.44)	133004	132959
marley	1000070140	0.01	(73.19, -835.57, 999.22)	133003	132959
marley	1000070140	0.03	(73.19, -835.57, 999.22)	133002	132959
marley	1000070140	0.04	(72.80, -835.93, 995.82)	133001	132959
marley	1000070140	0.02	(74.86, -838.06, 997.54)	133000	132959
marley	1000080160	0.04	(75.03, -837.57, 1000.08)	132999	132959
marley	2212		0.01	(61.34, -807.53, 978.48)	132998	132959
marley	1000180400	0.01	(37.83, -744.48, 917.96)	132997	132959
marley	1000180400	0.03	(30.36, -743.89, 917.43)	132996	132959
marley	1000060120	0.08	(87.23, -767.82, 915.85)	132995	132959
marley	2212		0.13	(83.71, -770.61, 920.23)	132994	132959
marley	1000070140	0.13	(35.26, -792.22, 936.11)	132993	132959
marley	1000180400	0.02	(91.19, -693.41, 993.05)	132992	132959
marley	1000180400	0.06	(93.25, -694.82, 996.31)	132991	132959
marley	1000180360	0.09	(92.43, -696.54, 993.50)	132990	132959
marley	1000180400	0.07	(115.94, -648.18, 1067.59)	132989	132959
marley	1000180400	0.04	(117.08, -649.36, 1065.91)	132988	132959
marley	1000180400	0.06	(78.84, -719.40, 1083.18)	132987	132959
marley	1000180400	0.00	(90.34, -722.10, 1085.62)	132986	132959
marley	1000180400	0.01	(101.94, -729.00, 1089.74)	132985	132959
marley	1000180400	0.09	(105.25, -740.63, 1094.26)	132984	132959
marley	22		1.46	(117.14, -726.73, 1081.36)	132961	132912
marley	1000180400	0.12	(117.14, -726.73, 1081.36)	132960	132912
marley	2112		1.08	(117.14, -726.73, 1081.36)	132959	132912
marley	22		5.71	(108.41, -721.81, 1085.63)	132913	0
marley	2112		2.67	(108.41, -721.81, 1085.63)	132912	0
marley	1000190390	0.08	(108.41, -721.81, 1085.63)	132911	0
marley	11		8.58	(108.41, -721.81, 1085.63)	132910	0
Signal Track IDs: 132910; 132911; 132912; 132913; 132959; 132960; 132961; 132984; 132985; 132986; 132987; 132988; 132989; 132990; 132991; 132992; 132993; 132994; 132995; 132996; 132997; 132998; 132999; 133000; 133001; 133002; 133003; 133004; 133005; 133006; 133007; 133008; 133009; 133010; 133011; 133012; 133013; 133014; 133015; 133016; 133018; 133019; 133020; 133021; 133022; 133023; 133088; 133089; 133090; 133091; 133092; 133093; 133094; 133095; 133096; 133097; 133098; 133099; 133100; 133101; 133102; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  06-Dec-2025 19:43:25 UTC run: 4871 subRun: 0 event: 7860

Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  06-Dec-2025 19:45:03 UTC run: 4871 subRun: 0 event: 7860
OpFlash PE 5031.59 with purity 0.56 time 0.11 plane 2
 - Vertex (115.67, -743.30, 1045.94)
	*** 1st Sanity check: Ratio 0.22 <= 1.00
	*** 2nd Sanity check: #OpHits 29 >= 29
OpFlash PE 49.50 with purity 0.21 time 2.48 plane 0
 - Vertex (-327.50, -174.47, 1407.47)
	*** 1st Sanity check: Ratio 0.20 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 75.63 with purity 0.06 time 2.21 plane 2
 - Vertex (210.07, -743.30, 1939.46)
	*** 1st Sanity check: Ratio 0.30 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 61.62 with purity 0.34 time 3.03 plane 0
 - Vertex (-327.50, -233.42, 941.80)
	*** 1st Sanity check: Ratio 0.26 <= 1.00
	*** 2nd Sanity check: #OpHits 8 >= 8
OpFlash PE 24.94 with purity 0.10 time 6.23 plane 0
 - Vertex (-327.50, 334.75, 1332.78)
	*** 1st Sanity check: Ratio 0.36 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 18.41 with purity 0.25 time 2469.86 plane 4
 - Vertex (60.07, 220.00, -96.50)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 453.57 with purity 0.25 time 2471.54 plane 0
 - Vertex (-327.50, -206.70, 338.26)
	*** 1st Sanity check: Ratio 0.45 <= 1.00
	*** 2nd Sanity check: #OpHits 9 >= 9
OpFlash PE 16.55 with purity 0.22 time 2474.03 plane 4
 - Vertex (86.65, 220.00, -96.50)
	*** 1st Sanity check: Ratio 0.65 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 227.56 with purity 0.71 time 2474.03 plane 2
 - Vertex (60.07, -743.30, 748.10)
	*** 1st Sanity check: Ratio 0.30 <= 1.00
	*** 2nd Sanity check: #OpHits 13 >= 13
OpFlash PE 5.17 with purity 0.33 time 2474.92 plane 0
 - Vertex (-327.50, -42.00, 1600.62)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 5.19 with purity 0.67 time 2475.53 plane 1
 - Vertex (210.07, 743.30, 152.42)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 9.78 with purity 0.30 time 2475.57 plane 2
 - Vertex (184.46, -743.30, 285.61)
	*** 1st Sanity check: Ratio 0.55 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 43.00 with purity 0.21 time 2477.87 plane 0
 - Vertex (-327.50, -547.25, 408.29)
	*** 1st Sanity check: Ratio 0.62 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3

# of OpHits (ophit10ppm): 53339 for times between -4254.54 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 12329 for times between -4253.59 us and 295147919198126080.00 us.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  06-Dec-2025 19:45:07 UTC run: 4871 subRun: 0 event: 7860

# OpHits (ophit10ppm) in full geometry: 53339
# OpFlashes (solarflash) in full geometry: 12329
# Hits (gaushit) in each view: 6623, 6634, 6556, 0
# Cluster from the hits: 2748, 2832, 5640, 0
# Tracks (pmtracktc) in full geometry: 436
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  06-Dec-2025 20:58:52 UTC run: 4871 subRun: 0 event: 7860

# ClusterReco: Looping over 5632 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  06-Dec-2025 20:58:52 UTC run: 4871 subRun: 0 event: 7860
-----------------------------------------------------------------------------------------

%MSG
06-Dec-2025 20:58:52 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/2a/9b/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250124T143134Z_gen_000786_supernova_g4stage1_g4stage2_detsim_reco_20250701T175641Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 06-Dec-2025 20:58:52 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          1.65196       3517.59       7569.17       4730.48       3005.75        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00127351       12.56        63.1824     0.00812259      25.0576        10     
end_path:solarnuana:SolarNuAna      1.63637       3505.03       7569.15       4710.72       2997.55        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 06-Dec-2025 20:58:52 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3172.97 MB
  Peak resident set size usage (VmHWM): 2556.27 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 34760.531330 Real = 35450.537866

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3172.97 VmHWM = 2556.27

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-07 23:39:15 UTC       justIN version: 01.06.00