justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 294329.98@dunegpschedd01.fnal.gov

Jobsub ID294329.98@dunegpschedd01.fnal.gov
Workflow ID12015
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-20 15:08:43
SiteUS_FNAL-T1
EntryCMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat2026-01-20 23:41:37
From worker nodeHostnamedunegli-50386-0-cmswn2355.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-20 22:13:10
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T090457Z_gen_002880_supernova_g4stage1_g4stage2_detsim_reco_20250731T051118Z_reco2.root
JobscriptExit code0
Real time1h (5287s)
CPU time1h (5245s = 99%)
Max RSS bytes2544754688 (2426 MiB)
Outputting started2026-01-20 23:41:18
Output files
Finished2026-01-20 23:41:37
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0.00	(-260.42, -189.56, 459.16)	133335	133203
marley	1000180360	0.00	(-245.37, -87.25, 402.95)	133334	133203
marley	1000180360	0.00	(-234.68, -86.31, 412.37)	133333	133203
marley	1000180360	0.00	(-234.50, -86.35, 411.22)	133332	133203
marley	1000180360	0.00	(-248.84, -102.46, 426.39)	133331	133203
marley	1000180400	0.00	(-238.37, -95.16, 441.25)	133330	133203
marley	1000180360	0.00	(-243.85, -101.14, 441.00)	133329	133203
marley	1000180360	0.00	(-242.22, -101.92, 440.35)	133328	133203
marley	1000180360	0.00	(-251.16, -117.03, 470.14)	133326	133203
marley	1000180360	0.00	(-251.34, -116.68, 468.28)	133325	133203
marley	1000180360	0.00	(-243.92, -125.92, 470.19)	133324	133203
marley	1000180360	0.00	(-252.54, -98.96, 459.75)	133323	133203
marley	1000180400	0.00	(-251.31, -95.80, 460.32)	133322	133203
marley	1000180360	0.00	(-224.65, -105.80, 468.94)	133321	133203
marley	1000180360	0.00	(-231.85, -131.36, 461.70)	133320	133203
marley	1000180360	0.00	(-229.93, -141.81, 461.70)	133319	133203
marley	1000180360	0.00	(-245.65, -130.51, 457.75)	133318	133203
marley	1000180360	0.00	(-241.15, -129.73, 455.36)	133317	133203
marley	1000180400	0.00	(-246.97, -148.34, 449.01)	133316	133203
marley	1000180360	0.00	(-252.88, -154.69, 448.01)	133315	133203
marley	1000180360	0.00	(-253.12, -157.77, 449.96)	133314	133203
marley	1000180360	0.00	(-254.52, -150.10, 447.42)	133313	133203
marley	1000180400	0.00	(-222.71, -168.85, 494.89)	133312	133203
marley	1000180360	0.00	(-294.48, -192.57, 505.70)	133311	133203
marley	1000180400	0.00	(-295.39, -196.57, 509.36)	133310	133203
marley	1000180400	0.00	(-288.18, -192.57, 514.82)	133309	133203
marley	1000180400	0.00	(-276.67, -199.37, 498.53)	133308	133203
marley	2212		0.06	(-327.85, -163.64, 527.57)	133307	133203
marley	1000180400	0.00	(-293.32, -125.93, 597.34)	133306	133203
marley	1000180400	0.00	(-1.54, -21.40, 339.12)	133305	133203
marley	1000180400	0.00	(-3.28, -26.44, 336.09)	133304	133203
marley	1000180400	0.00	(-8.05, -35.58, 356.19)	133303	133203
marley	1000180400	0.01	(-8.11, -35.83, 355.95)	133302	133203
marley	1000180400	0.00	(-2.93, -36.49, 358.32)	133301	133203
marley	1000180400	0.00	(9.01, -26.48, 357.42)	133300	133203
marley	1000180400	0.00	(11.95, -26.35, 357.59)	133299	133203
marley	1000180400	0.00	(15.60, -27.83, 355.33)	133298	133203
marley	1000180400	0.00	(28.86, -30.92, 353.14)	133297	133203
marley	1000180360	0.00	(34.13, -40.21, 371.81)	133296	133203
marley	1000180400	0.00	(35.13, -41.04, 371.18)	133295	133203
marley	1000180400	0.01	(61.62, -65.72, 401.74)	133294	133203
marley	1000180400	0.01	(61.26, -65.89, 401.82)	133293	133203
marley	1000180400	0.01	(61.93, -66.07, 401.67)	133292	133203
marley	1000180400	0.01	(51.52, -67.94, 413.99)	133291	133203
marley	1000180400	0.01	(62.86, -31.52, 432.60)	133290	133203
marley	1000180360	0.01	(146.08, -43.26, 336.90)	133289	133203
marley	1000180400	0.01	(199.55, 73.03, 361.40)	133288	133203
marley	1000180400	0.00	(167.33, 48.91, 325.87)	133287	133203
marley	1000180360	0.01	(30.75, -38.72, 87.66)	133286	133203
marley	1000180400	0.01	(10.87, -32.98, 91.15)	133285	133203
marley	1000180400	0.01	(13.01, -29.38, 90.66)	133284	133203
marley	1000180400	0.01	(26.30, -43.80, 86.44)	133283	133203
marley	1000180400	0.01	(5.29, -64.60, 73.20)	133282	133203
marley	1000180400	0.02	(50.49, -53.59, 34.81)	133281	133203
marley	1000180400	0.01	(50.74, -53.60, 36.26)	133280	133203
marley	1000180400	0.02	(67.83, -51.70, 29.91)	133279	133203
marley	1000180400	0.01	(67.31, -52.36, 29.04)	133278	133203
marley	1000180400	0.03	(65.24, -51.44, 28.25)	133277	133203
marley	1000180400	0.00	(106.37, -80.72, 31.19)	133276	133203
marley	1000180400	0.03	(110.27, -82.16, 33.40)	133275	133203
marley	1000180400	0.00	(105.68, -83.26, 25.18)	133274	133203
marley	1000180400	0.00	(96.76, -81.92, 19.38)	133273	133203
marley	1000180400	0.00	(79.90, -87.09, 9.97)	133272	133203
marley	1000180400	0.02	(58.52, -90.03, -9.86)	133271	133203
marley	1000180400	0.00	(74.03, -82.83, -17.08)	133270	133203
marley	1000180400	0.02	(113.45, -86.96, -60.97)	133269	133203
marley	1000180400	0.00	(109.23, -58.19, -61.27)	133268	133203
marley	1000180360	0.02	(107.33, -54.41, -64.21)	133267	133203
marley	1000180400	0.01	(106.14, -52.47, -59.98)	133266	133203
marley	1000180400	0.03	(103.49, -56.94, -56.12)	133265	133203
marley	1000180400	0.04	(106.44, -69.10, -87.23)	133264	133203
marley	1000180400	0.04	(109.63, -61.65, -77.41)	133263	133203
marley	1000180400	0.03	(125.81, -191.79, -51.45)	133262	133203
marley	1000180400	0.04	(136.50, -189.14, -51.28)	133261	133203
marley	1000180400	0.02	(135.47, -197.88, -48.38)	133260	133203
marley	1000180400	0.01	(139.56, -199.76, -49.16)	133259	133203
marley	1000180400	0.06	(141.76, -202.20, -52.85)	133258	133203
marley	1000180400	0.00	(142.30, -198.93, -46.57)	133257	133203
marley	1000180400	0.00	(139.92, -193.97, -40.60)	133256	133203
marley	1000180400	0.01	(135.62, -103.01, 11.33)	133255	133203
marley	1000180400	0.01	(94.48, -78.60, 33.24)	133254	133203
marley	1000180400	0.02	(87.04, -63.45, 28.43)	133253	133203
marley	1000180400	0.03	(97.28, -53.58, 18.05)	133252	133203
marley	1000180400	0.01	(119.98, -48.94, 34.88)	133251	133203
marley	1000180400	0.07	(132.47, -25.14, 78.93)	133250	133203
marley	1000180400	0.08	(124.90, -19.44, 63.99)	133249	133203
marley	1000180400	0.02	(135.96, -14.98, 89.75)	133248	133203
marley	1000180400	0.10	(145.49, -17.46, 91.46)	133247	133203
marley	1000180400	0.00	(138.72, -13.51, 87.86)	133246	133203
marley	1000180400	0.02	(136.51, -12.22, 85.17)	133245	133203
marley	1000180400	0.01	(136.41, -9.38, 84.00)	133244	133203
marley	1000180400	0.08	(125.54, 4.08, 78.37)	133243	133203
marley	1000180400	0.00	(122.81, 0.49, 113.75)	133242	133203
marley	1000180400	0.01	(112.57, -0.93, 133.55)	133241	133203
marley	1000180400	0.01	(105.46, -14.51, 146.76)	133240	133203
marley	1000180400	0.00	(90.21, -30.91, 151.93)	133239	133203
marley	1000180400	0.06	(89.21, -31.92, 152.94)	133238	133203
marley	22		2.52	(71.99, -20.29, 150.31)	133204	0
marley	2112		1.26	(71.99, -20.29, 150.31)	133203	0
marley	1000190390	0.02	(71.99, -20.29, 150.31)	133202	0
marley	11		24.40	(71.99, -20.29, 150.31)	133201	0
Signal Track IDs: 133201; 133202; 133203; 133204; 133238; 133239; 133240; 133241; 133242; 133243; 133244; 133245; 133246; 133247; 133248; 133249; 133250; 133251; 133252; 133253; 133254; 133255; 133256; 133257; 133258; 133259; 133260; 133261; 133262; 133263; 133264; 133265; 133266; 133267; 133268; 133269; 133270; 133271; 133272; 133273; 133274; 133275; 133276; 133277; 133278; 133279; 133280; 133281; 133282; 133283; 133284; 133285; 133286; 133287; 133288; 133289; 133290; 133291; 133292; 133293; 133294; 133295; 133296; 133297; 133298; 133299; 133300; 133301; 133302; 133303; 133304; 133305; 133306; 133307; 133308; 133309; 133310; 133311; 133312; 133313; 133314; 133315; 133316; 133317; 133318; 133319; 133320; 133321; 133322; 133323; 133324; 133325; 133326; 133328; 133329; 133330; 133331; 133332; 133333; 133334; 133335; 133339; 133340; 133341; 133342; 133343; 133344; 133345; 133347; 133348; 133349; 133350; 133352; 133353; 133355; 133356; 133357; 133358; 133359; 133363; 133366; 133368; 133371; 133375; 133441; 133442; 133443; 133444; 133445; 133446; 133448; 133449; 133450; 133451; 133452; 
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  20-Jan-2026 23:41:16 UTC run: 5021 subRun: 0 event: 28800

Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.

%MSG
20-Jan-2026 23:41:17 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/2b/1c/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T090457Z_gen_002880_supernova_g4stage1_g4stage2_detsim_reco_20250731T051118Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 20-Jan-2026 23:41:17 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          2.25111       517.377       5143.06       2.76599       1541.89        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00127022    0.00929215     0.0177698    0.00861436    0.00735028       10     
end_path:solarnuana:SolarNuAna      2.24808       517.367       5143.04       2.75674       1541.89        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 20-Jan-2026 23:41:17 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3170.43 MB
  Peak resident set size usage (VmHWM): 2544.75 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 5197.166958 Real = 5236.064216

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3170.43 VmHWM = 2544.75

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-04 07:38:20 UTC       justIN version: 01.06.00