justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 274831.1@dunegpschedd01.fnal.gov

Jobsub ID274831.1@dunegpschedd01.fnal.gov
Workflow ID11694
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-11 17:23:02
SiteUS_BNL
EntryDUNE_US_BNL_spoolce02
Last heartbeat2026-01-12 11:41:49
From worker nodeHostnamespool0268.sdcc.bnl.gov
cpuinfoAMD EPYC 7351 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-12 07:49:56
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T025613Z_gen_002068_supernova_g4stage1_g4stage2_detsim_reco_20250731T104533Z_reco2.root
JobscriptExit code0
Real time3h (13893s)
CPU time3h (13562s = 97%)
Max RSS bytes2556014592 (2437 MiB)
Outputting started2026-01-12 11:41:30
Output files
Finished2026-01-12 11:41:49
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

4)	132838	132732
marley	2212		0.00	(-429.80, 530.35, 945.41)	132837	132732
marley	2212		0.00	(-426.69, 551.79, 939.04)	132836	132732
marley	1000060120	0.00	(-426.49, 552.10, 939.19)	132835	132732
marley	1000240520	0.00	(-425.04, 551.83, 938.87)	132834	132732
marley	1000180400	0.00	(-422.82, 555.01, 937.53)	132833	132732
marley	1000180400	0.00	(-400.22, 632.78, 952.09)	132832	132732
marley	1000180400	0.00	(-240.89, 566.95, 850.71)	132831	132732
marley	1000180400	0.00	(-242.82, 569.48, 849.59)	132830	132732
marley	1000180360	0.00	(-206.42, 472.24, 946.86)	132829	132732
marley	1000180400	0.00	(-176.29, 553.07, 862.99)	132828	132732
marley	1000180400	0.00	(-225.45, 547.96, 855.26)	132827	132732
marley	1000180400	0.00	(-87.25, 657.34, 1028.03)	132826	132732
marley	1000180400	0.00	(-87.56, 670.74, 1014.07)	132825	132732
marley	1000180400	0.00	(-94.31, 693.46, 1016.17)	132824	132732
marley	1000180400	0.00	(-135.86, 644.29, 1145.83)	132823	132732
marley	1000180360	0.00	(-39.87, 685.15, 1141.30)	132822	132732
marley	1000180400	0.00	(-7.87, 714.36, 1220.15)	132821	132732
marley	1000180360	0.00	(-3.04, 702.30, 1204.70)	132820	132732
marley	1000180400	0.00	(2.71, 692.64, 1217.97)	132819	132732
marley	1000180400	0.00	(-76.69, 362.52, 986.15)	132818	132732
marley	1000180400	0.00	(-107.95, 307.23, 1089.03)	132817	132732
marley	1000180400	0.00	(-110.14, 283.98, 1092.68)	132816	132732
marley	1000180400	0.00	(-114.85, 273.66, 1090.89)	132815	132732
marley	1000180360	0.00	(-83.11, 293.15, 982.58)	132814	132732
marley	1000180400	0.00	(90.38, 181.43, 828.91)	132813	132732
marley	1000180400	0.00	(102.97, 197.75, 841.80)	132812	132732
marley	1000180400	0.00	(190.67, 274.11, 829.32)	132811	132732
marley	1000180400	0.00	(200.03, 270.99, 815.09)	132810	132732
marley	1000180400	0.00	(132.06, 207.20, 848.57)	132809	132732
marley	1000180360	0.00	(19.51, 360.02, 563.48)	132808	132732
marley	1000180400	0.00	(-37.10, 414.60, 618.44)	132807	132732
marley	1000180360	0.00	(-22.70, 390.83, 542.84)	132806	132732
marley	1000180360	0.00	(-80.14, 418.20, 506.04)	132805	132732
marley	1000180360	0.00	(-61.22, 308.04, 541.00)	132804	132732
marley	1000180360	0.00	(-87.59, 78.66, 494.64)	132803	132732
marley	1000180360	0.00	(-115.27, 18.62, 516.87)	132802	132732
marley	1000180360	0.00	(-93.32, -88.12, 473.27)	132801	132732
marley	1000180360	0.00	(-102.56, -82.48, 474.52)	132800	132732
marley	1000180360	0.01	(-208.25, 107.64, 475.68)	132799	132732
marley	1000180400	0.00	(-223.27, 66.75, 450.21)	132798	132732
marley	1000180400	0.01	(-211.46, 66.70, 454.67)	132797	132732
marley	1000180400	0.00	(-221.12, 64.08, 447.16)	132796	132732
marley	1000180400	0.01	(-222.12, 63.06, 444.67)	132795	132732
marley	1000180400	0.00	(-220.55, 63.36, 446.00)	132794	132732
marley	1000180400	0.01	(-220.71, 66.16, 445.24)	132793	132732
marley	1000180400	0.00	(-213.49, 41.36, 447.61)	132792	132732
marley	1000180360	0.00	(-206.16, 30.52, 445.10)	132791	132732
marley	1000180400	0.01	(-209.30, 25.63, 442.87)	132790	132732
marley	1000180400	0.01	(-203.27, 28.02, 443.33)	132789	132732
marley	1000180400	0.00	(-203.09, 27.62, 443.12)	132788	132732
marley	1000180400	0.01	(-188.26, 20.40, 435.42)	132787	132732
marley	1000180400	0.01	(-224.52, 6.56, 463.45)	132786	132732
marley	1000180360	0.00	(-224.07, 7.21, 464.23)	132785	132732
marley	1000180400	0.01	(-191.82, 10.96, 480.10)	132784	132732
marley	1000180360	0.00	(-188.00, 5.02, 473.82)	132783	132732
marley	1000180400	0.00	(-193.00, -26.79, 445.20)	132782	132732
marley	1000180360	0.00	(-229.93, -49.15, 385.77)	132781	132732
marley	1000180400	0.01	(-269.93, -62.82, 389.16)	132780	132732
marley	1000180400	0.01	(-266.46, -45.63, 529.89)	132779	132732
marley	1000180400	0.00	(-184.74, -37.19, 517.59)	132778	132732
marley	1000180360	0.00	(-158.60, -36.02, 436.65)	132777	132732
marley	1000180400	0.01	(-150.50, -68.79, 391.08)	132776	132732
marley	1000180400	0.00	(-150.57, -69.05, 391.34)	132775	132732
marley	1000180400	0.01	(-147.67, -76.46, 397.96)	132774	132732
marley	1000180400	0.01	(-175.00, -80.98, 399.95)	132773	132732
marley	1000180400	0.01	(-176.20, -82.40, 405.39)	132772	132732
marley	1000180400	0.01	(-130.21, -98.99, 403.83)	132771	132732
marley	1000180400	0.02	(-129.61, -90.64, 403.61)	132770	132732
marley	1000180400	0.01	(-153.94, -97.71, 399.08)	132769	132732
marley	1000180400	0.03	(-153.62, -102.72, 396.46)	132768	132732
marley	1000180400	0.02	(-155.76, -95.45, 399.45)	132767	132732
marley	1000180360	0.02	(-182.68, -111.68, 399.94)	132766	132732
marley	1000180400	0.02	(-159.98, -136.16, 441.98)	132765	132732
marley	1000180400	0.00	(-159.66, -129.57, 444.26)	132764	132732
marley	1000180400	0.03	(-161.91, -109.13, 449.73)	132763	132732
marley	1000180400	0.02	(-158.73, -128.27, 453.66)	132762	132732
marley	1000180400	0.01	(-123.11, -82.89, 517.42)	132761	132732
marley	1000180400	0.00	(-122.86, -82.96, 517.71)	132760	132732
marley	1000180400	0.02	(-55.10, -84.20, 565.59)	132759	132732
marley	1000180400	0.00	(-67.40, -89.08, 577.11)	132758	132732
marley	1000180360	0.00	(-75.42, -91.75, 587.99)	132757	132732
marley	1000180400	0.02	(-79.22, -100.20, 599.78)	132756	132732
marley	22		1.46	(-81.35, -113.89, 590.07)	132734	132643
marley	1000180400	0.02	(-81.35, -113.89, 590.07)	132733	132643
marley	2112		0.43	(-81.35, -113.89, 590.07)	132732	132643
marley	1000180400	0.08	(-83.05, -120.94, 586.80)	132731	132643
marley	1000180400	0.02	(-87.28, -123.54, 590.96)	132730	132643
marley	1000180400	0.21	(-95.17, -124.01, 619.67)	132729	132643
marley	1000180400	0.00	(-94.54, -124.70, 617.25)	132728	132643
marley	22		0.00	(-84.90, -129.68, 600.83)	132649	132597
marley	22		1.37	(-84.90, -129.68, 600.83)	132648	132597
marley	22		0.57	(-84.90, -129.68, 600.83)	132647	132597
marley	22		1.43	(-84.90, -129.68, 600.83)	132646	132597
marley	22		1.46	(-84.90, -129.68, 600.83)	132645	132597
marley	1000180400	0.16	(-84.90, -129.68, 600.83)	132644	132597
marley	2112		2.22	(-84.90, -129.68, 600.83)	132643	132597
marley	22		3.03	(-84.44, -127.29, 599.05)	132599	0
marley	22		1.98	(-84.44, -127.29, 599.05)	132598	0
marley	2112		7.21	(-84.44, -127.29, 599.05)	132597	0
marley	1000190390	0.33	(-84.44, -127.29, 599.05)	132596	0
marley	11		48.11	(-84.44, -127.29, 599.05)	132595	0
Signal Track IDs: 132595; 132596; 132597; 132598; 132599; 132643; 132644; 132645; 132646; 132647; 132648; 132649; 132728; 132729; 132730; 132731; 132732; 132733; 132734; 132756; 132757; 132758; 132759; 132760; 132761; 132762; 132763; 132764; 132765; 132766; 132767; 132768; 132769; 132770; 132771; 132772; 132773; 132774; 132775; 132776; 132777; 132778; 132779; 132780; 132781; 132782; 132783; 132784; 132785; 132786; 132787; 132788; 132789; 132790; 132791; 132792; 132793; 132794; 132795; 132796; 132797; 132798; 132799; 132800; 132801; 132802; 132803; 132804; 132805; 132806; 132807; 132808; 132809; 132810; 132811; 132812; 132813; 132814; 132815; 132816; 132817; 132818; 132819; 132820; 132821; 132822; 132823; 132824; 132825; 132826; 132827; 132828; 132829; 132830; 132831; 132832; 132833; 132834; 132835; 132836; 132837; 132838; 132839; 132840; 132841; 132842; 132843; 132844; 132845; 132846; 132847; 132848; 132849; 132850; 132851; 132852; 132854; 132855; 132856; 132857; 132859; 132860; 132861; 132862; 132863; 132864; 132865; 132923; 132924; 
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  12-Jan-2026 06:41:28 EST run: 5019 subRun: 0 event: 20680

Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.

%MSG
12-Jan-2026 06:41:28 EST  Closed input file "root://dcdndoor.sdcc.bnl.gov:1094//pnfs/sdcc.bnl.gov/data/dune/RSE/fardet-vd/fd/d1/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T025613Z_gen_002068_supernova_g4stage1_g4stage2_detsim_reco_20250731T104533Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 12-Jan-2026 06:41:28 EST  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          1.32498       1379.7        3915.2        3.46048       1698.55        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000790003   0.00290026    0.00482954    0.00292847    0.00115614       10     
end_path:solarnuana:SolarNuAna      1.32182       1379.7        3915.2        3.45777       1698.55        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 12-Jan-2026 06:41:28 EST  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3178.09 MB
  Peak resident set size usage (VmHWM): 2556.01 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 13535.234993 Real = 13860.798625

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3178.09 VmHWM = 2556.01

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-04 06:00:39 UTC       justIN version: 01.06.00