justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 241546.40@dunegpschedd02.fnal.gov

Jobsub ID241546.40@dunegpschedd02.fnal.gov
Workflow ID9936
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-11 21:35:26
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-11-11 22:55:48
From worker nodeHostnamedunegli-7727016-0-fnpc23034.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statestalled
Started2025-11-11 22:15:48
Input filesfardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250206T120232Z_gen_002318_supernova_g4_detsim_reco_20250724T021741Z_reco2.root
Outputting started2025-11-11 22:22:40
Output files
Finished2025-11-11 23:38:05
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

]:	2244.44
Fiducial Volume in [cm]:759.89, 1357.70, 1746.48
###################################################
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Nov-2025 22:22:40 UTC run: 5082 subRun: 0 event: 115900

There are a total of 32984 Particles in the event

# of particles 75	from gen 1 marley
# of particles 10896	from gen 2 Ar39GenInLAr
# of particles 1245	from gen 3 Kr85GenInLAr
# of particles 2	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 8	from gen 6 Rn222ChainRn222GenInLAr
# of particles 5	from gen 7 Rn222ChainPo218GenInLAr
# of particles 19	from gen 8 Rn222ChainPb214GenInLAr
# of particles 3	from gen 9 Rn222ChainBi214GenInLAr
# of particles 0	from gen 10 Rn222ChainPb210GenInLAr
# of particles 6	from gen 11 Rn220ChainPb212GenInLAr
# of particles 17	from gen 12 K40GenInCPA
# of particles 241	from gen 13 U238ChainGenInCPA
# of particles 309	from gen 14 Th232ChainGenInCPA
# of particles 3	from gen 15 K42From42ArGenInCPA
# of particles 3	from gen 16 Rn222ChainPo218GenInCPA
# of particles 31	from gen 17 Rn222ChainPb214GenInCPA
# of particles 50	from gen 18 Rn222ChainBi214GenInCPA
# of particles 25	from gen 19 Rn222ChainPb210GenInCPA
# of particles 34	from gen 20 Rn222ChainFromBi210GenInCPA
# of particles 33	from gen 21 Rn220ChainFromPb212GenInCPA
# of particles 9	from gen 22 Co60GenInAPA
# of particles 2	from gen 23 U238ChainGenInAPA
# of particles 3	from gen 24 Th232ChainGenInAPA
# of particles 42	from gen 25 U238Th232K40GenInLArAPAboards1x2x6
# of particles 0	from gen 26 Rn222ChainGenInPDS
# of particles 19159	from gen 27 CavernwallGammasAtLAr1x2x6lowBgAPA
# of particles 764	from gen 28 foamGammasAtLAr1x2x6lowBgAPA
# of particles 0	from gen 29 CavernwallNeutronsAtLAr1x2x6lowBgAPA
# of particles 0	from gen 30 CryostatNGammasAtLAr1x2x6lowBgAPA
# of particles 0	from gen 31 CavernNGammasAtLAr1x2x6lowBgAPA
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Nov-2025 22:22:40 UTC run: 5082 subRun: 0 event: 115900

Number of Signal Particles: 6
Neutrino Interaction: -1
Neutrino Energy: 61.69 MeV
Position (145.53, -589.63, 853.06) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	22		7.65	(-93.66, -781.60, 912.15)	33077	32971
marley	1000260570	0.00	(-93.66, -781.60, 912.15)	33076	32971
marley	2212		0.00	(105.30, -731.51, 945.42)	33054	32971
marley	2212		0.00	(51.11, -732.73, 981.58)	33050	32971
marley	2212		0.00	(48.41, -710.00, 974.17)	33049	32971
marley	2212		0.00	(40.49, -696.51, 973.73)	33048	32971
marley	2212		0.00	(41.07, -692.28, 973.64)	33047	32971
marley	2212		0.00	(61.72, -685.61, 973.27)	33046	32971
marley	2212		0.00	(64.83, -680.22, 974.64)	33045	32971
marley	2212		0.00	(65.96, -678.69, 975.64)	33044	32971
marley	2212		0.01	(67.27, -676.89, 975.77)	33043	32971
marley	2212		0.05	(66.66, -658.63, 972.70)	33042	32971
marley	1000180400	0.00	(-87.77, -542.55, 685.43)	33041	32971
marley	1000180400	0.00	(-60.10, -554.74, 605.72)	33040	32971
marley	1000180400	0.01	(-64.76, -554.31, 600.54)	33039	32971
marley	1000180400	0.00	(-58.92, -556.74, 609.84)	33038	32971
marley	1000180400	0.00	(-58.83, -556.41, 609.98)	33037	32971
marley	1000180400	0.00	(-59.27, -555.70, 608.55)	33036	32971
marley	1000180400	0.01	(-71.94, -556.95, 607.42)	33035	32971
marley	1000180400	0.00	(-68.49, -554.91, 617.09)	33034	32971
marley	1000180360	0.00	(-65.89, -568.76, 626.89)	33033	32971
marley	1000180400	0.01	(-64.95, -568.80, 626.91)	33032	32971
marley	1000180400	0.01	(-65.05, -569.13, 626.96)	33031	32971
marley	1000180400	0.00	(-68.50, -566.11, 626.32)	33030	32971
marley	1000180400	0.01	(-135.10, -592.59, 615.22)	33029	32971
marley	1000180400	0.01	(-116.74, -590.87, 608.59)	33028	32971
marley	1000180400	0.00	(-167.51, -547.63, 702.03)	33027	32971
marley	1000180400	0.01	(-145.24, -454.22, 712.43)	33026	32971
marley	1000180360	0.00	(-120.45, -447.64, 674.02)	33025	32971
marley	1000180360	0.01	(-110.46, -453.75, 664.13)	33024	32971
marley	1000180400	0.01	(-96.91, -433.45, 750.00)	33023	32971
marley	1000180400	0.01	(-78.38, -433.62, 752.21)	33022	32971
marley	1000180400	0.02	(-78.48, -435.50, 749.90)	33021	32971
marley	1000180400	0.01	(-81.82, -435.10, 760.41)	33020	32971
marley	1000180400	0.01	(-69.21, -451.06, 771.95)	33019	32971
marley	1000180400	0.00	(-74.67, -457.16, 765.94)	33018	32971
marley	1000180400	0.02	(-93.55, -531.66, 762.94)	33017	32971
marley	1000180400	0.02	(-83.78, -512.63, 713.80)	33016	32971
marley	1000180400	0.03	(-89.30, -493.18, 735.55)	33015	32971
marley	1000180400	0.03	(-88.03, -495.66, 730.82)	33014	32971
marley	1000180400	0.02	(-96.60, -468.31, 746.06)	33013	32971
marley	1000180400	0.00	(-13.64, -462.88, 783.22)	33012	32971
marley	1000180360	0.01	(-2.02, -468.63, 790.31)	33011	32971
marley	1000180400	0.01	(7.08, -464.68, 792.00)	33010	32971
marley	1000180400	0.00	(55.49, -508.74, 865.78)	33009	32971
marley	1000180400	0.03	(56.22, -524.75, 880.90)	33008	32971
marley	1000180400	0.04	(50.81, -514.64, 883.41)	33007	32971
marley	1000180360	0.00	(60.45, -520.59, 882.93)	33006	32971
marley	1000180400	0.02	(107.22, -629.51, 860.35)	33005	32971
marley	1000180360	0.01	(107.90, -629.44, 863.15)	33004	32971
marley	1000180400	0.02	(139.86, -599.23, 880.84)	33003	32971
marley	1000180400	0.02	(133.77, -590.23, 883.99)	33002	32971
marley	1000180360	0.00	(139.10, -583.42, 874.25)	33001	32971
marley	1000180400	0.00	(139.27, -581.61, 870.61)	33000	32971
marley	1000180360	0.03	(144.04, -580.72, 863.66)	32999	32971
marley	1000180400	0.04	(149.97, -587.00, 866.58)	32998	32971
marley	1000180400	0.05	(162.04, -549.58, 843.49)	32997	32971
marley	1000180400	0.04	(150.80, -552.53, 862.87)	32996	32971
marley	1000180400	0.04	(143.69, -575.58, 845.00)	32995	32971
marley	1000180400	0.02	(132.48, -579.24, 863.79)	32994	32971
marley	1000180400	0.02	(156.95, -573.39, 912.52)	32993	32971
marley	1000180400	0.05	(159.32, -575.52, 913.06)	32992	32971
marley	22		1.46	(123.81, -591.86, 879.71)	32973	32928
marley	1000180400	0.02	(123.81, -591.86, 879.71)	32972	32928
marley	2112		0.77	(123.81, -591.86, 879.71)	32971	32928
marley	1000180400	0.07	(122.33, -597.06, 872.67)	32970	32928
marley	1000180400	0.17	(126.35, -594.59, 865.26)	32969	32928
marley	22		0.00	(126.80, -593.56, 866.68)	32931	32912
marley	22		1.46	(126.80, -593.56, 866.68)	32930	32912
marley	1000180400	0.19	(126.80, -593.56, 866.68)	32929	32912
marley	2112		2.49	(126.80, -593.56, 866.68)	32928	32912
marley	22		2.52	(145.53, -589.63, 853.06)	32913	0
marley	2112		4.14	(145.53, -589.63, 853.06)	32912	0
marley	1000190390	0.13	(145.53, -589.63, 853.06)	32911	0
marley	11		45.60	(145.53, -589.63, 853.06)	32910	0
Signal Track IDs: 32910; 32911; 32912; 32913; 32928; 32929; 32930; 32931; 32969; 32970; 32971; 32972; 32973; 32992; 32993; 32994; 32995; 32996; 32997; 32998; 32999; 33000; 33001; 33002; 33003; 33004; 33005; 33006; 33007; 33008; 33009; 33010; 33011; 33012; 33013; 33014; 33015; 33016; 33017; 33018; 33019; 33020; 33021; 33022; 33023; 33024; 33025; 33026; 33027; 33028; 33029; 33030; 33031; 33032; 33033; 33034; 33035; 33036; 33037; 33038; 33039; 33040; 33041; 33042; 33043; 33044; 33045; 33046; 33047; 33048; 33049; 33050; 33054; 33076; 33077; 
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Nov-2025 22:22:40 UTC run: 5082 subRun: 0 event: 115900

Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.

%MSG
11-Nov-2025 22:22:40 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/b6/1a/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250206T120232Z_gen_002318_supernova_g4_detsim_reco_20250724T021741Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 11-Nov-2025 22:22:40 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.134613       7.11971       19.0893      0.602708       7.75777        50     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00118779     0.0124175     0.250892     0.00215868     0.0362999       50     
end_path:solarnuana:SolarNuAna     0.132915       7.10707       19.0873      0.594401       7.76155        50     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 11-Nov-2025 22:22:40 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1550.25 MB
  Peak resident set size usage (VmHWM): 902.148 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 50 passed = 50 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         50         50          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 367.410735 Real = 388.168108

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1550.25 VmHWM = 902.148

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-10 07:56:39 UTC       justIN version: 01.06.00