justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 242009.22@dunegpschedd02.fnal.gov

Jobsub ID242009.22@dunegpschedd02.fnal.gov
Workflow ID9957
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-12 06:57:22
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-11-13 08:08:21
From worker nodeHostnamedunegli-7572321-0-fnpc23039.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2025-11-13 05:37:24
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T065803Z_gen_002871_supernova_g4stage1_g4stage2_detsim_reco_20250702T231114Z_reco2.root
JobscriptExit code0
Real time2h (9038s)
CPU time2h (8917s = 98%)
Max RSS bytes1905610752 (1817 MiB)
Outputting started2025-11-13 08:08:02
Output files
Finished2025-11-13 08:08:21
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

GenInUpperMesh1x8x14
# of particles 51	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 42	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 23	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 68	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 70	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Nov-2025 08:08:02 UTC run: 5031 subRun: 0 event: 28710

Number of Signal Particles: 8
Neutrino Interaction: -1
Neutrino Energy: 56.60 MeV
Position (236.03, 70.06, 713.02) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	1000260570	0.00	(494.05, -834.49, 923.53)	133248	133070
marley	22		7.65	(494.05, -834.49, 923.53)	133247	133070
marley	22		7.65	(494.05, -834.49, 923.53)	133246	133070
marley	22		7.65	(494.05, -834.49, 923.53)	133245	133070
marley	22		7.65	(494.05, -834.49, 923.53)	133244	133070
marley	22		7.65	(494.05, -834.49, 923.53)	133243	133070
marley	2212		0.00	(460.83, -788.28, 955.49)	133229	133070
marley	2212		0.00	(460.67, -788.10, 920.33)	133228	133070
marley	2212		0.00	(457.07, -788.34, 917.93)	133227	133070
marley	2212		0.00	(454.61, -780.90, 917.20)	133226	133070
marley	2212		0.00	(445.74, -772.89, 913.97)	133225	133070
marley	2212		0.00	(445.62, -772.62, 914.23)	133224	133070
marley	2212		0.01	(433.90, -756.87, 916.83)	133223	133070
marley	2212		0.02	(432.49, -747.87, 913.36)	133222	133070
marley	2212		0.02	(426.86, -742.70, 901.41)	133221	133070
marley	1000180360	0.00	(-8.62, 52.72, 506.67)	133220	133070
marley	1000180360	0.00	(-19.31, 38.69, 534.02)	133219	133070
marley	1000180360	0.00	(-8.69, 22.65, 587.45)	133218	133070
marley	1000180400	0.00	(-168.01, -23.47, 639.91)	133217	133070
marley	1000180400	0.01	(-178.05, -87.93, 529.41)	133216	133070
marley	1000180400	0.00	(-177.00, -71.07, 553.12)	133215	133070
marley	1000180400	0.01	(-175.96, -73.41, 561.43)	133214	133070
marley	1000180400	0.01	(-176.95, -72.45, 560.97)	133213	133070
marley	1000180400	0.00	(-172.88, -72.18, 559.22)	133212	133070
marley	1000180400	0.00	(-172.83, -72.15, 558.97)	133211	133070
marley	1000180400	0.00	(-177.79, -80.92, 557.11)	133210	133070
marley	1000180400	0.00	(-199.75, -70.60, 580.25)	133209	133070
marley	1000180400	0.00	(-213.56, -76.43, 599.29)	133208	133070
marley	1000180400	0.00	(-213.50, -82.35, 602.28)	133207	133070
marley	1000180400	0.00	(-218.07, -89.88, 615.18)	133206	133070
marley	1000180400	0.00	(-225.07, -123.08, 621.09)	133205	133070
marley	1000180360	0.01	(-235.18, -127.69, 608.01)	133204	133070
marley	1000180400	0.00	(-233.40, -111.31, 610.89)	133203	133070
marley	1000180400	0.01	(-240.78, -82.66, 607.32)	133202	133070
marley	1000180400	0.00	(-240.72, -83.09, 607.80)	133201	133070
marley	1000180400	0.00	(-281.95, -98.47, 664.52)	133200	133070
marley	1000180360	0.00	(-276.24, -104.70, 682.48)	133199	133070
marley	1000180360	0.00	(-276.82, -103.72, 683.69)	133198	133070
marley	1000180400	0.00	(-129.72, 132.70, 734.57)	133197	133070
marley	1000180400	0.01	(-143.50, 153.57, 743.76)	133196	133070
marley	1000180360	0.01	(-125.39, 137.06, 753.71)	133195	133070
marley	1000180400	0.02	(-26.46, 33.50, 574.08)	133194	133070
marley	1000180400	0.01	(-28.76, 33.90, 577.16)	133193	133070
marley	1000180400	0.01	(-32.53, 43.60, 566.21)	133192	133070
marley	1000180400	0.02	(-32.62, 45.03, 569.38)	133191	133070
marley	1000180400	0.02	(-32.70, 44.71, 569.20)	133190	133070
marley	1000180400	0.00	(21.03, 78.52, 691.13)	133189	133070
marley	1000180400	0.01	(27.59, 67.40, 705.69)	133188	133070
marley	1000180400	0.01	(24.51, 67.49, 707.83)	133187	133070
marley	1000180400	0.02	(23.67, 77.40, 712.93)	133186	133070
marley	1000180360	0.02	(22.06, 75.91, 714.37)	133185	133070
marley	1000180400	0.01	(24.11, 73.21, 711.33)	133184	133070
marley	1000180400	0.02	(30.99, 78.23, 700.21)	133183	133070
marley	1000180360	0.01	(31.95, 88.93, 715.16)	133182	133070
marley	1000180400	0.01	(57.88, 96.39, 725.06)	133181	133070
marley	1000180400	0.01	(62.32, 95.54, 720.68)	133180	133070
marley	1000180360	0.04	(66.41, 85.09, 712.39)	133179	133070
marley	1000180400	0.00	(56.89, 90.97, 718.42)	133178	133070
marley	1000180360	0.03	(-9.18, 123.55, 765.76)	133177	133070
marley	1000180400	0.00	(18.62, 126.75, 778.15)	133176	133070
marley	1000180400	0.01	(71.81, 138.56, 841.00)	133175	133070
marley	1000180360	0.00	(125.60, 106.68, 847.50)	133174	133070
marley	1000180400	0.04	(154.17, 95.98, 849.65)	133173	133070
marley	1000180400	0.01	(150.39, 108.87, 846.69)	133172	133070
marley	1000180400	0.04	(156.46, 133.02, 813.23)	133171	133070
marley	1000180400	0.03	(205.60, 28.90, 854.25)	133170	133070
marley	1000180400	0.03	(213.93, 35.59, 854.33)	133169	133070
marley	1000180400	0.03	(219.15, 27.80, 855.92)	133168	133070
marley	1000180400	0.05	(244.01, 29.27, 820.03)	133167	133070
marley	1000180400	0.06	(243.58, 29.64, 820.05)	133166	133070
marley	1000180400	0.01	(249.21, 30.67, 819.17)	133165	133070
marley	1000180400	0.06	(259.34, 26.12, 815.49)	133164	133070
marley	1000180400	0.07	(241.35, 32.34, 797.57)	133163	133070
marley	1000180400	0.09	(245.22, 33.22, 797.23)	133162	133070
marley	1000180400	0.02	(221.91, 18.81, 792.54)	133161	133070
marley	1000180400	0.06	(171.75, 31.46, 803.83)	133160	133070
marley	1000180400	0.08	(192.34, 98.79, 672.34)	133159	133070
marley	1000180400	0.01	(188.17, 101.87, 678.28)	133158	133070
marley	1000180400	0.09	(172.08, 107.70, 683.10)	133157	133070
marley	1000180400	0.02	(211.13, 58.42, 733.31)	133156	133070
marley	1000180400	0.02	(210.18, 56.56, 735.08)	133155	133070
marley	1000180400	0.12	(206.66, 56.53, 737.77)	133154	133070
marley	1000180400	0.02	(216.39, 54.63, 736.99)	133153	133070
marley	1000180400	0.06	(238.65, 65.82, 724.27)	133152	133070
marley	1000180400	0.02	(237.72, 66.66, 722.18)	133151	133070
marley	1000180400	0.02	(237.69, 67.84, 721.55)	133150	133070
marley	22		2.53	(236.03, 70.06, 713.02)	133073	0
marley	22		2.41	(236.03, 70.06, 713.02)	133072	0
marley	22		1.89	(236.03, 70.06, 713.02)	133071	0
marley	2112		1.49	(236.03, 70.06, 713.02)	133070	0
marley	1000190390	0.21	(236.03, 70.06, 713.02)	133069	0
marley	11		38.77	(236.03, 70.06, 713.02)	133068	0
Signal Track IDs: 133068; 133069; 133070; 133071; 133072; 133073; 133150; 133151; 133152; 133153; 133154; 133155; 133156; 133157; 133158; 133159; 133160; 133161; 133162; 133163; 133164; 133165; 133166; 133167; 133168; 133169; 133170; 133171; 133172; 133173; 133174; 133175; 133176; 133177; 133178; 133179; 133180; 133181; 133182; 133183; 133184; 133185; 133186; 133187; 133188; 133189; 133190; 133191; 133192; 133193; 133194; 133195; 133196; 133197; 133198; 133199; 133200; 133201; 133202; 133203; 133204; 133205; 133206; 133207; 133208; 133209; 133210; 133211; 133212; 133213; 133214; 133215; 133216; 133217; 133218; 133219; 133220; 133221; 133222; 133223; 133224; 133225; 133226; 133227; 133228; 133229; 133243; 133244; 133245; 133246; 133247; 133248; 
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Nov-2025 08:08:02 UTC run: 5031 subRun: 0 event: 28710

Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.

%MSG
13-Nov-2025 08:08:02 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/a0/06/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T065803Z_gen_002871_supernova_g4stage1_g4stage2_detsim_reco_20250702T231114Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 13-Nov-2025 08:08:02 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.958431       896.221       2715.24       1.66357       1113.52        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000691132   0.00954729     0.0323008    0.00716015     0.0100382       10     
end_path:solarnuana:SolarNuAna     0.957555       896.211       2715.22       1.65488       1113.52        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 13-Nov-2025 08:08:02 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2529.98 MB
  Peak resident set size usage (VmHWM): 1905.61 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 8899.736381 Real = 8996.877625

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 2529.98 VmHWM = 1905.61

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-10 06:23:41 UTC       justIN version: 01.06.00