justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 296301.0@dunegpschedd02.fnal.gov

Jobsub ID296301.0@dunegpschedd02.fnal.gov
Workflow ID12414
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-28 12:58:41
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2026-01-28 20:03:29
From worker nodeHostnamedunegli-8465065-0-fnpc18001.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-28 13:03:07
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T024301Z_gen_001803_supernova_g4stage1_g4stage2_detsim_reco_20250630T210935Z_reco2.root
JobscriptExit code0
Real time7h (25202s)
CPU time6h (24413s = 96%)
Max RSS bytes2578608128 (2459 MiB)
Outputting started2026-01-28 20:03:10
Output files
Finished2026-01-28 20:03:29
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

cles 37	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 17	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  28-Jan-2026 20:03:08 UTC run: 5019 subRun: 0 event: 18030

Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 63.74 MeV
Position (19.99, 125.82, 370.56) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	22		1.29	(-214.99, -420.68, -40.61)	133180	133176
marley	1000190410	0.00	(-214.99, -420.68, -40.61)	133179	133176
marley	11		0.82	(-214.99, -420.68, -40.61)	133178	133175
marley	-12		0.38	(-214.99, -420.68, -40.61)	133177	133175
marley	1000190419	0.00	(-214.99, -420.68, -40.61)	133176	133175
marley	1000180410	0.00	(-214.99, -420.68, -40.61)	133175	133037
marley	22		2.21	(-214.99, -420.68, -40.61)	133174	133037
marley	22		5.22	(-214.99, -420.68, -40.61)	133173	133037
marley	22		4.04	(-214.99, -420.68, -40.61)	133172	133037
marley	2212		0.01	(-243.26, -376.58, -112.81)	133164	133037
marley	2212		0.04	(-244.21, -375.37, -113.80)	133163	133037
marley	1000060120	0.01	(-278.88, -379.01, -110.85)	133162	133037
marley	1000180400	0.00	(-276.54, -375.12, -104.95)	133161	133037
marley	1000180400	0.00	(-292.47, -231.82, 320.46)	133160	133037
marley	1000180360	0.00	(-297.70, -93.09, 375.78)	133159	133037
marley	1000180400	0.01	(-173.18, 103.15, 371.46)	133158	133037
marley	1000180400	0.00	(-174.94, 85.85, 374.24)	133157	133037
marley	1000180400	0.00	(-174.85, 81.13, 374.82)	133156	133037
marley	1000180400	0.00	(-174.87, 81.14, 374.97)	133155	133037
marley	1000180400	0.01	(-175.32, 81.08, 375.75)	133154	133037
marley	1000180400	0.00	(-177.54, 80.72, 372.93)	133153	133037
marley	1000180400	0.01	(-179.68, 82.08, 373.94)	133152	133037
marley	1000180400	0.00	(-172.38, 81.55, 379.84)	133151	133037
marley	1000180360	0.00	(-171.53, 77.32, 384.85)	133150	133037
marley	1000180400	0.01	(-164.03, 69.49, 381.75)	133149	133037
marley	1000180360	0.01	(-125.82, 140.89, 414.06)	133148	133037
marley	1000180400	0.00	(-112.72, 125.93, 409.02)	133147	133037
marley	1000180400	0.01	(-106.86, 126.84, 409.82)	133146	133037
marley	1000180400	0.01	(-123.78, 105.73, 381.27)	133145	133037
marley	1000180400	0.00	(-124.99, 88.40, 390.95)	133144	133037
marley	1000180400	0.01	(-115.45, 76.63, 381.52)	133143	133037
marley	1000180400	0.01	(-140.04, 128.33, 385.42)	133142	133037
marley	1000180400	0.01	(-132.19, 142.16, 435.58)	133141	133037
marley	1000180400	0.01	(-131.48, 139.97, 433.49)	133140	133037
marley	1000180400	0.02	(-131.28, 139.83, 433.56)	133139	133037
marley	1000180400	0.02	(-131.46, 139.78, 433.45)	133138	133037
marley	1000180400	0.01	(-112.05, 198.41, 437.81)	133137	133037
marley	1000180400	0.00	(4.58, 184.19, 541.36)	133136	133037
marley	1000180400	0.01	(46.72, 176.48, 550.26)	133135	133037
marley	1000180400	0.02	(33.80, 157.97, 563.85)	133134	133037
marley	1000180400	0.01	(27.90, 131.62, 427.60)	133133	133037
marley	1000180400	0.00	(30.56, 127.92, 428.80)	133132	133037
marley	1000180400	0.00	(30.74, 126.24, 428.57)	133131	133037
marley	1000180400	0.03	(30.43, 121.35, 420.71)	133130	133037
marley	1000180400	0.02	(29.08, 123.45, 448.10)	133129	133037
marley	1000180400	0.01	(38.73, 82.51, 437.36)	133128	133037
marley	1000180400	0.03	(51.42, 73.23, 389.27)	133127	133037
marley	1000180400	0.02	(45.69, 71.70, 422.31)	133126	133037
marley	1000180400	0.00	(48.96, 84.31, 422.13)	133125	133037
marley	1000180400	0.00	(48.50, 90.23, 423.16)	133124	133037
marley	1000180400	0.01	(66.38, 194.64, 490.04)	133123	133037
marley	1000180400	0.00	(73.73, 189.82, 502.24)	133122	133037
marley	1000180400	0.04	(96.85, 179.27, 513.06)	133121	133037
marley	1000180400	0.04	(71.74, 184.53, 518.37)	133120	133037
marley	1000180400	0.03	(77.15, 183.51, 510.84)	133119	133037
marley	1000180400	0.04	(84.93, 181.14, 518.22)	133118	133037
marley	1000180400	0.03	(63.21, 167.07, 518.01)	133117	133037
marley	1000180400	0.00	(83.79, 141.95, 546.40)	133116	133037
marley	1000180400	0.02	(90.94, 139.09, 551.57)	133115	133037
marley	1000180400	0.01	(115.99, 152.24, 541.38)	133114	133037
marley	1000180400	0.02	(129.19, 147.88, 545.37)	133113	133037
marley	1000180400	0.00	(164.14, 165.74, 501.14)	133112	133037
marley	1000180400	0.07	(169.37, 174.79, 492.23)	133111	133037
marley	1000180400	0.04	(159.10, 144.90, 514.30)	133110	133037
marley	1000180400	0.01	(18.34, 151.25, 457.39)	133109	133037
marley	1000180400	0.07	(-9.03, 126.72, 381.12)	133108	133037
marley	1000180400	0.01	(-11.83, 129.04, 388.56)	133107	133037
marley	1000180400	0.04	(-18.75, 129.28, 395.16)	133106	133037
marley	1000180400	0.04	(-5.72, 127.46, 411.20)	133105	133037
marley	1000180400	0.01	(17.11, 127.42, 394.22)	133104	133037
marley	1000180400	0.10	(35.43, 120.61, 393.11)	133103	133037
marley	1000180400	0.00	(-5.07, 130.07, 390.13)	133102	133037
marley	1000180400	0.04	(-6.90, 131.28, 390.41)	133101	133037
marley	1000180400	0.04	(-17.13, 122.61, 399.10)	133100	133037
marley	1000180400	0.10	(-13.24, 122.48, 408.57)	133099	133037
marley	1000180400	0.02	(-11.31, 106.14, 379.24)	133098	133037
marley	1000180400	0.11	(-1.07, 115.63, 346.59)	133097	133037
marley	1000180400	0.10	(-2.21, 116.66, 348.19)	133096	133037
marley	1000180400	0.05	(8.35, 108.94, 353.00)	133095	133037
marley	1000180400	0.07	(10.53, 111.24, 355.66)	133094	133037
marley	1000180400	0.15	(4.41, 119.51, 355.55)	133093	133037
marley	1000180400	0.16	(5.49, 106.38, 354.68)	133092	133037
marley	1000180400	0.19	(8.39, 113.45, 358.33)	133091	133037
marley	1000180400	0.16	(7.72, 107.89, 353.83)	133090	133037
marley	1000180400	0.02	(1.73, 113.81, 354.26)	133089	133037
marley	1000180400	0.21	(-8.39, 116.77, 357.65)	133088	133037
marley	1000180400	0.08	(-5.87, 113.79, 353.48)	133087	133037
marley	1000180400	0.00	(15.91, 118.60, 351.28)	133086	133037
marley	1000180400	0.16	(17.48, 118.90, 350.78)	133085	133037
marley	1000180400	0.01	(17.51, 122.03, 361.59)	133084	133037
marley	22		3.02	(19.99, 125.82, 370.56)	133039	0
marley	22		4.94	(19.99, 125.82, 370.56)	133038	0
marley	2112		2.67	(19.99, 125.82, 370.56)	133037	0
marley	1000190390	0.13	(19.99, 125.82, 370.56)	133036	0
marley	11		43.68	(19.99, 125.82, 370.56)	133035	0
Signal Track IDs: 133035; 133036; 133037; 133038; 133039; 133084; 133085; 133086; 133087; 133088; 133089; 133090; 133091; 133092; 133093; 133094; 133095; 133096; 133097; 133098; 133099; 133100; 133101; 133102; 133103; 133104; 133105; 133106; 133107; 133108; 133109; 133110; 133111; 133112; 133113; 133114; 133115; 133116; 133117; 133118; 133119; 133120; 133121; 133122; 133123; 133124; 133125; 133126; 133127; 133128; 133129; 133130; 133131; 133132; 133133; 133134; 133135; 133136; 133137; 133138; 133139; 133140; 133141; 133142; 133143; 133144; 133145; 133146; 133147; 133148; 133149; 133150; 133151; 133152; 133153; 133154; 133155; 133156; 133157; 133158; 133159; 133160; 133161; 133162; 133163; 133164; 133172; 133173; 133174; 133175; 133176; 133177; 133178; 133179; 133180; 
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  28-Jan-2026 20:03:08 UTC run: 5019 subRun: 0 event: 18030

Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.

%MSG
28-Jan-2026 20:03:09 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/1c/99/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T024301Z_gen_001803_supernova_g4stage1_g4stage2_detsim_reco_20250630T210935Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 28-Jan-2026 20:03:09 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          1.4573        2510.93       4729.08       3694.42       2082.99        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)              0.00168      0.0178406     0.0717373     0.0117123     0.0206912       10     
end_path:solarnuana:SolarNuAna      1.45436       2510.91       4729.06       3694.41       2082.98        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 28-Jan-2026 20:03:09 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3191.01 MB
  Peak resident set size usage (VmHWM): 2578.61 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 24387.963397 Real = 25168.007165

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3191.01 VmHWM = 2578.61

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-04 04:26:49 UTC       justIN version: 01.06.00