justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 288544.31@dunegpschedd02.fnal.gov

Jobsub ID288544.31@dunegpschedd02.fnal.gov
Workflow ID12007
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-20 14:48:38
SiteUS_FNAL-T1
EntryCMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat2026-01-20 21:13:26
From worker nodeHostnamedunegli-50386-0-cmswn2355.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-20 14:57:39
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T125207Z_gen_003626_supernova_g4stage1_g4stage2_detsim_reco_20250701T042035Z_reco2.root
JobscriptExit code0
Real time6h (22528s)
CPU time6h (22383s = 99%)
Max RSS bytes2562154496 (2443 MiB)
Outputting started2026-01-20 21:13:08
Output files
Finished2026-01-20 21:13:26
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

m gen 10 Rn222ChainPb210GenInLAr
# of particles 22	from gen 11 Rn220ChainPb212GenInLAr
# of particles 246	from gen 12 K40GenInCathode
# of particles 3128	from gen 13 U238ChainGenInCathode
# of particles 3699	from gen 14 Th232ChainGenInCathode
# of particles 101	from gen 15 K40GenInAnode
# of particles 1399	from gen 16 U238ChainGenInAnode
# of particles 1725	from gen 17 Th232ChainGenInAnode
# of particles 0	from gen 18 Rn222ChainGenInPDS
# of particles 0	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 0	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 17	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 62	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 37	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 52	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 37	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 13	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  20-Jan-2026 21:13:06 UTC run: 5043 subRun: 0 event: 36260

Number of Signal Particles: 5
Neutrino Interaction: -1
Neutrino Energy: 56.43 MeV
Position (120.80, -430.40, 338.46) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	22		1.29	(182.99, 615.48, 372.74)	133367	133363
marley	1000190410	0.00	(182.99, 615.48, 372.74)	133366	133363
marley	11		0.17	(182.99, 615.48, 372.74)	133365	133362
marley	-12		1.03	(182.99, 615.48, 372.74)	133364	133362
marley	1000190419	0.00	(182.99, 615.48, 372.74)	133363	133362
marley	1000180410	0.00	(182.99, 615.48, 372.74)	133362	133252
marley	22		2.69	(182.99, 615.48, 372.74)	133361	133252
marley	22		0.77	(182.99, 615.48, 372.74)	133360	133252
marley	22		1.19	(182.99, 615.48, 372.74)	133359	133252
marley	22		3.19	(182.99, 615.48, 372.74)	133358	133252
marley	2212		0.00	(258.89, 776.07, 323.56)	133341	133252
marley	2212		0.00	(426.96, 702.96, 276.10)	133323	133252
marley	1000060120	0.00	(425.51, 701.23, 274.20)	133322	133252
marley	2212		0.00	(427.30, 699.32, 273.72)	133321	133252
marley	2212		0.00	(429.66, 698.74, 272.66)	133320	133252
marley	2212		0.00	(431.12, 689.59, 264.04)	133319	133252
marley	2212		0.01	(431.43, 688.82, 263.34)	133318	133252
marley	2212		0.02	(441.18, 679.89, 266.20)	133317	133252
marley	2212		0.01	(442.07, 664.90, 264.55)	133316	133252
marley	2212		0.02	(441.50, 663.81, 264.36)	133315	133252
marley	2212		0.04	(441.46, 663.16, 264.48)	133314	133252
marley	2212		0.01	(435.18, 650.78, 276.92)	133313	133252
marley	1000180400	0.00	(400.72, 598.66, 307.05)	133312	133252
marley	1000180400	0.01	(278.59, 408.30, 365.34)	133311	133252
marley	1000180400	0.01	(281.95, 414.26, 380.28)	133310	133252
marley	1000180360	0.00	(282.05, 414.40, 380.06)	133309	133252
marley	1000180400	0.00	(295.60, 408.01, 368.21)	133308	133252
marley	1000180400	0.01	(315.31, 401.28, 347.36)	133307	133252
marley	1000180400	0.01	(304.52, 409.03, 360.48)	133306	133252
marley	1000180400	0.01	(313.75, 424.91, 264.02)	133305	133252
marley	1000180400	0.01	(320.82, 418.37, 266.80)	133304	133252
marley	1000180400	0.01	(320.26, 423.88, 263.95)	133303	133252
marley	1000180400	0.02	(312.25, 423.19, 263.90)	133302	133252
marley	1000060120	0.06	(449.82, 420.01, 237.34)	133301	133252
marley	1000260540	0.02	(425.17, 451.60, 264.73)	133300	133252
marley	1000060120	0.01	(430.32, 443.06, 266.29)	133299	133252
marley	1000180400	0.00	(317.00, -249.36, 467.51)	133298	133252
marley	1000180400	0.03	(308.74, -291.68, 508.64)	133297	133252
marley	1000180400	0.03	(309.55, -291.28, 508.11)	133296	133252
marley	1000180400	0.01	(305.61, -330.09, 523.15)	133295	133252
marley	1000180360	0.00	(307.17, -335.13, 519.82)	133294	133252
marley	1000180400	0.01	(317.45, -341.66, 501.76)	133293	133252
marley	1000180400	0.01	(308.02, -344.74, 485.81)	133292	133252
marley	1000180400	0.03	(308.60, -328.16, 445.89)	133291	133252
marley	1000180400	0.03	(323.35, -337.50, 453.65)	133290	133252
marley	1000180400	0.03	(298.94, -348.36, 446.07)	133289	133252
marley	1000180400	0.02	(298.94, -348.35, 446.08)	133288	133252
marley	1000180400	0.04	(301.76, -346.80, 446.34)	133287	133252
marley	1000180400	0.04	(260.71, -427.61, 336.67)	133286	133252
marley	1000180400	0.05	(264.98, -427.27, 337.22)	133285	133252
marley	1000180400	0.01	(251.51, -421.50, 327.54)	133284	133252
marley	1000180400	0.05	(249.74, -415.65, 322.87)	133283	133252
marley	1000180400	0.01	(247.76, -417.66, 323.23)	133282	133252
marley	1000180400	0.02	(247.78, -420.93, 325.75)	133281	133252
marley	1000180400	0.00	(247.97, -422.67, 324.81)	133280	133252
marley	1000180400	0.06	(245.31, -430.49, 321.11)	133279	133252
marley	1000180400	0.01	(237.95, -420.61, 335.58)	133278	133252
marley	1000180400	0.00	(231.45, -418.36, 338.23)	133277	133252
marley	1000180400	0.01	(190.45, -407.29, 342.33)	133276	133252
marley	22		1.46	(138.70, -340.56, 356.53)	133254	133132
marley	1000180400	0.14	(138.70, -340.56, 356.53)	133253	133132
marley	2112		0.78	(138.70, -340.56, 356.53)	133252	133132
marley	1000180400	0.04	(140.16, -343.45, 353.98)	133251	133132
marley	1000180400	0.05	(133.55, -350.45, 342.96)	133250	133132
marley	1000180400	0.18	(134.37, -349.18, 336.73)	133249	133132
marley	1000180400	0.09	(150.08, -361.25, 344.38)	133248	133132
marley	22		0.65	(150.67, -360.77, 344.63)	133139	133125
marley	22		1.01	(150.67, -360.77, 344.63)	133138	133125
marley	22		1.88	(150.67, -360.77, 344.63)	133137	133125
marley	22		0.57	(150.67, -360.77, 344.63)	133136	133125
marley	22		1.43	(150.67, -360.77, 344.63)	133135	133125
marley	22		1.46	(150.67, -360.77, 344.63)	133134	133125
marley	1000180400	0.62	(150.67, -360.77, 344.63)	133133	133125
marley	2112		2.74	(150.67, -360.77, 344.63)	133132	133125
marley	1000180400	0.04	(144.74, -364.40, 341.17)	133131	133125
marley	1000180400	0.02	(135.84, -376.02, 328.68)	133130	133125
marley	1000180400	0.03	(134.29, -379.74, 326.04)	133129	133125
marley	1000180400	0.12	(133.78, -385.11, 323.89)	133128	133125
marley	1000180400	0.00	(125.75, -414.01, 332.29)	133127	133125
marley	1000180400	0.00	(124.93, -416.59, 333.29)	133126	133125
marley	2112		10.57	(120.80, -430.40, 338.46)	133125	0
marley	1000190390	0.14	(120.80, -430.40, 338.46)	133124	0
marley	11		36.41	(120.80, -430.40, 338.46)	133123	0
Signal Track IDs: 133123; 133124; 133125; 133126; 133127; 133128; 133129; 133130; 133131; 133132; 133133; 133134; 133135; 133136; 133137; 133138; 133139; 133248; 133249; 133250; 133251; 133252; 133253; 133254; 133276; 133277; 133278; 133279; 133280; 133281; 133282; 133283; 133284; 133285; 133286; 133287; 133288; 133289; 133290; 133291; 133292; 133293; 133294; 133295; 133296; 133297; 133298; 133299; 133300; 133301; 133302; 133303; 133304; 133305; 133306; 133307; 133308; 133309; 133310; 133311; 133312; 133313; 133314; 133315; 133316; 133317; 133318; 133319; 133320; 133321; 133322; 133323; 133341; 133358; 133359; 133360; 133361; 133362; 133363; 133364; 133365; 133366; 133367; 
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  20-Jan-2026 21:13:06 UTC run: 5043 subRun: 0 event: 36260

Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.

%MSG
20-Jan-2026 21:13:06 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/4b/8a/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T125207Z_gen_003626_supernova_g4stage1_g4stage2_detsim_reco_20250701T042035Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 20-Jan-2026 21:13:06 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          2.41048       2243.51       4992.55       1896.21       2257.54        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00272938     0.012769      0.0250472     0.0130761     0.0086227       10     
end_path:solarnuana:SolarNuAna      2.38983       2243.5        4992.55       1896.19       2257.54        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 20-Jan-2026 21:13:06 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3187.26 MB
  Peak resident set size usage (VmHWM): 2562.15 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 22349.453496 Real = 22492.999410

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3187.26 VmHWM = 2562.15

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-04 04:32:59 UTC       justIN version: 01.06.00