justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 294328.167@dunegpschedd01.fnal.gov

Jobsub ID294328.167@dunegpschedd01.fnal.gov
Workflow ID12012
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-20 15:08:41
SiteUS_FNAL-T1
EntryCMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat2026-01-20 22:49:47
From worker nodeHostnamedunegli-50386-0-cmswn2355.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-20 21:30:32
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T212003Z_gen_003947_supernova_g4stage1_g4stage2_detsim_reco_20250701T045600Z_reco2.root
JobscriptExit code0
Real time1h (4736s)
CPU time1h (4698s = 99%)
Max RSS bytes2552516608 (2434 MiB)
Outputting started2026-01-20 22:49:29
Output files
Finished2026-01-20 22:49:47
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

.13, 1770.76)	132456	132390
marley	1000180400	0.00	(-120.87, 552.46, 1767.29)	132455	132390
marley	1000180360	0.00	(-98.40, 540.19, 1749.97)	132454	132390
marley	1000180360	0.01	(-103.18, 537.67, 1728.91)	132453	132390
marley	1000180400	0.00	(-135.08, 542.24, 1738.32)	132452	132390
marley	1000180400	0.00	(-143.43, 532.02, 1743.44)	132451	132390
marley	1000180400	0.01	(-134.74, 437.32, 1731.49)	132450	132390
marley	1000180400	0.01	(-136.51, 444.78, 1732.46)	132449	132390
marley	1000180400	0.00	(-141.74, 403.51, 1716.15)	132448	132390
marley	1000180400	0.01	(-130.02, 397.07, 1711.07)	132447	132390
marley	1000180400	0.01	(-133.57, 391.83, 1714.35)	132446	132390
marley	1000180400	0.00	(-119.54, 392.42, 1726.61)	132445	132390
marley	1000180360	0.01	(-86.62, 358.74, 1787.39)	132444	132390
marley	1000180400	0.01	(-88.88, 366.65, 1795.45)	132443	132390
marley	1000180400	0.00	(-90.96, 364.74, 1796.58)	132442	132390
marley	1000180400	0.00	(-92.89, 363.34, 1801.68)	132441	132390
marley	1000180400	0.02	(-98.17, 352.75, 1804.91)	132440	132390
marley	1000180400	0.02	(-78.82, 517.26, 1869.24)	132439	132390
marley	1000180400	0.00	(-113.16, 506.93, 1749.78)	132438	132390
marley	1000180400	0.02	(-112.86, 506.67, 1749.23)	132437	132390
marley	1000180400	0.00	(-92.89, 516.54, 1772.31)	132436	132390
marley	1000180360	0.03	(-79.77, 523.63, 1794.57)	132435	132390
marley	1000180400	0.02	(-106.70, 499.59, 1752.15)	132434	132390
marley	1000180400	0.01	(-109.09, 498.01, 1755.63)	132433	132390
marley	1000180400	0.00	(-118.21, 512.08, 1760.93)	132432	132390
marley	1000180360	0.00	(-125.65, 527.62, 1756.93)	132431	132390
marley	1000180400	0.03	(-124.99, 587.23, 1728.34)	132430	132390
marley	1000180400	0.01	(-127.67, 583.83, 1727.94)	132429	132390
marley	1000180400	0.03	(-126.03, 581.92, 1725.51)	132428	132390
marley	1000180400	0.01	(-117.27, 591.05, 1734.30)	132427	132390
marley	1000180400	0.01	(-120.57, 598.22, 1737.37)	132426	132390
marley	1000180400	0.04	(-204.69, 600.01, 1773.06)	132425	132390
marley	1000180360	0.02	(-139.42, 595.23, 1780.75)	132424	132390
marley	1000180400	0.01	(-138.95, 597.39, 1780.82)	132423	132390
marley	1000180400	0.02	(-120.80, 621.99, 1802.39)	132422	132390
marley	1000180400	0.04	(-155.78, 635.73, 1816.22)	132421	132390
marley	1000180400	0.04	(-130.19, 632.63, 1840.10)	132420	132390
marley	1000180400	0.00	(-117.61, 597.55, 1777.00)	132419	132390
marley	1000180400	0.06	(-188.97, 579.65, 1309.82)	132418	132390
marley	1000180360	0.03	(-172.89, 563.37, 1350.41)	132417	132390
marley	1000180400	0.02	(-199.01, 573.61, 1374.68)	132416	132390
marley	1000180400	0.03	(-202.27, 559.22, 1393.96)	132415	132390
marley	1000180400	0.03	(-232.27, 555.75, 1392.59)	132414	132390
marley	1000180400	0.03	(-239.56, 459.42, 1447.58)	132413	132390
marley	22		3.02	(-205.11, 441.18, 1444.10)	132391	0
marley	2112		0.73	(-205.11, 441.18, 1444.10)	132390	0
marley	1000190390	0.06	(-205.11, 441.18, 1444.10)	132389	0
marley	11		36.59	(-205.11, 441.18, 1444.10)	132388	0
Signal Track IDs: 132388; 132389; 132390; 132391; 132413; 132414; 132415; 132416; 132417; 132418; 132419; 132420; 132421; 132422; 132423; 132424; 132425; 132426; 132427; 132428; 132429; 132430; 132431; 132432; 132433; 132434; 132435; 132436; 132437; 132438; 132439; 132440; 132441; 132442; 132443; 132444; 132445; 132446; 132447; 132448; 132449; 132450; 132451; 132452; 132453; 132454; 132455; 132456; 132457; 132458; 132459; 132460; 132461; 132462; 132463; 132464; 132465; 132466; 132467; 132468; 132469; 132470; 132471; 132472; 132473; 132474; 132475; 132478; 132479; 132534; 132535; 132537; 132538; 
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  20-Jan-2026 22:49:18 UTC run: 5068 subRun: 0 event: 39469

Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.

%MSG
Begin processing the 10th record. run: 5068 subRun: 0 event: 39470 at 20-Jan-2026 22:49:19 UTC
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  20-Jan-2026 22:49:25 UTC run: 5068 subRun: 0 event: 39470

###################################################
Event:			39470
Flag:			2039687899
Geometry:		dunevd10kt_3view_30deg_v5_refactored_1x8x14ref (VD)
Signal Label:		marley
PDS Frequency in [MHz]:	62.50
PDS Tick in [us]:	0.016
TPC Frequency in [MHz]:	2.00
TPC Tick in [us]:	0.50
TPC Map:		112 TPCs
TPC DriftLength in [cm]:650.07
TPC DriftTime in [us]:	4048.69
Fiducial Volume in [cm]:850.32, 1507.84, 2306.12
###################################################
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  20-Jan-2026 22:49:27 UTC run: 5068 subRun: 0 event: 39470

There are a total of 132887 Particles in the event

# of particles 9	from gen 1 marley
# of particles 31123	from gen 2 Ar39GenInLAr
# of particles 3534	from gen 3 Kr85GenInLAr
# of particles 4	from gen 4 Ar42GenInLAr
# of particles 1	from gen 5 K42From42ArGenInLAr
# of particles 27	from gen 6 Rn222ChainRn222GenInLAr
# of particles 23	from gen 7 Rn222ChainPo218GenInLAr
# of particles 68	from gen 8 Rn222ChainPb214GenInLAr
# of particles 53	from gen 9 Rn222ChainBi214GenInLAr
# of particles 14	from gen 10 Rn222ChainPb210GenInLAr
# of particles 25	from gen 11 Rn220ChainPb212GenInLAr
# of particles 251	from gen 12 K40GenInCathode
# of particles 2974	from gen 13 U238ChainGenInCathode
# of particles 3610	from gen 14 Th232ChainGenInCathode
# of particles 99	from gen 15 K40GenInAnode
# of particles 1361	from gen 16 U238ChainGenInAnode
# of particles 1629	from gen 17 Th232ChainGenInAnode
# of particles 0	from gen 18 Rn222ChainGenInPDS
# of particles 2	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 1	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 22	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 52	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 44	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 34	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 38	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 41	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  20-Jan-2026 22:49:27 UTC run: 5068 subRun: 0 event: 39470

Number of Signal Particles: 8
Neutrino Interaction: -1
Neutrino Energy: 31.47 MeV
Position (260.89, 99.85, 1194.34) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.15	(260.89, 99.85, 1194.34)	132911	132840
marley	-12		1.16	(260.89, 99.85, 1194.34)	132910	132840
marley	1000200400	0.00	(260.89, 99.85, 1194.34)	132909	132840
marley	22		0.03	(260.89, 99.85, 1194.34)	132844	0
marley	22		0.77	(260.89, 99.85, 1194.34)	132843	0
marley	22		0.84	(260.89, 99.85, 1194.34)	132842	0
marley	22		0.65	(260.89, 99.85, 1194.34)	132841	0
marley	1000190400	0.00	(260.89, 99.85, 1194.34)	132840	0
marley	11		27.67	(260.89, 99.85, 1194.34)	132839	0
Signal Track IDs: 132839; 132840; 132841; 132842; 132843; 132844; 132909; 132910; 132911; 
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  20-Jan-2026 22:49:27 UTC run: 5068 subRun: 0 event: 39470

Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.

%MSG
20-Jan-2026 22:49:28 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/34/1b/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T212003Z_gen_003947_supernova_g4stage1_g4stage2_detsim_reco_20250701T045600Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 20-Jan-2026 22:49:28 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          2.34879       461.996       4595.11       2.51059       1377.7         10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00112423     0.0172034     0.0737069    0.00704028     0.0232882       10     
end_path:solarnuana:SolarNuAna      2.34697       461.978       4595.1        2.47915       1377.71        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 20-Jan-2026 22:49:28 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3176.85 MB
  Peak resident set size usage (VmHWM): 2552.52 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 4651.189396 Real = 4687.051385

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3176.85 VmHWM = 2552.52

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-04 05:49:54 UTC       justIN version: 01.06.00