justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 288544.43@dunegpschedd02.fnal.gov

Jobsub ID288544.43@dunegpschedd02.fnal.gov
Workflow ID12007
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-20 14:48:38
SiteUS_FNAL-T1
EntryCMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat2026-01-20 19:38:50
From worker nodeHostnamedunegli-50386-0-cmswn2355.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-20 14:57:44
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T215013Z_gen_004435_supernova_g4stage1_g4stage2_detsim_reco_20250730T143642Z_reco2.root
JobscriptExit code0
Real time4h (16846s)
CPU time4h (16531s = 98%)
Max RSS bytes2569060352 (2450 MiB)
Outputting started2026-01-20 19:38:30
Output files
Finished2026-01-20 19:38:50
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  20-Jan-2026 19:37:10 UTC run: 5026 subRun: 0 event: 44349
-----------------------------------------------------------------------------------------

%MSG
Begin processing the 10th record. run: 5026 subRun: 0 event: 44350 at 20-Jan-2026 19:37:11 UTC
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  20-Jan-2026 19:38:25 UTC run: 5026 subRun: 0 event: 44350

###################################################
Event:			44350
Flag:			1616430637
Geometry:		dunevd10kt_3view_30deg_v5_refactored_1x8x14ref (VD)
Signal Label:		marley
PDS Frequency in [MHz]:	62.50
PDS Tick in [us]:	0.016
TPC Frequency in [MHz]:	2.00
TPC Tick in [us]:	0.50
TPC Map:		112 TPCs
TPC DriftLength in [cm]:650.07
TPC DriftTime in [us]:	4048.69
Fiducial Volume in [cm]:850.32, 1507.84, 2306.12
###################################################
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  20-Jan-2026 19:38:27 UTC run: 5026 subRun: 0 event: 44350

There are a total of 132646 Particles in the event

# of particles 59	from gen 1 marley
# of particles 31023	from gen 2 Ar39GenInLAr
# of particles 3539	from gen 3 Kr85GenInLAr
# of particles 4	from gen 4 Ar42GenInLAr
# of particles 1	from gen 5 K42From42ArGenInLAr
# of particles 34	from gen 6 Rn222ChainRn222GenInLAr
# of particles 40	from gen 7 Rn222ChainPo218GenInLAr
# of particles 56	from gen 8 Rn222ChainPb214GenInLAr
# of particles 53	from gen 9 Rn222ChainBi214GenInLAr
# of particles 24	from gen 10 Rn222ChainPb210GenInLAr
# of particles 33	from gen 11 Rn220ChainPb212GenInLAr
# of particles 229	from gen 12 K40GenInCathode
# of particles 2954	from gen 13 U238ChainGenInCathode
# of particles 3541	from gen 14 Th232ChainGenInCathode
# of particles 109	from gen 15 K40GenInAnode
# of particles 1394	from gen 16 U238ChainGenInAnode
# of particles 1501	from gen 17 Th232ChainGenInAnode
# of particles 1	from gen 18 Rn222ChainGenInPDS
# of particles 1	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 3	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 11	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 44	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 27	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 39	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 69	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 9	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  20-Jan-2026 19:38:29 UTC run: 5026 subRun: 0 event: 44350

Number of Signal Particles: 6
Neutrino Interaction: -1
Neutrino Energy: 61.81 MeV
Position (-285.58, 680.47, 1640.23) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.07	(-247.40, 838.81, 1699.97)	132724	132721
marley	-12		0.08	(-247.40, 838.81, 1699.97)	132723	132721
marley	1000060140	0.04	(-247.40, 838.81, 1699.97)	132721	132662
marley	2212		0.58	(-247.40, 838.81, 1699.97)	132720	132662
marley	1000070140	0.00	(-248.07, 838.74, 1700.86)	132719	132662
marley	1000070140	0.00	(-247.34, 838.97, 1700.67)	132718	132662
marley	1000070140	0.00	(-247.75, 838.65, 1701.79)	132717	132662
marley	1000080160	0.00	(-247.79, 838.41, 1702.04)	132715	132662
marley	1000080160	0.00	(-247.83, 838.35, 1701.41)	132714	132662
marley	1000070140	0.00	(-246.23, 838.03, 1702.42)	132713	132662
marley	1000070140	0.00	(-246.34, 837.93, 1702.34)	132712	132662
marley	1000240520	0.00	(-246.17, 837.81, 1702.19)	132711	132662
marley	1000070140	0.00	(-249.23, 837.15, 1705.02)	132710	132662
marley	1000070140	0.00	(-249.88, 836.68, 1704.46)	132709	132662
marley	1000070140	0.00	(-249.74, 836.58, 1704.45)	132708	132662
marley	1000070140	0.00	(-249.92, 835.87, 1704.54)	132707	132662
marley	1000070140	0.00	(-249.40, 835.99, 1704.63)	132706	132662
marley	1000260560	0.00	(-248.70, 836.89, 1704.42)	132704	132662
marley	1000080160	0.00	(-251.88, 836.33, 1707.22)	132703	132662
marley	1000070140	0.00	(-252.89, 834.71, 1706.98)	132702	132662
marley	1000070140	0.00	(-252.80, 834.77, 1706.83)	132701	132662
marley	1000070140	0.00	(-253.12, 834.72, 1706.43)	132700	132662
marley	1000070140	0.00	(-253.10, 834.67, 1706.44)	132699	132662
marley	2212		0.00	(-258.01, 833.48, 1708.75)	132698	132662
marley	1000260560	0.00	(-261.19, 834.02, 1711.77)	132697	132662
marley	1000060120	0.00	(-263.04, 832.71, 1725.12)	132696	132662
marley	2212		0.00	(-286.47, 815.83, 1748.89)	132695	132662
marley	2212		0.01	(-296.49, 810.77, 1766.99)	132694	132662
marley	1000060120	0.00	(-307.25, 805.28, 1766.25)	132693	132662
marley	2212		0.03	(-308.90, 796.55, 1752.77)	132692	132662
marley	1000060120	0.01	(-337.75, 804.40, 1731.66)	132691	132662
marley	2212		0.08	(-330.73, 785.95, 1733.68)	132690	132662
marley	1000060120	0.03	(-322.31, 777.40, 1750.50)	132689	132662
marley	1000180400	0.00	(-310.55, 679.55, 1683.76)	132688	132662
marley	1000180360	0.00	(-311.00, 679.43, 1683.28)	132687	132662
marley	22		1.01	(-320.49, 675.23, 1684.80)	132664	132631
marley	1000130270	0.05	(-320.49, 675.23, 1684.80)	132663	132631
marley	2112		0.17	(-320.49, 675.23, 1684.80)	132662	132631
marley	1000130270	0.01	(-321.08, 675.40, 1681.57)	132661	132631
marley	1000130270	0.13	(-322.53, 675.20, 1678.93)	132660	132631
marley	1000180400	0.03	(-322.45, 678.62, 1679.78)	132659	132631
marley	1000180400	0.05	(-315.87, 691.10, 1669.18)	132658	132631
marley	1000180400	0.15	(-315.02, 696.76, 1672.82)	132657	132631
marley	1000180400	0.06	(-308.17, 677.66, 1651.07)	132656	132631
marley	1000180400	0.17	(-307.18, 678.03, 1650.71)	132655	132631
marley	1000130270	0.01	(-315.88, 676.69, 1656.54)	132654	132631
marley	1000130270	0.07	(-317.13, 676.82, 1658.35)	132653	132631
marley	1000130270	0.04	(-316.85, 675.49, 1659.78)	132652	132631
marley	1000130270	0.03	(-316.19, 675.68, 1662.71)	132651	132631
marley	1000130270	0.31	(-311.81, 675.55, 1666.22)	132650	132631
marley	1000180400	0.01	(-313.32, 674.73, 1663.82)	132649	132631
marley	1000130270	0.11	(-315.85, 674.60, 1661.42)	132648	132631
marley	22		1.46	(-312.40, 677.68, 1651.35)	132633	132580
marley	1000180400	0.06	(-312.40, 677.68, 1651.35)	132632	132580
marley	2112		2.41	(-312.40, 677.68, 1651.35)	132631	132580
marley	22		2.52	(-285.58, 680.47, 1640.23)	132581	0
marley	2112		3.93	(-285.58, 680.47, 1640.23)	132580	0
marley	1000190390	0.29	(-285.58, 680.47, 1640.23)	132579	0
marley	11		45.76	(-285.58, 680.47, 1640.23)	132578	0
Signal Track IDs: 132578; 132579; 132580; 132581; 132631; 132632; 132633; 132648; 132649; 132650; 132651; 132652; 132653; 132654; 132655; 132656; 132657; 132658; 132659; 132660; 132661; 132662; 132663; 132664; 132687; 132688; 132689; 132690; 132691; 132692; 132693; 132694; 132695; 132696; 132697; 132698; 132699; 132700; 132701; 132702; 132703; 132704; 132706; 132707; 132708; 132709; 132710; 132711; 132712; 132713; 132714; 132715; 132717; 132718; 132719; 132720; 132721; 132723; 132724; 
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  20-Jan-2026 19:38:29 UTC run: 5026 subRun: 0 event: 44350

Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.

%MSG
20-Jan-2026 19:38:29 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/e5/1d/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T215013Z_gen_004435_supernova_g4stage1_g4stage2_detsim_reco_20250730T143642Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 20-Jan-2026 19:38:29 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          2.26284       1659.54       5869.82       3.90254       2520.89        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00190621      6.23126       62.1857     0.00993846      18.6515        10     
end_path:solarnuana:SolarNuAna      2.26066       1653.31       5869.82       3.88581       2524.88        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 20-Jan-2026 19:38:29 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3192.24 MB
  Peak resident set size usage (VmHWM): 2569.06 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 16484.481827 Real = 16797.335806

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3192.24 VmHWM = 2569.06

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-04 06:06:51 UTC       justIN version: 01.06.00