justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 294329.5@dunegpschedd01.fnal.gov

Jobsub ID294329.5@dunegpschedd01.fnal.gov
Workflow ID12015
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-20 15:08:43
SiteUS_FNAL-T1
EntryCMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat2026-01-21 00:08:59
From worker nodeHostnamedunegli-50386-0-cmswn2355.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-20 21:42:57
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T004925Z_gen_000155_supernova_g4stage1_g4stage2_detsim_reco_20250701T174557Z_reco2.root
JobscriptExit code0
Real time2h (8742s)
CPU time2h (8556s = 97%)
Max RSS bytes2551894016 (2433 MiB)
Outputting started2026-01-21 00:08:40
Output files
Finished2026-01-21 00:08:59
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

nRn222GenInLAr
# of particles 28	from gen 7 Rn222ChainPo218GenInLAr
# of particles 68	from gen 8 Rn222ChainPb214GenInLAr
# of particles 42	from gen 9 Rn222ChainBi214GenInLAr
# of particles 17	from gen 10 Rn222ChainPb210GenInLAr
# of particles 29	from gen 11 Rn220ChainPb212GenInLAr
# of particles 234	from gen 12 K40GenInCathode
# of particles 2883	from gen 13 U238ChainGenInCathode
# of particles 3502	from gen 14 Th232ChainGenInCathode
# of particles 91	from gen 15 K40GenInAnode
# of particles 1330	from gen 16 U238ChainGenInAnode
# of particles 1565	from gen 17 Th232ChainGenInAnode
# of particles 3	from gen 18 Rn222ChainGenInPDS
# of particles 4	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 1	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 22	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 70	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 50	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 41	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 28	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 83844	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3566	from gen 27 foamGammasAtLAr1x8x14
# of particles 0	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 0	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  21-Jan-2026 00:08:30 UTC run: 5019 subRun: 0 event: 1549

Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 45.12 MeV
Position (13.37, -244.65, 770.09) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.62	(13.37, -244.65, 770.09)	131892	131830
marley	-12		0.09	(13.37, -244.65, 770.09)	131891	131830
marley	1000180360	0.00	(13.37, -244.65, 770.09)	131890	131830
marley	22		0.78	(13.37, -244.65, 770.09)	131833	0
marley	22		1.74	(13.37, -244.65, 770.09)	131832	0
marley	1000020040	6.40	(13.37, -244.65, 770.09)	131831	0
marley	1000170360	0.91	(13.37, -244.65, 770.09)	131830	0
marley	11		27.34	(13.37, -244.65, 770.09)	131829	0
Signal Track IDs: 131829; 131830; 131831; 131832; 131833; 131890; 131891; 131892; 
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  21-Jan-2026 00:08:30 UTC run: 5019 subRun: 0 event: 1549

Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.

%MSG
Begin processing the 10th record. run: 5019 subRun: 0 event: 1550 at 21-Jan-2026 00:08:30 UTC
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  21-Jan-2026 00:08:36 UTC run: 5019 subRun: 0 event: 1550

###################################################
Event:			1550
Flag:			889717310
Geometry:		dunevd10kt_3view_30deg_v5_refactored_1x8x14ref (VD)
Signal Label:		marley
PDS Frequency in [MHz]:	62.50
PDS Tick in [us]:	0.016
TPC Frequency in [MHz]:	2.00
TPC Tick in [us]:	0.50
TPC Map:		112 TPCs
TPC DriftLength in [cm]:650.07
TPC DriftTime in [us]:	4048.69
Fiducial Volume in [cm]:850.32, 1507.84, 2306.12
###################################################
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  21-Jan-2026 00:08:38 UTC run: 5019 subRun: 0 event: 1550

There are a total of 133068 Particles in the event

# of particles 28	from gen 1 marley
# of particles 31012	from gen 2 Ar39GenInLAr
# of particles 3540	from gen 3 Kr85GenInLAr
# of particles 3	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 30	from gen 6 Rn222ChainRn222GenInLAr
# of particles 24	from gen 7 Rn222ChainPo218GenInLAr
# of particles 58	from gen 8 Rn222ChainPb214GenInLAr
# of particles 58	from gen 9 Rn222ChainBi214GenInLAr
# of particles 16	from gen 10 Rn222ChainPb210GenInLAr
# of particles 24	from gen 11 Rn220ChainPb212GenInLAr
# of particles 245	from gen 12 K40GenInCathode
# of particles 3015	from gen 13 U238ChainGenInCathode
# of particles 3657	from gen 14 Th232ChainGenInCathode
# of particles 107	from gen 15 K40GenInAnode
# of particles 1389	from gen 16 U238ChainGenInAnode
# of particles 1702	from gen 17 Th232ChainGenInAnode
# of particles 3	from gen 18 Rn222ChainGenInPDS
# of particles 2	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 1	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 18	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 61	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 62	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 40	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 41	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 84	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  21-Jan-2026 00:08:39 UTC run: 5019 subRun: 0 event: 1550

Number of Signal Particles: 5
Neutrino Interaction: -1
Neutrino Energy: 31.29 MeV
Position (-160.38, 397.07, 1000.59) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	22		1.29	(-414.02, 544.85, 1035.15)	132996	132988
marley	1000190410	0.00	(-414.02, 544.85, 1035.15)	132995	132988
marley	11		0.83	(-414.02, 544.85, 1035.15)	132990	132987
marley	-12		0.37	(-414.02, 544.85, 1035.15)	132989	132987
marley	1000190419	0.00	(-414.02, 544.85, 1035.15)	132988	132987
marley	1000180410	0.00	(-414.02, 544.85, 1035.15)	132987	132957
marley	22		2.97	(-414.02, 544.85, 1035.15)	132986	132957
marley	22		2.73	(-414.02, 544.85, 1035.15)	132985	132957
marley	22		2.90	(-414.02, 544.85, 1035.15)	132984	132957
marley	22		0.44	(-414.02, 544.85, 1035.15)	132983	132957
marley	22		3.78	(-414.02, 544.85, 1035.15)	132982	132957
marley	22		1.91	(-414.02, 544.85, 1035.15)	132981	132957
marley	22		4.20	(-414.02, 544.85, 1035.15)	132980	132957
marley	2212		0.00	(-426.94, 507.79, 973.36)	132972	132957
marley	2212		0.00	(-438.15, 500.80, 968.72)	132970	132957
marley	2212		0.00	(-444.70, 487.65, 976.03)	132968	132957
marley	2212		0.00	(-442.07, 484.26, 982.28)	132966	132957
marley	2212		0.00	(-442.35, 484.15, 983.15)	132965	132957
marley	2212		0.00	(-443.52, 484.39, 984.28)	132964	132957
marley	2212		0.00	(-459.75, 472.40, 992.27)	132963	132957
marley	2212		0.00	(-459.25, 465.23, 999.21)	132962	132957
marley	2212		0.00	(-461.54, 462.17, 1007.23)	132961	132957
marley	2212		0.00	(-459.70, 461.29, 1014.14)	132960	132957
marley	2212		0.12	(-456.52, 458.24, 1030.12)	132959	132957
marley	2212		0.03	(-452.94, 459.02, 1030.32)	132958	132957
marley	2112		0.16	(-160.38, 397.07, 1000.59)	132957	0
marley	1000190390	0.00	(-160.38, 397.07, 1000.59)	132956	0
marley	11		21.83	(-160.38, 397.07, 1000.59)	132955	0
Signal Track IDs: 132955; 132956; 132957; 132958; 132959; 132960; 132961; 132962; 132963; 132964; 132965; 132966; 132968; 132970; 132972; 132980; 132981; 132982; 132983; 132984; 132985; 132986; 132987; 132988; 132989; 132990; 132995; 132996; 
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  21-Jan-2026 00:08:39 UTC run: 5019 subRun: 0 event: 1550

Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.

%MSG
21-Jan-2026 00:08:39 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/69/c1/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T004925Z_gen_000155_supernova_g4stage1_g4stage2_detsim_reco_20250701T174557Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 21-Jan-2026 00:08:39 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          2.27747       857.108       4409.49       2.55498       1710.2         10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00112233      6.22514       62.1744     0.00873942      18.6498        10     
end_path:solarnuana:SolarNuAna      2.26291       850.882       4409.49       2.54419       1698.32        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 21-Jan-2026 00:08:39 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3175 MB
  Peak resident set size usage (VmHWM): 2551.89 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 8509.616810 Real = 8693.029764

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3175 VmHWM = 2551.89

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-04 04:28:30 UTC       justIN version: 01.06.00