justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 241932.15@dunegpschedd02.fnal.gov

Jobsub ID241932.15@dunegpschedd02.fnal.gov
Workflow ID9959
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-12 04:20:46
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-11-13 08:11:09
From worker nodeHostnamedunegli-7728632-0-fnpc23013.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2025-11-13 03:51:29
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T194735Z_gen_004348_supernova_g4stage1_g4stage2_detsim_reco_20250611T013454Z_reco2.root
JobscriptExit code0
Real time4h (15572s)
CPU time4h (15437s = 99%)
Max RSS bytes1913286656 (1824 MiB)
Outputting started2025-11-13 08:11:02
Output files
Finished2025-11-13 08:11:09
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

)
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Nov-2025 08:10:55 UTC run: 4969 subRun: 0 event: 43478
-----------------------------------------------------------------------------------------

%MSG
Begin processing the 9th record. run: 4969 subRun: 0 event: 43479 at 13-Nov-2025 08:10:55 UTC
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Nov-2025 08:10:57 UTC run: 4969 subRun: 0 event: 43479

###################################################
Event:			43479
Flag:			1888517570
Geometry:		dunevd10kt_3view_30deg_v5_refactored_1x8x14ref (VD)
Signal Label:		marley
PDS Frequency in [MHz]:	62.50
PDS Tick in [us]:	0.016
TPC Frequency in [MHz]:	2.00
TPC Tick in [us]:	0.50
TPC Map:		112 TPCs
TPC DriftLength in [cm]:650.07
TPC DriftTime in [us]:	4048.69
Fiducial Volume in [cm]:850.32, 1507.84, 2306.12
###################################################
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Nov-2025 08:10:58 UTC run: 4969 subRun: 0 event: 43479

There are a total of 132521 Particles in the event

# of particles 7	from gen 1 marley
# of particles 31134	from gen 2 Ar39GenInLAr
# of particles 3494	from gen 3 Kr85GenInLAr
# of particles 4	from gen 4 Ar42GenInLAr
# of particles 1	from gen 5 K42From42ArGenInLAr
# of particles 37	from gen 6 Rn222ChainRn222GenInLAr
# of particles 23	from gen 7 Rn222ChainPo218GenInLAr
# of particles 69	from gen 8 Rn222ChainPb214GenInLAr
# of particles 31	from gen 9 Rn222ChainBi214GenInLAr
# of particles 21	from gen 10 Rn222ChainPb210GenInLAr
# of particles 11	from gen 11 Rn220ChainPb212GenInLAr
# of particles 239	from gen 12 K40GenInCathode
# of particles 3019	from gen 13 U238ChainGenInCathode
# of particles 3647	from gen 14 Th232ChainGenInCathode
# of particles 107	from gen 15 K40GenInAnode
# of particles 1319	from gen 16 U238ChainGenInAnode
# of particles 1673	from gen 17 Th232ChainGenInAnode
# of particles 1	from gen 18 Rn222ChainGenInPDS
# of particles 0	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 1	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 41	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 82	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 58	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 43	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 49	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 83844	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3566	from gen 27 foamGammasAtLAr1x8x14
# of particles 0	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 0	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Nov-2025 08:10:58 UTC run: 4969 subRun: 0 event: 43479

Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 39.13 MeV
Position (-40.01, 381.38, 2071.67) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.08	(-40.01, 381.38, 2071.67)	132583	132516
marley	-12		0.49	(-40.01, 381.38, 2071.67)	132582	132516
marley	22		1.27	(-40.01, 381.38, 2071.67)	132519	0
marley	22		2.47	(-40.01, 381.38, 2071.67)	132518	0
marley	2212		3.04	(-40.01, 381.38, 2071.67)	132517	0
marley	1000180390	0.12	(-40.01, 381.38, 2071.67)	132516	0
marley	11		23.14	(-40.01, 381.38, 2071.67)	132515	0
Signal Track IDs: 132515; 132516; 132517; 132518; 132519; 132582; 132583; 
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Nov-2025 08:10:58 UTC run: 4969 subRun: 0 event: 43479

Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.

%MSG
Begin processing the 10th record. run: 4969 subRun: 0 event: 43480 at 13-Nov-2025 08:10:58 UTC
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Nov-2025 08:11:00 UTC run: 4969 subRun: 0 event: 43480

###################################################
Event:			43480
Flag:			1667641685
Geometry:		dunevd10kt_3view_30deg_v5_refactored_1x8x14ref (VD)
Signal Label:		marley
PDS Frequency in [MHz]:	62.50
PDS Tick in [us]:	0.016
TPC Frequency in [MHz]:	2.00
TPC Tick in [us]:	0.50
TPC Map:		112 TPCs
TPC DriftLength in [cm]:650.07
TPC DriftTime in [us]:	4048.69
Fiducial Volume in [cm]:850.32, 1507.84, 2306.12
###################################################
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Nov-2025 08:11:01 UTC run: 4969 subRun: 0 event: 43480

There are a total of 133276 Particles in the event

# of particles 9	from gen 1 marley
# of particles 31240	from gen 2 Ar39GenInLAr
# of particles 3490	from gen 3 Kr85GenInLAr
# of particles 3	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 36	from gen 6 Rn222ChainRn222GenInLAr
# of particles 29	from gen 7 Rn222ChainPo218GenInLAr
# of particles 60	from gen 8 Rn222ChainPb214GenInLAr
# of particles 61	from gen 9 Rn222ChainBi214GenInLAr
# of particles 15	from gen 10 Rn222ChainPb210GenInLAr
# of particles 21	from gen 11 Rn220ChainPb212GenInLAr
# of particles 228	from gen 12 K40GenInCathode
# of particles 3144	from gen 13 U238ChainGenInCathode
# of particles 3630	from gen 14 Th232ChainGenInCathode
# of particles 109	from gen 15 K40GenInAnode
# of particles 1350	from gen 16 U238ChainGenInAnode
# of particles 1670	from gen 17 Th232ChainGenInAnode
# of particles 4	from gen 18 Rn222ChainGenInPDS
# of particles 1	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 2	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 29	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 46	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 79	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 47	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 38	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 87	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Nov-2025 08:11:01 UTC run: 4969 subRun: 0 event: 43480

Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 58.15 MeV
Position (34.02, 677.32, 787.94) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	22		1.46	(34.02, 677.32, 787.94)	133220	133183
marley	1000180400	0.00	(34.02, 677.32, 787.94)	133219	133183
marley	12		0.04	(34.02, 677.32, 787.94)	133218	133183
marley	11		0.00	(34.02, 677.32, 787.94)	133216	133183
marley	22		0.03	(34.02, 677.32, 787.94)	133186	0
marley	22		0.77	(34.02, 677.32, 787.94)	133185	0
marley	22		4.38	(34.02, 677.32, 787.94)	133184	0
marley	1000190400	0.07	(34.02, 677.32, 787.94)	133183	0
marley	11		51.39	(34.02, 677.32, 787.94)	133182	0
Signal Track IDs: 133182; 133183; 133184; 133185; 133186; 133216; 133218; 133219; 133220; 
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Nov-2025 08:11:01 UTC run: 4969 subRun: 0 event: 43480

Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.

%MSG
13-Nov-2025 08:11:01 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/c7/6a/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T194735Z_gen_004348_supernova_g4stage1_g4stage2_detsim_reco_20250611T013454Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 13-Nov-2025 08:11:01 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.588508       1552.16       3674.52       1646.01       1448.61        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000559189   0.00822343     0.0197647     0.0057157    0.00740722       10     
end_path:solarnuana:SolarNuAna     0.587818       1552.15       3674.5         1646         1448.6         10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 13-Nov-2025 08:11:01 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2538.86 MB
  Peak resident set size usage (VmHWM): 1913.29 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 15421.884098 Real = 15550.490273

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 2538.86 VmHWM = 1913.29

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-10 06:22:49 UTC       justIN version: 01.06.00