justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 241874.6@dunegpschedd02.fnal.gov

Jobsub ID241874.6@dunegpschedd02.fnal.gov
Workflow ID9963
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-12 03:33:42
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-11-13 08:12:37
From worker nodeHostnamedunegli-7728631-0-fnpc22023.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2025-11-13 03:27:27
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T224953Z_gen_003570_supernova_g4stage1_g4stage2_detsim_reco_20250702T192719Z_reco2.root
JobscriptExit code0
Real time4h (17093s)
CPU time4h (15103s = 88%)
Max RSS bytes1922879488 (1833 MiB)
Outputting started2025-11-13 08:12:22
Output files
Finished2025-11-13 08:12:37
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

UTC
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Nov-2025 08:12:19 UTC run: 3799 subRun: 0 event: 35700

###################################################
Event:			35700
Flag:			254693738
Geometry:		dunevd10kt_3view_30deg_v5_refactored_1x8x14ref (VD)
Signal Label:		marley
PDS Frequency in [MHz]:	62.50
PDS Tick in [us]:	0.016
TPC Frequency in [MHz]:	2.00
TPC Tick in [us]:	0.50
TPC Map:		112 TPCs
TPC DriftLength in [cm]:650.07
TPC DriftTime in [us]:	4048.69
Fiducial Volume in [cm]:850.32, 1507.84, 2306.12
###################################################
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Nov-2025 08:12:19 UTC run: 3799 subRun: 0 event: 35700

There are a total of 132669 Particles in the event

# of particles 65	from gen 1 marley
# of particles 30981	from gen 2 Ar39GenInLAr
# of particles 3434	from gen 3 Kr85GenInLAr
# of particles 2	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 32	from gen 6 Rn222ChainRn222GenInLAr
# of particles 35	from gen 7 Rn222ChainPo218GenInLAr
# of particles 38	from gen 8 Rn222ChainPb214GenInLAr
# of particles 50	from gen 9 Rn222ChainBi214GenInLAr
# of particles 7	from gen 10 Rn222ChainPb210GenInLAr
# of particles 19	from gen 11 Rn220ChainPb212GenInLAr
# of particles 218	from gen 12 K40GenInCathode
# of particles 2968	from gen 13 U238ChainGenInCathode
# of particles 3529	from gen 14 Th232ChainGenInCathode
# of particles 123	from gen 15 K40GenInAnode
# of particles 1430	from gen 16 U238ChainGenInAnode
# of particles 1686	from gen 17 Th232ChainGenInAnode
# of particles 0	from gen 18 Rn222ChainGenInPDS
# of particles 5	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 4	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 43	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 43	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 34	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 30	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 30	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 15	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Nov-2025 08:12:20 UTC run: 3799 subRun: 0 event: 35700

Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 62.65 MeV
Position (-7.47, 310.24, 1478.33) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	22		1.29	(-207.93, -541.24, 559.64)	132812	132807
marley	1000190410	0.00	(-207.93, -541.24, 559.64)	132811	132807
marley	11		0.40	(-207.93, -541.24, 559.64)	132810	132807
marley	-12		0.80	(-207.93, -541.24, 559.64)	132809	132807
marley	1000180410	0.00	(-207.93, -541.24, 559.64)	132807	132665
marley	22		1.42	(-207.93, -541.24, 559.64)	132806	132665
marley	22		3.37	(-207.93, -541.24, 559.64)	132805	132665
marley	22		1.92	(-207.93, -541.24, 559.64)	132804	132665
marley	2212		0.00	(-326.25, -275.78, 890.14)	132723	132665
marley	2212		0.00	(-326.13, -276.88, 890.84)	132722	132665
marley	1000180360	0.00	(-320.35, -276.79, 917.28)	132721	132665
marley	2212		0.00	(-328.72, -273.07, 900.40)	132720	132665
marley	2212		0.00	(-328.72, -273.06, 900.40)	132719	132665
marley	2212		0.05	(-328.69, -273.00, 900.29)	132718	132665
marley	1000180360	0.00	(-24.11, 137.06, 1023.44)	132717	132665
marley	1000180360	0.00	(-100.93, 164.28, 985.70)	132716	132665
marley	1000180360	0.00	(-6.97, 257.68, 944.88)	132715	132665
marley	1000180400	0.01	(192.53, 436.84, 940.76)	132714	132665
marley	1000180400	0.00	(142.57, 415.91, 938.91)	132713	132665
marley	1000180400	0.00	(151.71, 400.04, 963.06)	132712	132665
marley	1000180400	0.00	(152.73, 399.74, 962.83)	132711	132665
marley	1000180400	0.00	(153.58, 400.48, 963.58)	132710	132665
marley	1000180400	0.00	(155.17, 394.63, 966.38)	132709	132665
marley	1000180360	0.01	(154.28, 393.90, 966.88)	132708	132665
marley	1000180400	0.01	(154.26, 394.28, 964.65)	132707	132665
marley	1000180400	0.00	(153.98, 392.47, 966.95)	132706	132665
marley	1000180400	0.01	(148.52, 391.32, 972.78)	132705	132665
marley	1000180400	0.01	(188.52, 398.24, 1001.68)	132704	132665
marley	1000180400	0.00	(86.82, 338.62, 1008.61)	132703	132665
marley	1000180400	0.00	(60.14, 354.03, 1010.72)	132702	132665
marley	1000180400	0.01	(55.18, 359.28, 1010.92)	132701	132665
marley	1000180400	0.00	(106.10, 389.58, 966.47)	132700	132665
marley	1000180400	0.01	(106.08, 388.05, 959.97)	132699	132665
marley	1000180400	0.00	(87.69, 380.79, 962.47)	132698	132665
marley	1000180400	0.01	(-43.24, 521.81, 965.34)	132697	132665
marley	1000180360	0.01	(217.32, 575.14, 997.16)	132696	132665
marley	1000180400	0.00	(220.85, 573.03, 988.55)	132695	132665
marley	1000180400	0.01	(250.63, 561.97, 952.25)	132694	132665
marley	1000180400	0.01	(252.50, 559.35, 955.16)	132693	132665
marley	1000180360	0.01	(249.36, 560.19, 955.93)	132692	132665
marley	1000180400	0.01	(249.39, 560.37, 956.01)	132691	132665
marley	1000180400	0.02	(245.36, 555.98, 979.62)	132690	132665
marley	1000180400	0.01	(245.37, 555.98, 979.58)	132689	132665
marley	1000180400	0.02	(247.08, 544.68, 977.30)	132688	132665
marley	1000180400	0.01	(126.23, 587.03, 964.23)	132687	132665
marley	1000180400	0.02	(126.81, 596.64, 969.86)	132686	132665
marley	1000180400	0.03	(123.78, 595.61, 968.26)	132685	132665
marley	1000180400	0.01	(155.06, 615.53, 991.67)	132684	132665
marley	1000180400	0.01	(152.34, 645.36, 982.07)	132683	132665
marley	1000180400	0.01	(139.90, 670.46, 1022.28)	132682	132665
marley	1000180400	0.02	(139.64, 670.27, 1022.41)	132681	132665
marley	1000180400	0.02	(139.96, 670.80, 1023.03)	132680	132665
marley	22		1.46	(-2.96, 324.42, 1478.00)	132667	132648
marley	1000180400	0.08	(-2.96, 324.42, 1478.00)	132666	132648
marley	2112		0.39	(-2.96, 324.42, 1478.00)	132665	132648
marley	1000180400	0.18	(-2.13, 326.16, 1478.12)	132664	132648
marley	1000180400	0.13	(-1.34, 310.28, 1485.28)	132663	132648
marley	22		1.46	(-6.23, 308.47, 1477.82)	132650	132593
marley	1000180400	0.16	(-6.23, 308.47, 1477.82)	132649	132593
marley	2112		2.25	(-6.23, 308.47, 1477.82)	132648	132593
marley	22		3.87	(-7.47, 310.24, 1478.33)	132595	0
marley	22		2.62	(-7.47, 310.24, 1478.33)	132594	0
marley	2112		3.87	(-7.47, 310.24, 1478.33)	132593	0
marley	1000190390	0.36	(-7.47, 310.24, 1478.33)	132592	0
marley	11		42.63	(-7.47, 310.24, 1478.33)	132591	0
Signal Track IDs: 132591; 132592; 132593; 132594; 132595; 132648; 132649; 132650; 132663; 132664; 132665; 132666; 132667; 132680; 132681; 132682; 132683; 132684; 132685; 132686; 132687; 132688; 132689; 132690; 132691; 132692; 132693; 132694; 132695; 132696; 132697; 132698; 132699; 132700; 132701; 132702; 132703; 132704; 132705; 132706; 132707; 132708; 132709; 132710; 132711; 132712; 132713; 132714; 132715; 132716; 132717; 132718; 132719; 132720; 132721; 132722; 132723; 132804; 132805; 132806; 132807; 132809; 132810; 132811; 132812; 
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Nov-2025 08:12:20 UTC run: 3799 subRun: 0 event: 35700

Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.

%MSG
13-Nov-2025 08:12:20 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/88/4c/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T224953Z_gen_003570_supernova_g4stage1_g4stage2_detsim_reco_20250702T192719Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 13-Nov-2025 08:12:20 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.619752       1704.27       2923.3        1988.81       913.484        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000579725   0.00777915     0.0215618    0.00574399    0.00733357       10     
end_path:solarnuana:SolarNuAna     0.604975       1704.26       2923.29       1988.8        913.484        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 13-Nov-2025 08:12:20 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2535.95 MB
  Peak resident set size usage (VmHWM): 1922.88 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 15087.869115 Real = 17073.001510

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 2535.95 VmHWM = 1922.88

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-10 06:21:18 UTC       justIN version: 01.06.00