justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 293463.0@dunegpschedd02.fnal.gov

Jobsub ID293463.0@dunegpschedd02.fnal.gov
Workflow ID12147
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-22 08:48:47
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2026-01-22 11:58:19
From worker nodeHostnamedunegli-8388883-0-fnpc23049.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-22 08:49:36
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T223443Z_gen_002247_supernova_g4stage1_g4stage2_detsim_reco_20250703T100524Z_reco2.root
JobscriptExit code0
Real time3h (11313s)
CPU time3h (11186s = 98%)
Max RSS bytes2564399104 (2445 MiB)
Outputting started2026-01-22 11:58:09
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/12147/1/001/fdhd_ana_2026-01-22T_084947Z_hist.root
Finished2026-01-22 11:58:19
Saved logsjustin-logs:293463.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

C Frequency in [MHz]:	2.00
TPC Tick in [us]:	0.50
TPC Map:		112 TPCs
TPC DriftLength in [cm]:650.07
TPC DriftTime in [us]:	4048.69
Fiducial Volume in [cm]:850.32, 1507.84, 2306.12
###################################################
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 11:15:42 UTC run: 5013 subRun: 0 event: 22470

There are a total of 132811 Particles in the event

# of particles 8	from gen 1 marley
# of particles 30981	from gen 2 Ar39GenInLAr
# of particles 3498	from gen 3 Kr85GenInLAr
# of particles 3	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 29	from gen 6 Rn222ChainRn222GenInLAr
# of particles 26	from gen 7 Rn222ChainPo218GenInLAr
# of particles 38	from gen 8 Rn222ChainPb214GenInLAr
# of particles 46	from gen 9 Rn222ChainBi214GenInLAr
# of particles 26	from gen 10 Rn222ChainPb210GenInLAr
# of particles 25	from gen 11 Rn220ChainPb212GenInLAr
# of particles 226	from gen 12 K40GenInCathode
# of particles 2946	from gen 13 U238ChainGenInCathode
# of particles 3812	from gen 14 Th232ChainGenInCathode
# of particles 106	from gen 15 K40GenInAnode
# of particles 1374	from gen 16 U238ChainGenInAnode
# of particles 1577	from gen 17 Th232ChainGenInAnode
# of particles 0	from gen 18 Rn222ChainGenInPDS
# of particles 1	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 1	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 40	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 54	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 41	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 43	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 52	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 10	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 11:15:42 UTC run: 5013 subRun: 0 event: 22470

Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 18.13 MeV
Position (-45.59, 238.83, 1118.23) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.43	(-45.59, 238.83, 1118.23)	132828	132793
marley	-12		0.88	(-45.59, 238.83, 1118.23)	132827	132793
marley	1000200400	0.00	(-45.59, 238.83, 1118.23)	132826	132793
marley	22		0.03	(-45.59, 238.83, 1118.23)	132796	0
marley	22		1.61	(-45.59, 238.83, 1118.23)	132795	0
marley	22		0.65	(-45.59, 238.83, 1118.23)	132794	0
marley	1000190400	0.01	(-45.59, 238.83, 1118.23)	132793	0
marley	11		14.33	(-45.59, 238.83, 1118.23)	132792	0
Signal Track IDs: 132792; 132793; 132794; 132795; 132796; 132826; 132827; 132828; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 11:15:42 UTC run: 5013 subRun: 0 event: 22470

Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 11:16:44 UTC run: 5013 subRun: 0 event: 22470
OpFlash PE 25.79 with purity 0.23 time 0.42 plane 1
 - Vertex (227.56, 743.30, 1198.35)
	*** 1st Sanity check: Ratio 0.28 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 444.86 with purity 0.23 time 0.35 plane 0
 - Vertex (-327.50, 317.56, 1105.00)
	*** 1st Sanity check: Ratio 0.07 <= 1.00
	*** 2nd Sanity check: #OpHits 31 >= 31
OpFlash PE 9.02 with purity 0.14 time 1.16 plane 1
 - Vertex (285.07, 743.30, 450.26)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 12.57 with purity 1.00 time 1.70 plane 1
 - Vertex (206.84, 743.30, 1499.11)
	*** 1st Sanity check: Ratio 0.52 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 29.54 with purity 0.18 time 2.32 plane 0
 - Vertex (-327.50, 50.64, 777.42)
	*** 1st Sanity check: Ratio 0.24 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 7.68 with purity 1.00 time 3.54 plane 0
 - Vertex (-327.50, 628.80, 707.10)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 6.07 with purity 0.50 time 6.15 plane 0
 - Vertex (-327.50, -632.80, 1675.62)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1

# of OpHits (ophit10ppm): 52051 for times between -4253.99 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 18134 for times between -4253.99 us and 295147919198126080.00 us.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 11:16:46 UTC run: 5013 subRun: 0 event: 22470

# OpHits (ophit10ppm) in full geometry: 52051
# OpFlashes (solarflash) in full geometry: 18134
# Hits (gaushit) in each view: 6555, 6572, 6493, 0
# Cluster from the hits: 2709, 2756, 5490, 0
# Tracks (pmtracktc) in full geometry: 447
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 11:58:07 UTC run: 5013 subRun: 0 event: 22470

# ClusterReco: Looping over 5476 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 11:58:07 UTC run: 5013 subRun: 0 event: 22470
*** Matched preselection cluster: 2921 from 5476
 - MainTrackID 132792
 - Gen 1 -> marley TPC 61
 - Purity 1.00 Hits 7
 - Charge 1702.86 ( MaxHit 442.80 )
 - #AdjCl 12 ( 0 signal ):
    - Cluster 2262 at distance 99.07 with time 1807.17 and charge 77.09 in TPC 61 and hits 1
    - Cluster 2397 at distance 91.17 with time 1907.51 and charge 112.23 in TPC 61 and hits 2
    - Cluster 2559 at distance 64.23 with time 2039.07 and charge 89.25 in TPC 61 and hits 2
    - Cluster 2567 at distance 82.40 with time 2041.88 and charge 53.75 in TPC 63 and hits 1
    - Cluster 2668 at distance 87.55 with time 2124.54 and charge 183.30 in TPC 61 and hits 2
    - Cluster 2746 at distance 92.47 with time 2184.91 and charge 37.50 in TPC 61 and hits 1
    - Cluster 2788 at distance 91.03 with time 2215.10 and charge 26.16 in TPC 63 and hits 1
    - Cluster 2917 at distance 69.60 with time 2312.66 and charge 37.02 in TPC 57 and hits 1
    - Cluster 3096 at distance 64.77 with time 2437.35 and charge 45.28 in TPC 63 and hits 1
    - Cluster 3331 at distance 92.81 with time 2604.15 and charge 26.84 in TPC 59 and hits 1
    - Cluster 3384 at distance 71.80 with time 2639.29 and charge 29.93 in TPC 57 and hits 1
    - Cluster 3410 at distance 84.77 with time 2655.39 and charge 55.99 in TPC 61 and hits 1
 - RecoCol  Time,Y,Z ( 2317.75, 236.24, 1119.21 )
 - RecoInd0 Time,Y,Z ( 2317.81, 236.25, 1120.40 )
 - RecoInd1 Time,Y,Z ( 2317.93, 236.23, 1120.40 )
*** Matched flash: 9153 from 18134
 - Purity 23.08 % Plane 0 #Hits 31
 - MainOpHitPE 32.34 (PE);  TotalPE 444.86 vs expected 330.24 (PE)
 - Time 0.35 (us) Fast 12.97 % Residual 151.49
 - Reco Time,Y,Z ( 0.35, 317.56, 1105.00 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -45.59, 238.83, 1118.23 )
 - Main X,Y,Z ( -48.82, 234.45, 1119.89 )
 - EDep X,Y,Z ( -48.12, 235.05, 1119.75 )
 - Reco X,Y,Z ( -47.05, 236.24, 1119.21 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 11:58:07 UTC run: 5013 subRun: 0 event: 22470
-----------------------------------------------------------------------------------------

%MSG
22-Jan-2026 11:58:08 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/15/2c/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T223443Z_gen_002247_supernova_g4stage1_g4stage2_detsim_reco_20250703T100524Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 22-Jan-2026 11:58:08 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          0.53394       1126.95       2546.18       950.35        1143.34        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000728204   0.00771844     0.0199426    0.00658696    0.00673474       10     
end_path:solarnuana:SolarNuAna     0.533083       1126.94       2546.18       950.338       1143.33        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 22-Jan-2026 11:58:08 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3184.96 MB
  Peak resident set size usage (VmHWM): 2564.4 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 11175.180622 Real = 11293.834074

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3184.96 VmHWM = 2564.4

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-05 14:10:37 UTC       justIN version: 01.06.00