justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 276577.0@dunegpschedd01.fnal.gov

Jobsub ID276577.0@dunegpschedd01.fnal.gov
Workflow ID11757
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-12 23:22:38
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2026-01-13 09:32:46
From worker nodeHostnamedunegli-8149265-0-fnpc18004.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-13 00:13:14
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T214959Z_gen_003991_supernova_g4stage1_g4stage2_detsim_reco_20250702T134405Z_reco2.root
JobscriptExit code0
Real time9h (33546s)
CPU time9h (33124s = 98%)
Max RSS bytes2582614016 (2462 MiB)
Outputting started2026-01-13 09:32:20
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/11757/1/001/fdhd_ana_2026-01-13T_001338Z_hist.root
Finished2026-01-13 09:32:46
Saved logsjustin-logs:276577.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

################
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Jan-2026 07:59:39 UTC run: 5052 subRun: 0 event: 39910

There are a total of 133293 Particles in the event

# of particles 8	from gen 1 marley
# of particles 31222	from gen 2 Ar39GenInLAr
# of particles 3607	from gen 3 Kr85GenInLAr
# of particles 2	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 35	from gen 6 Rn222ChainRn222GenInLAr
# of particles 29	from gen 7 Rn222ChainPo218GenInLAr
# of particles 59	from gen 8 Rn222ChainPb214GenInLAr
# of particles 53	from gen 9 Rn222ChainBi214GenInLAr
# of particles 5	from gen 10 Rn222ChainPb210GenInLAr
# of particles 43	from gen 11 Rn220ChainPb212GenInLAr
# of particles 209	from gen 12 K40GenInCathode
# of particles 3051	from gen 13 U238ChainGenInCathode
# of particles 3685	from gen 14 Th232ChainGenInCathode
# of particles 111	from gen 15 K40GenInAnode
# of particles 1399	from gen 16 U238ChainGenInAnode
# of particles 1684	from gen 17 Th232ChainGenInAnode
# of particles 0	from gen 18 Rn222ChainGenInPDS
# of particles 0	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 4	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 30	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 61	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 53	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 32	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 59	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 4	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Jan-2026 07:59:39 UTC run: 5052 subRun: 0 event: 39910

Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 28.95 MeV
Position (-266.09, -178.75, 1778.52) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.42	(-266.09, -178.75, 1778.52)	133361	133284
marley	-12		0.89	(-266.09, -178.75, 1778.52)	133360	133284
marley	1000200400	0.00	(-266.09, -178.75, 1778.52)	133359	133284
marley	22		0.03	(-266.09, -178.75, 1778.52)	133287	0
marley	22		3.84	(-266.09, -178.75, 1778.52)	133286	0
marley	22		2.92	(-266.09, -178.75, 1778.52)	133285	0
marley	1000190400	0.01	(-266.09, -178.75, 1778.52)	133284	0
marley	11		20.65	(-266.09, -178.75, 1778.52)	133283	0
Signal Track IDs: 133283; 133284; 133285; 133286; 133287; 133359; 133360; 133361; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Jan-2026 07:59:39 UTC run: 5052 subRun: 0 event: 39910

Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Jan-2026 08:01:42 UTC run: 5052 subRun: 0 event: 39910
OpFlash PE 2466.70 with purity 0.22 time 0.04 plane 0
 - Vertex (-327.50, -170.89, 1788.34)
	*** 1st Sanity check: Ratio 0.18 <= 1.00
	*** 2nd Sanity check: #OpHits 32 >= 32
OpFlash PE 57.29 with purity 0.16 time 0.39 plane 2
 - Vertex (207.18, -743.30, 1184.72)
	*** 1st Sanity check: Ratio 0.24 <= 1.00
	*** 2nd Sanity check: #OpHits 6 >= 6
OpFlash PE 52.29 with purity 0.05 time 0.74 plane 2
 - Vertex (220.95, -743.30, 1433.51)
	*** 1st Sanity check: Ratio 0.21 <= 1.00
	*** 2nd Sanity check: #OpHits 6 >= 6
OpFlash PE 5.61 with purity 0.67 time 1.32 plane 3
 - Vertex (60.07, 220.00, 2188.38)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 43.34 with purity 0.20 time 1.40 plane 0
 - Vertex (-327.50, -533.61, 960.69)
	*** 1st Sanity check: Ratio 0.35 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 6.00 with purity 0.50 time 3.02 plane 3
 - Vertex (60.07, 220.00, 2188.38)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 8.36 with purity 0.67 time 4.14 plane 0
 - Vertex (-327.50, 373.40, 1973.46)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 26.61 with purity 0.14 time 5.39 plane 3
 - Vertex (223.89, 220.00, 2188.38)
	*** 1st Sanity check: Ratio 0.40 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 10.92 with purity 0.23 time 6.55 plane 0
 - Vertex (-327.50, -266.32, 1666.90)
	*** 1st Sanity check: Ratio 0.55 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2

# of OpHits (ophit10ppm): 52420 for times between -4254.31 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 18236 for times between -4254.31 us and 295147919198126080.00 us.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Jan-2026 08:01:47 UTC run: 5052 subRun: 0 event: 39910

# OpHits (ophit10ppm) in full geometry: 52420
# OpFlashes (solarflash) in full geometry: 18236
# Hits (gaushit) in each view: 7111, 7023, 6806, 0
# Cluster from the hits: 2914, 2964, 5789, 0
# Tracks (pmtracktc) in full geometry: 514
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Jan-2026 09:32:16 UTC run: 5052 subRun: 0 event: 39910

# ClusterReco: Looping over 5786 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Jan-2026 09:32:16 UTC run: 5052 subRun: 0 event: 39910
*** Matched preselection cluster: 4939 from 5786
 - MainTrackID 133283
 - Gen 1 -> marley TPC 90
 - Purity 1.00 Hits 11
 - Charge 1826.99 ( MaxHit 283.68 )
 - #AdjCl 13 ( 3 signal ):
    - Cluster 4382 at distance 65.33 with time 3255.54 and charge 75.19 in TPC 90 and hits 1
    - Cluster 4626 at distance 95.94 with time 3433.85 and charge 30.37 in TPC 102 and hits 1
    - Cluster 4676 at distance 54.55 with time 3480.26 and charge 72.65 in TPC 98 and hits 1
    - Cluster 4697 at distance 42.14 with time 3494.18 and charge 148.41 in TPC 90 and hits 2
    - Cluster 4709 at distance 83.40 with time 3502.37 and charge 29.44 in TPC 94 and hits 1
    - Cluster 4845 at distance 73.88 with time 3604.10 and charge 119.80 in TPC 90 and hits 2
    - Cluster 4913 at distance 57.07 with time 3644.20 and charge 23.18 in TPC 100 and hits 1
    - Cluster 4952 at distance 13.55 with time 3666.22 and charge 99.92 in TPC 90 and hits 2
    - Cluster 4962 at distance 64.74 with time 3676.68 and charge 24.70 in TPC 92 and hits 1
    - Cluster 5328 at distance 87.85 with time 3909.19 and charge 30.63 in TPC 90 and hits 1
    - Cluster 5351 at distance 52.82 with time 3924.01 and charge 40.25 in TPC 88 and hits 1
    - Cluster 5542 at distance 77.30 with time 4057.17 and charge 24.02 in TPC 88 and hits 1
    - Cluster 5630 at distance 94.35 with time 4131.24 and charge 22.18 in TPC 100 and hits 1
 - RecoCol  Time,Y,Z ( 3658.42, -179.76, 1780.74 )
 - RecoInd0 Time,Y,Z ( 3659.53, -179.78, 1776.55 )
 - RecoInd1 Time,Y,Z ( 3659.39, -179.73, 1718.08 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -266.09, -178.75, 1778.52 )
 - Main X,Y,Z ( -259.32, -180.75, 1782.01 )
 - EDep X,Y,Z ( -259.33, -180.67, 1781.97 )
 - Reco X,Y,Z ( -1000000.00, -179.76, 1780.74 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  13-Jan-2026 09:32:16 UTC run: 5052 subRun: 0 event: 39910
-----------------------------------------------------------------------------------------

%MSG
13-Jan-2026 09:32:17 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/ec/41/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T214959Z_gen_003991_supernova_g4stage1_g4stage2_detsim_reco_20250702T134405Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 13-Jan-2026 09:32:17 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          1.59793       3343.4        6573.83       4546.5        2802.73        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00278675     0.0104285     0.0242604    0.00733184    0.00795346       10     
end_path:solarnuana:SolarNuAna      1.58083       3343.39       6573.83       4546.49       2802.73        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 13-Jan-2026 09:32:17 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3192.57 MB
  Peak resident set size usage (VmHWM): 2582.61 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 33087.390242 Real = 33495.155608

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3192.57 VmHWM = 2582.61

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-06 09:02:37 UTC       justIN version: 01.06.00