justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 270733.18@dunegpschedd02.fnal.gov

Jobsub ID270733.18@dunegpschedd02.fnal.gov
Workflow ID11752
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-12 17:54:24
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2026-01-12 22:54:05
From worker nodeHostnamedunegli-8304436-0-fnpc19118.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-12 22:31:58
Input filesfardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250207T160627Z_gen_000643_supernova_g4_detsim_reco_20250723T184538Z_reco2.root
JobscriptExit code0
Real time21m (1314s)
CPU time21m (1289s = 98%)
Max RSS bytes906592256 (864 MiB)
Outputting started2026-01-12 22:53:52
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dune10kt_1x2x6_centralAPA/fnal/11752/1/001/fdhd_ana_2026-01-12T_223210Z_hist.root
Finished2026-01-12 22:54:05
Saved logsjustin-logs:270733.18-dunegpschedd02.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

tils:  SolarNuAna:solarnuana@BeginModule  12-Jan-2026 22:52:49 UTC run: 5092 subRun: 0 event: 32150

There are a total of 33014 Particles in the event

# of particles 11	from gen 1 marley
# of particles 11039	from gen 2 Ar39GenInLAr
# of particles 1259	from gen 3 Kr85GenInLAr
# of particles 2	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 9	from gen 6 Rn222ChainRn222GenInLAr
# of particles 8	from gen 7 Rn222ChainPo218GenInLAr
# of particles 18	from gen 8 Rn222ChainPb214GenInLAr
# of particles 8	from gen 9 Rn222ChainBi214GenInLAr
# of particles 9	from gen 10 Rn222ChainPb210GenInLAr
# of particles 6	from gen 11 Rn220ChainPb212GenInLAr
# of particles 13	from gen 12 K40GenInCPA
# of particles 233	from gen 13 U238ChainGenInCPA
# of particles 263	from gen 14 Th232ChainGenInCPA
# of particles 1	from gen 15 K42From42ArGenInCPA
# of particles 5	from gen 16 Rn222ChainPo218GenInCPA
# of particles 21	from gen 17 Rn222ChainPb214GenInCPA
# of particles 52	from gen 18 Rn222ChainBi214GenInCPA
# of particles 18	from gen 19 Rn222ChainPb210GenInCPA
# of particles 27	from gen 20 Rn222ChainFromBi210GenInCPA
# of particles 40	from gen 21 Rn220ChainFromPb212GenInCPA
# of particles 3	from gen 22 Co60GenInAPA
# of particles 2	from gen 23 U238ChainGenInAPA
# of particles 2	from gen 24 Th232ChainGenInAPA
# of particles 42	from gen 25 U238Th232K40GenInLArAPAboards1x2x6
# of particles 0	from gen 26 Rn222ChainGenInPDS
# of particles 19159	from gen 27 CavernwallGammasAtLAr1x2x6lowBgAPA
# of particles 764	from gen 28 foamGammasAtLAr1x2x6lowBgAPA
# of particles 0	from gen 29 CavernwallNeutronsAtLAr1x2x6lowBgAPA
# of particles 0	from gen 30 CryostatNGammasAtLAr1x2x6lowBgAPA
# of particles 0	from gen 31 CavernNGammasAtLAr1x2x6lowBgAPA
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  12-Jan-2026 22:52:49 UTC run: 5092 subRun: 0 event: 32150

Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 5.72 MeV
Position (145.69, 336.90, 844.99) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	22		1.46	(145.69, 336.90, 844.99)	33039	33005
marley	1000180400	0.00	(145.69, 336.90, 844.99)	33038	33005
marley	12		0.04	(145.69, 336.90, 844.99)	33037	33005
marley	11		0.00	(145.69, 336.90, 844.99)	33035	33005
marley	11		0.00	(145.69, 336.90, 844.99)	33034	33005
marley	11		0.00	(145.69, 336.90, 844.99)	33033	33005
marley	22		0.03	(145.69, 336.90, 844.99)	33008	0
marley	22		1.61	(145.69, 336.90, 844.99)	33007	0
marley	22		1.09	(145.69, 336.90, 844.99)	33006	0
marley	1000190400	0.00	(145.69, 336.90, 844.99)	33005	0
marley	11		1.49	(145.69, 336.90, 844.99)	33004	0
Signal Track IDs: 33004; 33005; 33006; 33007; 33008; 33033; 33034; 33035; 33037; 33038; 33039; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  12-Jan-2026 22:52:49 UTC run: 5092 subRun: 0 event: 32150

Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  12-Jan-2026 22:53:04 UTC run: 5092 subRun: 0 event: 32150
OpFlash PE 18.31 with purity 0.33 time -32.21 plane 0
 - Vertex (0.05, 467.03, 1013.48)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 12.45 with purity 0.43 time -18.30 plane 0
 - Vertex (0.05, 381.80, 833.04)
	*** 1st Sanity check: Ratio 0.40 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 59.64 with purity 0.79 time -18.01 plane 0
 - Vertex (0.05, 365.10, 905.11)
	*** 1st Sanity check: Ratio 0.12 <= 1.00
	*** 2nd Sanity check: #OpHits 23 >= 23
OpFlash PE 34.92 with purity 0.74 time -17.32 plane 0
 - Vertex (0.03, 175.97, 758.15)
	*** 1st Sanity check: Ratio 0.27 <= 1.00
	*** 2nd Sanity check: #OpHits 10 >= 10
OpFlash PE 11.62 with purity 0.16 time -17.22 plane 0
 - Vertex (0.05, 591.57, 35.12)
	*** 1st Sanity check: Ratio 0.84 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 6.23 with purity 0.60 time -16.70 plane 0
 - Vertex (0.05, 362.48, 1016.17)
	*** 1st Sanity check: Ratio 0.36 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 3.49 with purity 0.43 time -16.17 plane 0
 - Vertex (-0.01, 103.41, 284.76)
	*** 1st Sanity check: Ratio 0.57 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 11.79 with purity 0.90 time -16.12 plane 0
 - Vertex (0.03, 248.33, 816.08)
	*** 1st Sanity check: Ratio 0.36 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 14.89 with purity 0.91 time -15.68 plane 0
 - Vertex (0.05, 311.62, 824.04)
	*** 1st Sanity check: Ratio 0.26 <= 1.00
	*** 2nd Sanity check: #OpHits 6 >= 6
OpFlash PE 5.62 with purity 0.89 time -15.15 plane 0
 - Vertex (0.05, 382.60, 801.31)
	*** 1st Sanity check: Ratio 0.68 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 11.43 with purity 0.18 time -14.69 plane 0
 - Vertex (-0.03, -387.67, 698.86)
	*** 1st Sanity check: Ratio 0.51 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 5.01 with purity 1.00 time -13.97 plane 0
 - Vertex (0.05, 362.50, 1059.79)
	*** 1st Sanity check: Ratio 0.36 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 3.93 with purity 1.00 time -13.44 plane 0
 - Vertex (0.05, 346.08, 881.00)
	*** 1st Sanity check: Ratio 0.53 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 5.86 with purity 0.36 time -8.72 plane 0
 - Vertex (0.02, -13.81, 946.58)
	*** 1st Sanity check: Ratio 0.36 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3

# of OpHits (ophitspe): 71773 for times between -2261.95 us and 2226.88 us.
# of OpFlashes (solarflash): 9724 for times between -2261.95 us and 2226.88 us.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  12-Jan-2026 22:53:04 UTC run: 5092 subRun: 0 event: 32150

# OpHits (ophitspe) in full geometry: 71773
# OpFlashes (solarflash) in full geometry: 9724
# Hits (hitfd) in each view: 204, 197, 476, 0
# Cluster from the hits: 130, 125, 432, 0
# Tracks (pmtracktc) in full geometry: 1
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  12-Jan-2026 22:53:51 UTC run: 5092 subRun: 0 event: 32150

# ClusterReco: Looping over 270 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  12-Jan-2026 22:53:51 UTC run: 5092 subRun: 0 event: 32150
*** Matched preselection cluster: 86 from 270
 - MainTrackID 33004
 - Gen 1 -> marley TPC 15
 - Purity 1.00 Hits 2
 - Charge 174.09 ( MaxHit 129.35 )
 - #AdjCl 2 ( 2 signal ):
    - Cluster 87 at distance 6.56 with time 893.44 and charge 160.84 in TPC 15 and hits 1
    - Cluster 96 at distance 17.23 with time 937.05 and charge 66.41 in TPC 15 and hits 1
 - RecoCol  Time,Y,Z ( 889.69, 337.48, 844.94 )
 - RecoInd0 Time,Y,Z ( 891.01, 337.94, 812.49 )
 - RecoInd1 Time,Y,Z ( 889.76, 337.01, 812.49 )
*** Matched flash: 4729 from 9724
 - Purity 79.01 % Plane 0 #Hits 23
 - MainOpHitPE 6.94 (PE);  TotalPE 59.64 vs expected 89.62 (PE)
 - Time -18.01 (us) Fast 19.31 % Residual 5.25
 - Reco Time,Y,Z ( -18.01, 365.10, 905.11 )
 - Found valid waveform: false
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 145.69, 336.90, 844.99 )
 - Main X,Y,Z ( 145.93, 336.99, 844.95 )
 - EDep X,Y,Z ( 145.88, 336.98, 844.98 )
 - Reco X,Y,Z ( 145.74, 337.48, 844.94 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  12-Jan-2026 22:53:51 UTC run: 5092 subRun: 0 event: 32150
-----------------------------------------------------------------------------------------

%MSG
12-Jan-2026 22:53:51 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/08/aa/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250207T160627Z_gen_000643_supernova_g4_detsim_reco_20250723T184538Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 12-Jan-2026 22:53:51 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.277088       24.6052       79.805        13.3131       25.3514        50     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00190059    0.00903793     0.0225616    0.00931797    0.00610083       50     
end_path:solarnuana:SolarNuAna     0.262745       24.596        79.7934       13.3041       25.3518        50     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 12-Jan-2026 22:53:51 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1552.67 MB
  Peak resident set size usage (VmHWM): 908.358 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 50 passed = 50 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         50         50          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1256.798006 Real = 1275.226115

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1552.67 VmHWM = 908.358

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-06 09:07:02 UTC       justIN version: 01.06.00