justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 272853.3@dunegpschedd01.fnal.gov

Jobsub ID272853.3@dunegpschedd01.fnal.gov
Workflow ID11625
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-08 19:33:21
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2026-01-08 19:41:43
From worker nodeHostnamedunegli-8121317-0-fnpc23033.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-08 19:34:41
Input filesfardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20241023T202351Z_gen_000967_supernova_g4_detsim_reco_20250724T111154Z_reco2.root
JobscriptExit code0
Real time6m (414s)
CPU time6m (405s = 97%)
Max RSS bytes906731520 (864 MiB)
Outputting started2026-01-08 19:41:35
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dune10kt_1x2x6_centralAPA/fnal/11625/1/001/fdhd_ana_2026-01-08T_193447Z_hist.root
Finished2026-01-08 19:41:43
Saved logsjustin-logs:272853.3-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ubRun: 0 event: 48350

There are a total of 32953 Particles in the event

# of particles 6	from gen 1 marley
# of particles 11008	from gen 2 Ar39GenInLAr
# of particles 1216	from gen 3 Kr85GenInLAr
# of particles 1	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 18	from gen 6 Rn222ChainRn222GenInLAr
# of particles 12	from gen 7 Rn222ChainPo218GenInLAr
# of particles 28	from gen 8 Rn222ChainPb214GenInLAr
# of particles 22	from gen 9 Rn222ChainBi214GenInLAr
# of particles 9	from gen 10 Rn222ChainPb210GenInLAr
# of particles 5	from gen 11 Rn220ChainPb212GenInLAr
# of particles 21	from gen 12 K40GenInCPA
# of particles 236	from gen 13 U238ChainGenInCPA
# of particles 212	from gen 14 Th232ChainGenInCPA
# of particles 2	from gen 15 K42From42ArGenInCPA
# of particles 1	from gen 16 Rn222ChainPo218GenInCPA
# of particles 34	from gen 17 Rn222ChainPb214GenInCPA
# of particles 44	from gen 18 Rn222ChainBi214GenInCPA
# of particles 38	from gen 19 Rn222ChainPb210GenInCPA
# of particles 23	from gen 20 Rn222ChainFromBi210GenInCPA
# of particles 51	from gen 21 Rn220ChainFromPb212GenInCPA
# of particles 0	from gen 22 Co60GenInAPA
# of particles 1	from gen 23 U238ChainGenInAPA
# of particles 0	from gen 24 Th232ChainGenInAPA
# of particles 42	from gen 25 U238Th232K40GenInLArAPAboards1x2x6
# of particles 0	from gen 26 Rn222ChainGenInPDS
# of particles 19159	from gen 27 CavernwallGammasAtLAr1x2x6lowBgAPA
# of particles 764	from gen 28 foamGammasAtLAr1x2x6lowBgAPA
# of particles 0	from gen 29 CavernwallNeutronsAtLAr1x2x6lowBgAPA
# of particles 0	from gen 30 CryostatNGammasAtLAr1x2x6lowBgAPA
# of particles 0	from gen 31 CavernNGammasAtLAr1x2x6lowBgAPA
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  08-Jan-2026 19:41:21 UTC run: 3800 subRun: 0 event: 48350

Number of Signal Particles: 6
Neutrino Interaction: -1
Neutrino Energy: 11.61 MeV
Position (119.80, 25.31, 108.01) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.52	(119.80, 25.31, 108.01)	32993	32949
marley	-12		0.80	(119.80, 25.31, 108.01)	32992	32949
marley	22		2.42	(119.80, 25.31, 108.01)	32951	0
marley	22		0.31	(119.80, 25.31, 108.01)	32950	0
marley	1000190400	0.00	(119.80, 25.31, 108.01)	32949	0
marley	11		7.37	(119.80, 25.31, 108.01)	32948	0
Signal Track IDs: 32948; 32949; 32950; 32951; 32992; 32993; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  08-Jan-2026 19:41:21 UTC run: 3800 subRun: 0 event: 48350

Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  08-Jan-2026 19:41:23 UTC run: 3800 subRun: 0 event: 48350
OpFlash PE 110.55 with purity 0.25 time -29.31 plane 0
 - Vertex (-0.05, -529.30, 35.12)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 136.68 with purity 0.90 time -18.04 plane 0
 - Vertex (0.00, 8.33, 128.02)
	*** 1st Sanity check: Ratio 0.16 <= 1.00
	*** 2nd Sanity check: #OpHits 28 >= 28
OpFlash PE 17.25 with purity 0.31 time -17.67 plane 0
 - Vertex (-0.05, -402.56, 433.34)
	*** 1st Sanity check: Ratio 0.19 <= 1.00
	*** 2nd Sanity check: #OpHits 8 >= 8
OpFlash PE 29.83 with purity 0.92 time -17.62 plane 0
 - Vertex (-0.00, 35.89, 200.17)
	*** 1st Sanity check: Ratio 0.26 <= 1.00
	*** 2nd Sanity check: #OpHits 9 >= 9
OpFlash PE 76.21 with purity 0.57 time -17.27 plane 0
 - Vertex (-0.05, -217.95, 499.90)
	*** 1st Sanity check: Ratio 0.45 <= 1.00
	*** 2nd Sanity check: #OpHits 12 >= 12
OpFlash PE 44.33 with purity 1.00 time -16.54 plane 0
 - Vertex (0.02, 90.00, 103.21)
	*** 1st Sanity check: Ratio 0.21 <= 1.00
	*** 2nd Sanity check: #OpHits 12 >= 12
OpFlash PE 5.73 with purity 0.64 time -16.43 plane 0
 - Vertex (-0.05, -349.77, 240.19)
	*** 1st Sanity check: Ratio 0.36 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 5.33 with purity 0.68 time -16.08 plane 0
 - Vertex (0.02, 11.17, 275.60)
	*** 1st Sanity check: Ratio 0.68 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 8.22 with purity 0.61 time -15.61 plane 0
 - Vertex (-0.00, -90.98, 245.34)
	*** 1st Sanity check: Ratio 0.32 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 7.08 with purity 0.24 time -15.21 plane 0
 - Vertex (-0.00, -129.99, 551.48)
	*** 1st Sanity check: Ratio 0.29 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 22.97 with purity 0.77 time -15.12 plane 0
 - Vertex (0.02, 58.33, 215.52)
	*** 1st Sanity check: Ratio 0.19 <= 1.00
	*** 2nd Sanity check: #OpHits 10 >= 10
OpFlash PE 34.33 with purity 0.75 time -13.92 plane 0
 - Vertex (-0.05, -93.41, 35.12)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 20.05 with purity 0.09 time -13.51 plane 0
 - Vertex (-0.05, -31.14, 1357.47)
	*** 1st Sanity check: Ratio 0.91 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 8.53 with purity 0.22 time -12.80 plane 0
 - Vertex (0.05, 515.87, 639.20)
	*** 1st Sanity check: Ratio 0.60 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 28.05 with purity 0.57 time -7.78 plane 0
 - Vertex (0.05, 155.68, 146.72)
	*** 1st Sanity check: Ratio 0.86 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3

# of OpHits (ophitspe): 72166 for times between -2261.70 us and 2228.06 us.
# of OpFlashes (solarflash): 9728 for times between -2261.60 us and 2228.06 us.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  08-Jan-2026 19:41:23 UTC run: 3800 subRun: 0 event: 48350

# OpHits (ophitspe) in full geometry: 72166
# OpFlashes (solarflash) in full geometry: 9728
# Hits (hitfd) in each view: 206, 221, 469, 0
# Cluster from the hits: 133, 135, 427, 0
# Tracks (pmtracktc) in full geometry: 1
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  08-Jan-2026 19:41:35 UTC run: 3800 subRun: 0 event: 48350

# ClusterReco: Looping over 269 matched clusters
%MSG
Selecting flash with PE 28.79 closer to predicted PE 61.4992 than reference flash PE 17.58 predicted PE 61.3954
The differences are 1.13613 and 2.49235
Selecting flash with PE 136.68 closer to predicted PE 278.181 than reference flash PE 28.79 predicted PE 61.4992
The differences are 1.03527 and 1.13613
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  08-Jan-2026 19:41:35 UTC run: 3800 subRun: 0 event: 48350
*** Matched preselection cluster: 80 from 269
 - MainTrackID 32948
 - Gen 1 -> marley TPC 3
 - Purity 1.00 Hits 5
 - Charge 996.11 ( MaxHit 364.61 )
 - #AdjCl 1 ( 1 signal ):
    - Cluster 111 at distance 52.21 with time 1029.28 and charge 220.75 in TPC 3 and hits 2
 - RecoCol  Time,Y,Z ( 730.00, 24.46, 106.67 )
 - RecoInd0 Time,Y,Z ( 729.73, 24.50, 160.21 )
 - RecoInd1 Time,Y,Z ( 730.10, 24.42, 61.80 )
*** Matched flash: 4799 from 9728
 - Purity 89.94 % Plane 0 #Hits 28
 - MainOpHitPE 21.47 (PE);  TotalPE 136.68 vs expected 278.18 (PE)
 - Time -18.04 (us) Fast 50.73 % Residual 75.87
 - Reco Time,Y,Z ( -18.04, 8.33, 128.02 )
 - Found valid waveform: false
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 119.80, 25.31, 108.01 )
 - Main X,Y,Z ( 120.80, 24.05, 106.19 )
 - EDep X,Y,Z ( 120.13, 24.39, 106.51 )
 - Reco X,Y,Z ( 120.11, 24.46, 106.67 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  08-Jan-2026 19:41:35 UTC run: 3800 subRun: 0 event: 48350
-----------------------------------------------------------------------------------------

%MSG
08-Jan-2026 19:41:35 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/fb/c3/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20241023T202351Z_gen_000967_supernova_g4_detsim_reco_20250724T111154Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 08-Jan-2026 19:41:35 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.138887       7.50401       17.1642       6.7199        7.31129        50     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000863993   0.00398897     0.0551617     0.0015888     0.0086691       50     
end_path:solarnuana:SolarNuAna     0.137001       7.49989       17.1626       6.71823       7.30976        50     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 08-Jan-2026 19:41:35 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1553.31 MB
  Peak resident set size usage (VmHWM): 907.641 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 50 passed = 50 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         50         50          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 389.990877 Real = 397.544852

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1553.31 VmHWM = 907.641

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-06 14:27:28 UTC       justIN version: 01.06.00