justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 273111.3@dunegpschedd01.fnal.gov

Jobsub ID273111.3@dunegpschedd01.fnal.gov
Workflow ID11648
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-09 21:56:51
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2026-01-09 23:30:37
From worker nodeHostnamedunegli-8133324-0-fnpc23021.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-09 23:22:49
Input filesfardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250206T140653Z_gen_003836_supernova_g4_detsim_reco_20250724T104013Z_reco2.root
JobscriptExit code0
Real time7m (458s)
CPU time7m (423s = 92%)
Max RSS bytes899158016 (857 MiB)
Outputting started2026-01-09 23:30:28
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dune10kt_1x2x6_centralAPA/fnal/11648/1/001/fdhd_ana_2026-01-09T_232255Z_hist.root
Finished2026-01-09 23:30:37
Saved logsjustin-logs:273111.3-dunegpschedd01.fnal.gov.logs.tgz
List job events     (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

e are a total of 32774 Particles in the event

# of particles 12	from gen 1 marley
# of particles 10883	from gen 2 Ar39GenInLAr
# of particles 1199	from gen 3 Kr85GenInLAr
# of particles 0	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 12	from gen 6 Rn222ChainRn222GenInLAr
# of particles 11	from gen 7 Rn222ChainPo218GenInLAr
# of particles 22	from gen 8 Rn222ChainPb214GenInLAr
# of particles 18	from gen 9 Rn222ChainBi214GenInLAr
# of particles 6	from gen 10 Rn222ChainPb210GenInLAr
# of particles 15	from gen 11 Rn220ChainPb212GenInLAr
# of particles 14	from gen 12 K40GenInCPA
# of particles 215	from gen 13 U238ChainGenInCPA
# of particles 282	from gen 14 Th232ChainGenInCPA
# of particles 1	from gen 15 K42From42ArGenInCPA
# of particles 6	from gen 16 Rn222ChainPo218GenInCPA
# of particles 18	from gen 17 Rn222ChainPb214GenInCPA
# of particles 23	from gen 18 Rn222ChainBi214GenInCPA
# of particles 26	from gen 19 Rn222ChainPb210GenInCPA
# of particles 20	from gen 20 Rn222ChainFromBi210GenInCPA
# of particles 18	from gen 21 Rn220ChainFromPb212GenInCPA
# of particles 0	from gen 22 Co60GenInAPA
# of particles 4	from gen 23 U238ChainGenInAPA
# of particles 4	from gen 24 Th232ChainGenInAPA
# of particles 42	from gen 25 U238Th232K40GenInLArAPAboards1x2x6
# of particles 0	from gen 26 Rn222ChainGenInPDS
# of particles 19159	from gen 27 CavernwallGammasAtLAr1x2x6lowBgAPA
# of particles 764	from gen 28 foamGammasAtLAr1x2x6lowBgAPA
# of particles 0	from gen 29 CavernwallNeutronsAtLAr1x2x6lowBgAPA
# of particles 0	from gen 30 CryostatNGammasAtLAr1x2x6lowBgAPA
# of particles 0	from gen 31 CavernNGammasAtLAr1x2x6lowBgAPA
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  09-Jan-2026 23:30:05 UTC run: 5082 subRun: 0 event: 191800

Number of Signal Particles: 8
Neutrino Interaction: -1
Neutrino Energy: 10.58 MeV
Position (135.19, 575.58, 1198.31) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	22		1.46	(135.19, 575.58, 1198.31)	32830	32764
marley	1000180400	0.00	(135.19, 575.58, 1198.31)	32829	32764
marley	12		0.04	(135.19, 575.58, 1198.31)	32828	32764
marley	22		0.00	(135.19, 575.58, 1198.31)	32826	32764
marley	11		0.00	(135.19, 575.58, 1198.31)	32825	32764
marley	11		0.00	(135.19, 575.58, 1198.31)	32824	32764
marley	22		0.03	(135.19, 575.58, 1198.31)	32768	0
marley	22		1.61	(135.19, 575.58, 1198.31)	32767	0
marley	22		0.65	(135.19, 575.58, 1198.31)	32766	0
marley	22		2.09	(135.19, 575.58, 1198.31)	32765	0
marley	1000190400	0.00	(135.19, 575.58, 1198.31)	32764	0
marley	11		4.69	(135.19, 575.58, 1198.31)	32763	0
Signal Track IDs: 32763; 32764; 32765; 32766; 32767; 32768; 32824; 32825; 32826; 32828; 32829; 32830; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  09-Jan-2026 23:30:05 UTC run: 5082 subRun: 0 event: 191800

Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  09-Jan-2026 23:30:09 UTC run: 5082 subRun: 0 event: 191800
OpFlash PE 2.82 with purity 0.50 time -18.53 plane 0
 - Vertex (0.05, 280.22, 1308.67)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 6.36 with purity 0.28 time -18.09 plane 0
 - Vertex (-0.02, -113.67, 876.60)
	*** 1st Sanity check: Ratio 0.44 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 76.09 with purity 1.00 time -18.04 plane 0
 - Vertex (0.05, 552.78, 1233.11)
	*** 1st Sanity check: Ratio 0.21 <= 1.00
	*** 2nd Sanity check: #OpHits 17 >= 17
OpFlash PE 34.99 with purity 1.00 time -17.42 plane 0
 - Vertex (0.05, 500.60, 1122.63)
	*** 1st Sanity check: Ratio 0.20 <= 1.00
	*** 2nd Sanity check: #OpHits 12 >= 12
OpFlash PE 23.32 with purity 1.00 time -17.20 plane 0
 - Vertex (0.05, 499.11, 1124.82)
	*** 1st Sanity check: Ratio 0.28 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 25.70 with purity 0.86 time -16.52 plane 0
 - Vertex (0.05, 441.69, 932.10)
	*** 1st Sanity check: Ratio 0.28 <= 1.00
	*** 2nd Sanity check: #OpHits 9 >= 9
OpFlash PE 4.60 with purity 1.00 time -15.94 plane 0
 - Vertex (0.05, 488.55, 1204.12)
	*** 1st Sanity check: Ratio 0.65 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 3.81 with purity 0.75 time -15.27 plane 0
 - Vertex (0.05, 561.03, 1017.08)
	*** 1st Sanity check: Ratio 0.51 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 4.16 with purity 0.50 time -14.89 plane 0
 - Vertex (0.05, 498.46, 991.55)
	*** 1st Sanity check: Ratio 0.50 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 3.16 with purity 1.00 time -13.52 plane 0
 - Vertex (0.05, 529.30, 1245.87)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 3.10 with purity 0.67 time -12.99 plane 0
 - Vertex (0.05, 467.03, 1308.67)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 3.87 with purity 0.50 time -11.94 plane 0
 - Vertex (0.05, 435.49, 1076.28)
	*** 1st Sanity check: Ratio 0.50 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 5.73 with purity 0.31 time -11.52 plane 0
 - Vertex (0.05, 269.13, 719.40)
	*** 1st Sanity check: Ratio 0.35 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3

# of OpHits (ophitspe): 71583 for times between -2260.26 us and 2227.65 us.
# of OpFlashes (solarflash): 9719 for times between -2260.24 us and 2227.59 us.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  09-Jan-2026 23:30:09 UTC run: 5082 subRun: 0 event: 191800

# OpHits (ophitspe) in full geometry: 71583
# OpFlashes (solarflash) in full geometry: 9719
# Hits (hitfd) in each view: 210, 220, 483, 0
# Cluster from the hits: 140, 140, 449, 0
# Tracks (pmtracktc) in full geometry: 1
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  09-Jan-2026 23:30:27 UTC run: 5082 subRun: 0 event: 191800

# ClusterReco: Looping over 295 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  09-Jan-2026 23:30:27 UTC run: 5082 subRun: 0 event: 191800
*** Matched preselection cluster: 88 from 295
 - MainTrackID 32763
 - Gen 1 -> marley TPC 23
 - Purity 1.00 Hits 3
 - Charge 617.96 ( MaxHit 239.86 )
 - #AdjCl 4 ( 2 signal ):
    - Cluster 47 at distance 63.71 with time 550.05 and charge 176.90 in TPC 19 and hits 2
    - Cluster 49 at distance 44.94 with time 570.93 and charge 88.19 in TPC 23 and hits 1
    - Cluster 80 at distance 8.10 with time 778.48 and charge 109.34 in TPC 23 and hits 1
    - Cluster 81 at distance 15.04 with time 783.71 and charge 210.23 in TPC 23 and hits 2
 - RecoCol  Time,Y,Z ( 823.34, 574.63, 1197.94 )
 - RecoInd0 Time,Y,Z ( 823.38, 574.69, 1189.05 )
 - RecoInd1 Time,Y,Z ( 823.41, 574.57, 1285.95 )
*** Matched flash: 4818 from 9719
 - Purity 100.00 % Plane 0 #Hits 17
 - MainOpHitPE 15.89 (PE);  TotalPE 76.09 vs expected 167.46 (PE)
 - Time -18.04 (us) Fast 41.37 % Residual 11.16
 - Reco Time,Y,Z ( -18.04, 552.78, 1233.11 )
 - Found valid waveform: false
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 135.19, 575.58, 1198.31 )
 - Main X,Y,Z ( 135.11, 574.15, 1197.49 )
 - EDep X,Y,Z ( 135.20, 574.70, 1197.93 )
 - Reco X,Y,Z ( 135.09, 574.63, 1197.94 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  09-Jan-2026 23:30:27 UTC run: 5082 subRun: 0 event: 191800
-----------------------------------------------------------------------------------------

%MSG
09-Jan-2026 23:30:27 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/50/86/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250206T140653Z_gen_003836_supernova_g4_detsim_reco_20250724T104013Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 09-Jan-2026 23:30:27 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.163193       7.82701       22.2909      0.618784       8.77425        50     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00108723     0.0203806     0.353508     0.00467286     0.0513741       50     
end_path:solarnuana:SolarNuAna     0.151127       7.80649       22.277       0.607507       8.76671        50     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 09-Jan-2026 23:30:27 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1550.13 MB
  Peak resident set size usage (VmHWM): 904.172 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 50 passed = 50 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         50         50          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 407.231098 Real = 440.616868

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1550.13 VmHWM = 904.172

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-06 14:26:15 UTC       justIN version: 01.06.00