justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 247020.11@dunegpschedd01.fnal.gov

Jobsub ID247020.11@dunegpschedd01.fnal.gov
Workflow ID9926
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-11 07:57:00
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-11-11 08:02:51
From worker nodeHostnamedunegli-7564923-0-fnpc17102.fnal.gov
cpuinfoIntel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-11 07:57:45
Input filesfardet-hd:fardet-hd_mc_le_mc_2024a_list-4403_input.list_out1_reco1_supernova_dune10kt_1x2x6_hit-reconstructed_merged_skip000050_lim000025_mergeLar_20241218T193511_20250723T161137Z_reco2.root
JobscriptExit code0
Real time4m (286s)
CPU time1m (102s = 35%)
Max RSS bytes637894656 (608 MiB)
Outputting started2025-11-11 08:02:32
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_dune10kt_1x2x6/fnal/09926/1/001/fdhd_ana_2025-11-11T_135755Z_hist.root
Finished2025-11-11 08:02:51
Saved logsjustin-logs:247020.11-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ted!
# of particles 0	from gen 18 Rn222ChainBi214GenInCPA *not generated!
# of particles 0	from gen 19 Rn222ChainPb210GenInCPA *not generated!
# of particles 0	from gen 20 Rn222ChainFromBi210GenInCPA *not generated!
# of particles 0	from gen 21 Rn220ChainFromPb212GenInCPA *not generated!
# of particles 0	from gen 22 Co60GenInAPA *not generated!
# of particles 0	from gen 23 U238ChainGenInAPA *not generated!
# of particles 0	from gen 24 Th232ChainGenInAPA *not generated!
# of particles 0	from gen 25 U238Th232K40GenInLArAPAboards1x2x6 *not generated!
# of particles 0	from gen 26 Rn222ChainGenInPDS *not generated!
# of particles 0	from gen 27 CavernwallGammasAtLAr1x2x6lowBgAPA *not generated!
# of particles 0	from gen 28 foamGammasAtLAr1x2x6lowBgAPA *not generated!
# of particles 0	from gen 29 CavernwallNeutronsAtLAr1x2x6lowBgAPA *not generated!
# of particles 0	from gen 30 CryostatNGammasAtLAr1x2x6lowBgAPA *not generated!
# of particles 0	from gen 31 CavernNGammasAtLAr1x2x6lowBgAPA *not generated!
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Nov-2025 14:02:31 UTC run: 4403 subRun: 0 event: 7500

Number of Signal Particles: 5
Neutrino Interaction: -1
Neutrino Energy: 20.79 MeV
Position (236.02, -168.10, 452.37) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	22		7.65	(505.65, -127.86, 688.37)	56	3
marley	1000260570	0.00	(505.65, -127.86, 688.37)	55	3
marley	2212		0.00	(428.83, -147.91, 596.66)	33	3
marley	2212		0.00	(419.39, -151.38, 588.84)	32	3
marley	2212		0.00	(408.39, -149.51, 569.67)	30	3
marley	2212		0.00	(403.90, -144.12, 563.64)	29	3
marley	2212		0.00	(404.30, -127.39, 560.14)	28	3
marley	2212		0.00	(437.76, -97.03, 523.82)	27	3
marley	2212		0.00	(438.31, -97.10, 523.16)	26	3
marley	2212		0.00	(439.75, -109.69, 519.28)	25	3
marley	2212		0.01	(438.76, -111.29, 518.96)	24	3
marley	2212		0.00	(409.88, -119.15, 487.74)	23	3
marley	2212		0.03	(401.58, -129.55, 473.29)	22	3
marley	1000060120	0.00	(400.11, -128.63, 468.78)	21	3
marley	1000180400	0.01	(192.34, -48.54, 391.45)	20	3
marley	1000180400	0.00	(205.62, -86.58, 428.08)	19	3
marley	1000180400	0.00	(213.51, -82.04, 437.35)	18	3
marley	1000180400	0.00	(217.70, -90.10, 442.67)	17	3
marley	1000180400	0.00	(217.72, -90.56, 447.37)	16	3
marley	1000180400	0.00	(205.82, -98.28, 454.12)	15	3
marley	1000180400	0.01	(205.77, -98.39, 453.94)	14	3
marley	1000180400	0.00	(208.26, -96.98, 458.33)	13	3
marley	1000180400	0.01	(211.82, -94.27, 473.43)	12	3
marley	1000180400	0.00	(213.97, -106.27, 466.31)	11	3
marley	1000180400	0.00	(222.10, -105.21, 465.99)	10	3
marley	1000180400	0.00	(235.21, -156.83, 441.71)	9	3
marley	1000180400	0.01	(235.30, -158.68, 441.75)	8	3
marley	1000180400	0.01	(231.49, -153.39, 426.00)	7	3
marley	1000180400	0.00	(235.23, -152.96, 427.87)	6	3
marley	1000180400	0.01	(259.26, -149.31, 426.54)	5	3
marley	1000180400	0.01	(257.53, -124.32, 419.76)	4	3
marley	2112		0.13	(236.02, -168.10, 452.37)	3	0
marley	1000190390	0.03	(236.02, -168.10, 452.37)	2	0
marley	11		11.32	(236.02, -168.10, 452.37)	1	0
Signal Track IDs: 1; 2; 3; 4; 5; 6; 7; 8; 9; 10; 11; 12; 13; 14; 15; 16; 17; 18; 19; 20; 21; 22; 23; 24; 25; 26; 27; 28; 29; 30; 32; 33; 55; 56; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Nov-2025 14:02:31 UTC run: 4403 subRun: 0 event: 7500

Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.

%MSG
%MSG-w PhotonBackTracker:  SolarNuAna:solarnuana@BeginModule  11-Nov-2025 14:02:31 UTC run: 4403 subRun: 0 event: 7500
Exception caught
---- PhotonBackTracker2 BEGIN
  No sim:: OpDetBacktrackerRecord corresponding to opDetNum: 207
---- PhotonBackTracker2 END

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Nov-2025 14:02:31 UTC run: 4403 subRun: 0 event: 7500
OpFlash PE 75.51 with purity 1.00 time 0.00 plane 0
 - Vertex (-0.03, -143.26, 516.58)
	*** 1st Sanity check: Ratio 0.08 <= 1.00
	*** 2nd Sanity check: #OpHits 29 >= 29
OpFlash PE 7.31 with purity 1.00 time 0.02 plane 0
 - Vertex (0.02, 164.02, 809.71)
	*** 1st Sanity check: Ratio 0.27 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 28.80 with purity 1.00 time 0.02 plane 0
 - Vertex (-0.05, -251.55, 340.16)
	*** 1st Sanity check: Ratio 0.14 <= 1.00
	*** 2nd Sanity check: #OpHits 12 >= 12
OpFlash PE 34.49 with purity 1.00 time 0.02 plane 0
 - Vertex (0.00, -21.91, 527.28)
	*** 1st Sanity check: Ratio 0.11 <= 1.00
	*** 2nd Sanity check: #OpHits 15 >= 15
OpFlash PE 5.28 with purity 1.00 time 0.03 plane 0
 - Vertex (0.05, 284.11, 451.73)
	*** 1st Sanity check: Ratio 0.69 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 5.63 with purity 1.00 time 0.03 plane 0
 - Vertex (-0.05, -508.28, 246.10)
	*** 1st Sanity check: Ratio 0.34 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 13.45 with purity 1.00 time 0.04 plane 0
 - Vertex (-0.00, 14.19, 659.88)
	*** 1st Sanity check: Ratio 0.22 <= 1.00
	*** 2nd Sanity check: #OpHits 6 >= 6
OpFlash PE 10.05 with purity 1.00 time 0.04 plane 0
 - Vertex (-0.05, -226.93, 569.10)
	*** 1st Sanity check: Ratio 0.27 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 2.04 with purity 1.00 time 0.06 plane 0
 - Vertex (0.05, 217.95, 892.69)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 1.56 with purity 1.00 time 0.09 plane 0
 - Vertex (-0.05, -404.76, 316.31)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 2.19 with purity 1.00 time 0.09 plane 0
 - Vertex (0.05, 93.41, 316.31)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 3.90 with purity 1.00 time 0.11 plane 0
 - Vertex (-0.00, -98.51, 606.79)
	*** 1st Sanity check: Ratio 0.52 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2

# of OpFlashes (solarflash) in full geometry: 13

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Nov-2025 14:02:31 UTC run: 4403 subRun: 0 event: 7500

# OpHits (ophitspe) in full geometry: 245
# OpFlashes (solarflash) in full geometry: 13
# Hits (hitfd) in each view: 9, 6, 8, 0
# Cluster from the hits: 1, 1, 1, 0
# Tracks (pmtracktc) in full geometry: 1
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Nov-2025 14:02:31 UTC run: 4403 subRun: 0 event: 7500

# ClusterReco: Looping over 1 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Nov-2025 14:02:31 UTC run: 4403 subRun: 0 event: 7500
*** Matched preselection cluster: 0
 - MainTrackID 1
 - Gen 1 -> marley TPC 5
 - Purity 1.00 Hits 8
 - Charge 1367.16 ( MaxHit 344.53 )
 - #AdjCl 0 ( 0 signal ):
 - RecoCol  Time,Y,Z ( 1450.15, -166.96, 450.29 )
 - RecoInd0 Time,Y,Z ( 1450.09, -166.94, 347.71 )
 - RecoInd1 Time,Y,Z ( 1450.25, -166.97, 396.96 )
*** Matched flash: 
 - Purity 1.00 Plane 0 #Hits 29 PE 75.51 MaxPE 5.98
 - Time -18.10 Fast 0.83 Residual 5.30
 - Reco Time,Y,Z ( -18.10, -143.26, 516.58 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 236.02, -168.10, 452.37 )
 - Main X,Y,Z ( 235.35, -166.87, 449.25 )
 - EDep X,Y,Z ( 236.11, -167.59, 451.72 )
 - Reco X,Y,Z ( 235.75, -166.96, 450.29 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  11-Nov-2025 14:02:31 UTC run: 4403 subRun: 0 event: 7500
-----------------------------------------------------------------------------------------

%MSG
11-Nov-2025 14:02:31 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/e4/5b/fardet-hd_mc_le_mc_2024a_list-4403_input.list_out1_reco1_supernova_dune10kt_1x2x6_hit-reconstructed_merged_skip000050_lim000025_mergeLar_20241218T193511_20250723T161137Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 11-Nov-2025 14:02:31 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                        0.00291355     0.0298164      1.55755      0.0149342     0.0770425      2500    
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000547208   0.00475339      1.53675     0.00121113     0.0394299      2500    
end_path:solarnuana:SolarNuAna    0.00220258     0.0249325      1.15249      0.011733      0.0611215      2500    
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 11-Nov-2025 14:02:31 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1328.64 MB
  Peak resident set size usage (VmHWM): 635.625 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 2500 passed = 2500 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport       2500       2500          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 69.609959 Real = 247.088832

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1328.64 VmHWM = 635.625

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-10 07:57:38 UTC       justIN version: 01.06.00