justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 273012.1@dunegpschedd02.fnal.gov

Jobsub ID273012.1@dunegpschedd02.fnal.gov
Workflow ID11915
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-15 05:35:28
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2026-01-15 17:44:13
From worker nodeHostnamedunegli-8323758-0-fnpc18010.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-15 05:36:24
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T164836Z_gen_001608_supernova_g4stage1_g4stage2_detsim_reco_20250729T135948Z_reco2.root
JobscriptExit code0
Real time12h (43649s)
CPU time11h (43103s = 98%)
Max RSS bytes2589302784 (2469 MiB)
Outputting started2026-01-15 17:43:53
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/11915/1/001/fdhd_ana_2026-01-15T_053642Z_hist.root
Finished2026-01-15 17:44:13
Saved logsjustin-logs:273012.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

of particles 74	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 21	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 16:35:54 UTC run: 4899 subRun: 0 event: 16080

Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 29.65 MeV
Position (197.45, -632.11, 1346.43) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.48	(197.45, -632.11, 1346.43)	133237	133201
marley	-12		0.83	(197.45, -632.11, 1346.43)	133236	133201
marley	1000200400	0.00	(197.45, -632.11, 1346.43)	133235	133201
marley	22		0.03	(197.45, -632.11, 1346.43)	133204	0
marley	22		1.61	(197.45, -632.11, 1346.43)	133203	0
marley	22		0.65	(197.45, -632.11, 1346.43)	133202	0
marley	1000190400	0.01	(197.45, -632.11, 1346.43)	133201	0
marley	11		25.85	(197.45, -632.11, 1346.43)	133200	0
Signal Track IDs: 133200; 133201; 133202; 133203; 133204; 133235; 133236; 133237; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 16:35:54 UTC run: 4899 subRun: 0 event: 16080

Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 16:37:42 UTC run: 4899 subRun: 0 event: 16080
OpFlash PE 26.61 with purity 0.15 time -0.17 plane 1
 - Vertex (160.81, 743.30, 370.00)
	*** 1st Sanity check: Ratio 0.46 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 2045.79 with purity 0.49 time -0.15 plane 2
 - Vertex (203.04, -743.30, 1343.78)
	*** 1st Sanity check: Ratio 0.17 <= 1.00
	*** 2nd Sanity check: #OpHits 24 >= 24
OpFlash PE 11.45 with purity 0.21 time 0.27 plane 0
 - Vertex (-327.50, -471.64, 198.21)
	*** 1st Sanity check: Ratio 0.57 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 54.82 with purity 0.16 time 0.59 plane 2
 - Vertex (69.14, -743.30, 229.98)
	*** 1st Sanity check: Ratio 0.34 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 149.08 with purity 0.43 time 1.05 plane 0
 - Vertex (-327.50, -519.65, 1264.70)
	*** 1st Sanity check: Ratio 0.15 <= 1.00
	*** 2nd Sanity check: #OpHits 13 >= 13
OpFlash PE 5.94 with purity 1.00 time 2.04 plane 2
 - Vertex (135.07, -743.30, 1641.62)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 12.29 with purity 0.26 time 3.77 plane 1
 - Vertex (207.05, 743.30, 1641.62)
	*** 1st Sanity check: Ratio 0.52 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 36.57 with purity 0.13 time 3.03 plane 0
 - Vertex (-327.50, -70.11, 1154.41)
	*** 1st Sanity check: Ratio 0.19 <= 1.00
	*** 2nd Sanity check: #OpHits 6 >= 6
OpFlash PE 19.51 with purity 0.24 time 3.63 plane 0
 - Vertex (-327.50, -347.78, 1705.39)
	*** 1st Sanity check: Ratio 0.40 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 3.29 with purity 1.00 time 4.36 plane 2
 - Vertex (135.07, -743.30, 1641.62)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 3.62 with purity 0.50 time 5.29 plane 0
 - Vertex (-327.50, -377.40, 707.10)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 12.90 with purity 1.00 time 6.59 plane 2
 - Vertex (226.96, -743.30, 1161.33)
	*** 1st Sanity check: Ratio 0.61 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2

# of OpHits (ophit10ppm): 53076 for times between -4253.88 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 18455 for times between -4253.88 us and 295147919198126080.00 us.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 16:37:45 UTC run: 4899 subRun: 0 event: 16080

# OpHits (ophit10ppm) in full geometry: 53076
# OpFlashes (solarflash) in full geometry: 18455
# Hits (gaushit) in each view: 6668, 6610, 6656, 0
# Cluster from the hits: 2808, 2854, 5684, 0
# Tracks (pmtracktc) in full geometry: 454
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 17:43:52 UTC run: 4899 subRun: 0 event: 16080

# ClusterReco: Looping over 5675 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 17:43:52 UTC run: 4899 subRun: 0 event: 16080
*** Matched preselection cluster: 928 from 5675
 - MainTrackID 133200
 - Gen 1 -> marley TPC 72
 - Purity 1.00 Hits 3
 - Charge 356.62 ( MaxHit 228.34 )
 - #AdjCl 5 ( 1 signal ):
    - Cluster 455 at distance 98.82 with time 387.35 and charge 74.10 in TPC 78 and hits 1
    - Cluster 817 at distance 80.93 with time 675.59 and charge 28.30 in TPC 70 and hits 1
    - Cluster 871 at distance 83.22 with time 714.70 and charge 129.99 in TPC 72 and hits 1
    - Cluster 1311 at distance 81.34 with time 1037.73 and charge 43.01 in TPC 64 and hits 1
    - Cluster 1329 at distance 66.73 with time 1056.40 and charge 20.88 in TPC 74 and hits 1
 - RecoCol  Time,Y,Z ( 755.53, 259.59, 1375.04 )
 - RecoInd0 Time,Y,Z ( 755.70, 433.20, 1718.08 )
 - RecoInd1 Time,Y,Z ( 755.65, 85.97, 1718.08 )
*** Matched flash: 6856 from 18455
 - Purity 0.00 % Plane 0 #Hits 5
 - MainOpHitPE 7.92 (PE);  TotalPE 36.22 vs expected 39.93 (PE)
 - Time -1050.50 (us) Fast 24.63 % Residual 35.51
 - Reco Time,Y,Z ( -1050.50, 301.88, 1288.02 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 197.45, -632.11, 1346.43 )
 - Main X,Y,Z ( 197.80, -635.26, 1350.29 )
 - EDep X,Y,Z ( 197.86, -634.65, 1349.02 )
 - Reco X,Y,Z ( 35.05, 259.59, 1375.04 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 17:43:52 UTC run: 4899 subRun: 0 event: 16080
*** Matched preselection cluster: 991 from 5675
 - MainTrackID 133200
 - Gen 1 -> marley TPC 72
 - Purity 1.00 Hits 10
 - Charge 1911.37 ( MaxHit 289.91 )
 - #AdjCl 9 ( 2 signal ):
    - Cluster 576 at distance 85.96 with time 470.50 and charge 108.14 in TPC 64 and hits 1
    - Cluster 590 at distance 88.53 with time 484.64 and charge 117.74 in TPC 64 and hits 2
    - Cluster 819 at distance 64.51 with time 678.83 and charge 118.16 in TPC 64 and hits 2
    - Cluster 931 at distance 29.90 with time 756.60 and charge 905.52 in TPC 72 and hits 5
    - Cluster 1031 at distance 12.92 with time 813.27 and charge 166.45 in TPC 64 and hits 2
    - Cluster 1136 at distance 71.23 with time 901.05 and charge 184.29 in TPC 72 and hits 2
    - Cluster 1196 at distance 38.22 with time 947.20 and charge 137.69 in TPC 74 and hits 2
    - Cluster 1500 at distance 98.53 with time 1190.26 and charge 33.83 in TPC 76 and hits 1
    - Cluster 1578 at distance 93.79 with time 1250.82 and charge 134.64 in TPC 64 and hits 1
 - RecoCol  Time,Y,Z ( 792.39, -634.42, 1348.76 )
 - RecoInd0 Time,Y,Z ( 792.48, -634.42, 1379.63 )
 - RecoInd1 Time,Y,Z ( 792.43, -634.42, 1419.24 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 197.45, -632.11, 1346.43 )
 - Main X,Y,Z ( 197.80, -635.26, 1350.29 )
 - EDep X,Y,Z ( 197.86, -634.65, 1349.02 )
 - Reco X,Y,Z ( -1000000.00, -634.42, 1348.76 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 17:43:52 UTC run: 4899 subRun: 0 event: 16080
-----------------------------------------------------------------------------------------

%MSG
15-Jan-2026 17:43:52 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/05/9a/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T164836Z_gen_001608_supernova_g4stage1_g4stage2_detsim_reco_20250729T135948Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 15-Jan-2026 17:43:52 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          2693.63       4355.08       5310.1        4330.31       756.696        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00294003     0.0122622     0.0258428    0.00947034     0.0078246       10     
end_path:solarnuana:SolarNuAna      2693.62       4355.07       5310.08       4330.29       756.694        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 15-Jan-2026 17:43:52 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3196.93 MB
  Peak resident set size usage (VmHWM): 2589.3 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 43072.918007 Real = 43610.926638

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3196.93 VmHWM = 2589.3

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-06 02:42:47 UTC       justIN version: 01.06.00