justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 272871.2@dunegpschedd01.fnal.gov

Jobsub ID272871.2@dunegpschedd01.fnal.gov
Workflow ID11629
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-08 19:51:21
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2026-01-08 19:59:23
From worker nodeHostnamedunegli-8121614-0-fnpc23047.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-08 19:53:04
Input filesfardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250206T130104Z_gen_003018_supernova_g4_detsim_reco_20250724T082055Z_reco2.root
JobscriptExit code0
Real time6m (372s)
CPU time5m (359s = 96%)
Max RSS bytes906899456 (864 MiB)
Outputting started2026-01-08 19:59:16
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dune10kt_1x2x6_centralAPA/fnal/11629/1/001/fdhd_ana_2026-01-08T_195309Z_hist.root
Finished2026-01-08 19:59:23
Saved logsjustin-logs:272871.2-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

event

# of particles 8	from gen 1 marley
# of particles 11071	from gen 2 Ar39GenInLAr
# of particles 1234	from gen 3 Kr85GenInLAr
# of particles 1	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 10	from gen 6 Rn222ChainRn222GenInLAr
# of particles 11	from gen 7 Rn222ChainPo218GenInLAr
# of particles 20	from gen 8 Rn222ChainPb214GenInLAr
# of particles 9	from gen 9 Rn222ChainBi214GenInLAr
# of particles 6	from gen 10 Rn222ChainPb210GenInLAr
# of particles 1	from gen 11 Rn220ChainPb212GenInLAr
# of particles 16	from gen 12 K40GenInCPA
# of particles 224	from gen 13 U238ChainGenInCPA
# of particles 283	from gen 14 Th232ChainGenInCPA
# of particles 3	from gen 15 K42From42ArGenInCPA
# of particles 3	from gen 16 Rn222ChainPo218GenInCPA
# of particles 22	from gen 17 Rn222ChainPb214GenInCPA
# of particles 57	from gen 18 Rn222ChainBi214GenInCPA
# of particles 26	from gen 19 Rn222ChainPb210GenInCPA
# of particles 20	from gen 20 Rn222ChainFromBi210GenInCPA
# of particles 44	from gen 21 Rn220ChainFromPb212GenInCPA
# of particles 3	from gen 22 Co60GenInAPA
# of particles 1	from gen 23 U238ChainGenInAPA
# of particles 0	from gen 24 Th232ChainGenInAPA
# of particles 42	from gen 25 U238Th232K40GenInLArAPAboards1x2x6
# of particles 0	from gen 26 Rn222ChainGenInPDS
# of particles 19159	from gen 27 CavernwallGammasAtLAr1x2x6lowBgAPA
# of particles 764	from gen 28 foamGammasAtLAr1x2x6lowBgAPA
# of particles 0	from gen 29 CavernwallNeutronsAtLAr1x2x6lowBgAPA
# of particles 0	from gen 30 CryostatNGammasAtLAr1x2x6lowBgAPA
# of particles 0	from gen 31 CavernNGammasAtLAr1x2x6lowBgAPA
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  08-Jan-2026 19:59:03 UTC run: 5082 subRun: 0 event: 150900

Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 8.32 MeV
Position (212.69, 196.27, 1066.22) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.32	(212.69, 196.27, 1066.22)	33070	33032
marley	-12		0.99	(212.69, 196.27, 1066.22)	33069	33032
marley	1000200400	0.00	(212.69, 196.27, 1066.22)	33068	33032
marley	22		0.03	(212.69, 196.27, 1066.22)	33035	0
marley	22		1.61	(212.69, 196.27, 1066.22)	33034	0
marley	22		0.65	(212.69, 196.27, 1066.22)	33033	0
marley	1000190400	0.00	(212.69, 196.27, 1066.22)	33032	0
marley	11		4.52	(212.69, 196.27, 1066.22)	33031	0
Signal Track IDs: 33031; 33032; 33033; 33034; 33035; 33068; 33069; 33070; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  08-Jan-2026 19:59:03 UTC run: 5082 subRun: 0 event: 150900

Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  08-Jan-2026 19:59:06 UTC run: 5082 subRun: 0 event: 150900
OpFlash PE 16.07 with purity 0.65 time -23.41 plane 0
 - Vertex (0.05, 280.22, 1076.28)
	*** 1st Sanity check: Ratio 0.86 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 60.88 with purity 0.28 time -18.44 plane 0
 - Vertex (0.05, 290.63, 682.59)
	*** 1st Sanity check: Ratio 0.49 <= 1.00
	*** 2nd Sanity check: #OpHits 8 >= 8
OpFlash PE 16.43 with purity 0.26 time -18.06 plane 0
 - Vertex (0.03, 44.70, 510.96)
	*** 1st Sanity check: Ratio 0.20 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 44.23 with purity 0.90 time -17.73 plane 0
 - Vertex (0.04, 241.62, 1048.48)
	*** 1st Sanity check: Ratio 0.12 <= 1.00
	*** 2nd Sanity check: #OpHits 14 >= 14
OpFlash PE 24.66 with purity 0.87 time -17.49 plane 0
 - Vertex (0.05, 276.95, 1070.09)
	*** 1st Sanity check: Ratio 0.27 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 7.39 with purity 1.00 time -17.06 plane 0
 - Vertex (-0.00, 73.42, 909.06)
	*** 1st Sanity check: Ratio 0.52 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 16.05 with purity 0.70 time -16.67 plane 0
 - Vertex (0.04, 198.69, 966.49)
	*** 1st Sanity check: Ratio 0.19 <= 1.00
	*** 2nd Sanity check: #OpHits 8 >= 8
OpFlash PE 3.92 with purity 0.54 time -16.18 plane 0
 - Vertex (0.05, 337.09, 1148.27)
	*** 1st Sanity check: Ratio 0.54 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 4.21 with purity 1.00 time -15.74 plane 0
 - Vertex (0.05, 340.86, 844.42)
	*** 1st Sanity check: Ratio 0.51 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 3.53 with purity 0.50 time -14.91 plane 0
 - Vertex (0.05, 218.53, 870.25)
	*** 1st Sanity check: Ratio 0.50 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 34.36 with purity 0.32 time -12.18 plane 0
 - Vertex (0.05, 591.57, 781.09)
	*** 1st Sanity check: Ratio 0.95 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 11.73 with purity 0.58 time -11.10 plane 0
 - Vertex (0.05, 31.14, 1013.48)
	*** 1st Sanity check: Ratio 0.78 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 21.32 with purity 0.62 time -8.48 plane 0
 - Vertex (0.05, 155.68, 1013.48)
	*** 1st Sanity check: Ratio 0.83 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3

# of OpHits (ophitspe): 72700 for times between -2262.02 us and 2227.60 us.
# of OpFlashes (solarflash): 9834 for times between -2262.02 us and 2227.60 us.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  08-Jan-2026 19:59:06 UTC run: 5082 subRun: 0 event: 150900

# OpHits (ophitspe) in full geometry: 72700
# OpFlashes (solarflash) in full geometry: 9834
# Hits (hitfd) in each view: 171, 171, 468, 0
# Cluster from the hits: 111, 109, 436, 0
# Tracks (pmtracktc) in full geometry: 0
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  08-Jan-2026 19:59:16 UTC run: 5082 subRun: 0 event: 150900

# ClusterReco: Looping over 249 matched clusters
%MSG
Selecting flash with PE 10.8033 closer to predicted PE 21.5497 than reference flash PE 7.86 predicted PE 20.6891
The differences are 0.994726 and 1.6322
Selecting flash with PE 20.43 closer to predicted PE 39.2425 than reference flash PE 10.8033 predicted PE 21.5497
The differences are 0.920827 and 0.994726
Selecting flash with PE 44.2267 closer to predicted PE 63.8269 than reference flash PE 20.43 predicted PE 39.2425
The differences are 0.443176 and 0.920827
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  08-Jan-2026 19:59:16 UTC run: 5082 subRun: 0 event: 150900
*** Matched preselection cluster: 140 from 249
 - MainTrackID 33031
 - Gen 1 -> marley TPC 19
 - Purity 1.00 Hits 2
 - Charge 309.86 ( MaxHit 236.06 )
 - #AdjCl 2 ( 2 signal ):
    - Cluster 107 at distance 40.11 with time 1070.08 and charge 41.06 in TPC 19 and hits 1
    - Cluster 136 at distance 10.44 with time 1275.76 and charge 139.72 in TPC 19 and hits 2
 - RecoCol  Time,Y,Z ( 1302.45, 196.36, 1066.31 )
 - RecoInd0 Time,Y,Z ( 1302.48, 196.40, 1044.88 )
 - RecoInd1 Time,Y,Z ( 1302.23, 196.32, 1044.88 )
*** Matched flash: 4966 from 9834
 - Purity 90.45 % Plane 0 #Hits 14
 - MainOpHitPE 5.20 (PE);  TotalPE 44.23 vs expected 63.83 (PE)
 - Time -17.73 (us) Fast 14.02 % Residual 2.77
 - Reco Time,Y,Z ( -17.73, 241.62, 1048.48 )
 - Found valid waveform: false
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 212.69, 196.27, 1066.22 )
 - Main X,Y,Z ( 211.78, 196.38, 1066.44 )
 - EDep X,Y,Z ( 211.87, 196.36, 1066.43 )
 - Reco X,Y,Z ( 211.97, 196.36, 1066.31 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  08-Jan-2026 19:59:16 UTC run: 5082 subRun: 0 event: 150900
-----------------------------------------------------------------------------------------

%MSG
08-Jan-2026 19:59:16 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/13/72/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250206T130104Z_gen_003018_supernova_g4_detsim_reco_20250724T082055Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 08-Jan-2026 19:59:16 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.138131       6.68414       15.8252      0.355661       7.05763        50     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00116127    0.00725104     0.0329251    0.00198076    0.00786908       50     
end_path:solarnuana:SolarNuAna     0.131546       6.67676       15.8231      0.353925       7.05893        50     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 08-Jan-2026 19:59:16 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1553.29 MB
  Peak resident set size usage (VmHWM): 908.657 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 50 passed = 50 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         50         50          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 346.617951 Real = 356.828028

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1553.29 VmHWM = 908.657

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-06 14:26:14 UTC       justIN version: 01.06.00