justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 265912.0@dunegpschedd02.fnal.gov

Jobsub ID265912.0@dunegpschedd02.fnal.gov
Workflow ID11515
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-04 20:31:29
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2026-01-04 21:15:39
From worker nodeHostnamedunegli-8240627-0-fnpc22033.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-04 21:08:48
Input filesfardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250207T180906Z_gen_003688_supernova_g4_detsim_reco_20250724T130248Z_reco2.root
JobscriptExit code0
Real time6m (404s)
CPU time6m (389s = 96%)
Max RSS bytes904671232 (862 MiB)
Outputting started2026-01-04 21:15:32
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dune10kt_1x2x6_centralAPA/fnal/11515/1/001/fdhd_ana_2026-01-04T_210853Z_hist.root
Finished2026-01-04 21:15:39
Saved logsjustin-logs:265912.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

000180400	0.00	(-260.36, 348.02, 918.60)	32877	32843
marley	1000180400	0.01	(-260.54, 345.79, 907.90)	32876	32843
marley	1000180400	0.01	(-246.10, 298.34, 1080.98)	32875	32843
marley	1000180400	0.01	(-287.10, 316.67, 1041.76)	32874	32843
marley	1000180400	0.01	(-275.20, 287.52, 1079.77)	32873	32843
marley	1000180400	0.01	(-179.24, 328.59, 1136.90)	32872	32843
marley	1000180400	0.02	(-180.49, 330.92, 1135.65)	32871	32843
marley	1000180400	0.01	(-176.82, 324.10, 1134.72)	32870	32843
marley	1000180400	0.02	(-221.15, 275.35, 1128.89)	32869	32843
marley	1000180400	0.01	(-219.41, 275.69, 1132.17)	32868	32843
marley	1000180400	0.01	(-218.99, 278.28, 1133.34)	32867	32843
marley	1000180400	0.01	(-202.61, 265.30, 1157.37)	32866	32843
marley	1000180400	0.01	(-202.80, 265.70, 1157.63)	32865	32843
marley	1000180400	0.01	(-184.78, 280.24, 1327.92)	32864	32843
marley	1000180360	0.02	(-186.05, 278.18, 1329.31)	32863	32843
marley	1000180400	0.02	(-204.42, 295.28, 1305.81)	32862	32843
marley	1000180400	0.00	(-201.00, 286.81, 1301.70)	32861	32843
marley	1000180360	0.04	(-186.43, 273.28, 1275.04)	32860	32843
marley	1000180400	0.03	(-189.41, 277.41, 1285.18)	32859	32843
marley	1000180400	0.03	(-149.57, 218.39, 1265.32)	32858	32843
marley	1000180400	0.02	(-172.74, 249.05, 1248.01)	32857	32843
marley	22		1.46	(-227.03, 230.18, 1327.47)	32845	32810
marley	1000180400	0.11	(-227.03, 230.18, 1327.47)	32844	32810
marley	2112		0.43	(-227.03, 230.18, 1327.47)	32843	32810
marley	1000180400	0.02	(-220.68, 231.81, 1324.11)	32842	32810
marley	22		3.88	(-216.08, 238.14, 1322.31)	32812	0
marley	22		2.48	(-216.08, 238.14, 1322.31)	32811	0
marley	2112		2.01	(-216.08, 238.14, 1322.31)	32810	0
marley	1000190390	0.08	(-216.08, 238.14, 1322.31)	32809	0
marley	11		10.71	(-216.08, 238.14, 1322.31)	32808	0
Signal Track IDs: 32808; 32809; 32810; 32811; 32812; 32842; 32843; 32844; 32845; 32857; 32858; 32859; 32860; 32861; 32862; 32863; 32864; 32865; 32866; 32867; 32868; 32869; 32870; 32871; 32872; 32873; 32874; 32875; 32876; 32877; 32878; 32879; 32880; 32881; 32882; 32883; 32884; 32885; 32886; 32887; 32888; 32889; 32890; 32891; 32892; 32893; 32894; 32895; 32896; 32897; 32898; 32899; 32900; 32902; 32903; 32904; 32905; 32906; 32973; 32974; 32975; 32976; 32977; 32978; 32979; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  04-Jan-2026 21:15:19 UTC run: 5092 subRun: 0 event: 184400

Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  04-Jan-2026 21:15:22 UTC run: 5092 subRun: 0 event: 184400
OpFlash PE 8.86 with purity 0.60 time -21.26 plane 0
 - Vertex (0.05, 280.22, 1076.28)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 100.22 with purity 0.95 time -18.01 plane 0
 - Vertex (0.05, 207.09, 1236.19)
	*** 1st Sanity check: Ratio 0.08 <= 1.00
	*** 2nd Sanity check: #OpHits 26 >= 26
OpFlash PE 68.21 with purity 0.99 time -17.46 plane 0
 - Vertex (0.05, 246.10, 1321.42)
	*** 1st Sanity check: Ratio 0.22 <= 1.00
	*** 2nd Sanity check: #OpHits 17 >= 17
OpFlash PE 29.18 with purity 0.28 time -17.07 plane 0
 - Vertex (-0.05, -467.03, 892.69)
	*** 1st Sanity check: Ratio 0.67 <= 1.00
	*** 2nd Sanity check: #OpHits 6 >= 6
OpFlash PE 23.01 with purity 1.00 time -16.43 plane 0
 - Vertex (0.03, 219.54, 1295.25)
	*** 1st Sanity check: Ratio 0.31 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 5.95 with purity 1.00 time -16.02 plane 0
 - Vertex (0.02, 134.33, 1269.66)
	*** 1st Sanity check: Ratio 0.35 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 19.81 with purity 0.90 time -15.40 plane 0
 - Vertex (0.05, 231.34, 1120.65)
	*** 1st Sanity check: Ratio 0.59 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 3.53 with purity 0.52 time -14.76 plane 0
 - Vertex (0.05, 407.40, 1023.35)
	*** 1st Sanity check: Ratio 0.52 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 3.94 with purity 1.00 time -14.17 plane 0
 - Vertex (0.05, 390.85, 1155.88)
	*** 1st Sanity check: Ratio 0.56 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 1.93 with purity 1.00 time -14.11 plane 0
 - Vertex (-0.05, -591.57, 1357.47)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 5.38 with purity 0.60 time -13.57 plane 0
 - Vertex (0.01, 93.17, 1094.60)
	*** 1st Sanity check: Ratio 0.62 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 9.23 with purity 0.50 time -12.89 plane 0
 - Vertex (-0.00, 23.17, 1200.99)
	*** 1st Sanity check: Ratio 0.32 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4

# of OpHits (ophitspe): 70247 for times between -2262.54 us and 2225.38 us.
# of OpFlashes (solarflash): 9508 for times between -2262.50 us and 2225.38 us.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  04-Jan-2026 21:15:22 UTC run: 5092 subRun: 0 event: 184400

# OpHits (ophitspe) in full geometry: 70247
# OpFlashes (solarflash) in full geometry: 9508
# Hits (hitfd) in each view: 209, 192, 461, 0
# Cluster from the hits: 135, 124, 424, 0
# Tracks (pmtracktc) in full geometry: 2
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  04-Jan-2026 21:15:32 UTC run: 5092 subRun: 0 event: 184400

# ClusterReco: Looping over 297 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  04-Jan-2026 21:15:32 UTC run: 5092 subRun: 0 event: 184400
*** Matched preselection cluster: 139 from 297
 - MainTrackID 32811
 - Gen 1 -> marley TPC 22
 - Purity 1.00 Hits 2
 - Charge 194.17 ( MaxHit 140.82 )
 - #AdjCl 0 ( 0 signal ):
 - RecoCol  Time,Y,Z ( 1312.57, -82.67, 1317.61 )
 - RecoInd0 Time,Y,Z ( 1303.93, -408.47, 644.04 )
 - RecoInd1 Time,Y,Z ( 1310.01, 243.14, 1277.27 )
*** Matched flash: 2887 from 9508
 - Purity 0.00 % Plane 0 #Hits 3 PE 33.05 MainOpHitPE 22.09
 - Time -871.50 (us) Fast 69.86 % Residual 110.46
 - Reco Time,Y,Z ( -871.50, -93.41, 1343.05 )
 - Found valid waveform: false
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -216.08, 238.14, 1322.31 )
 - Main X,Y,Z ( -213.56, 255.18, 1320.44 )
 - EDep X,Y,Z ( -213.34, 243.54, 1317.85 )
 - Reco X,Y,Z ( -350.68, -82.67, 1317.61 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  04-Jan-2026 21:15:32 UTC run: 5092 subRun: 0 event: 184400
*** Matched preselection cluster: 140 from 297
 - MainTrackID 32808
 - Gen 1 -> marley TPC 22
 - Purity 1.00 Hits 5
 - Charge 1349.24 ( MaxHit 465.20 )
 - #AdjCl 2 ( 2 signal ):
    - Cluster 104 at distance 55.04 with time 1065.89 and charge 388.22 in TPC 22 and hits 2
    - Cluster 147 at distance 13.10 with time 1374.16 and charge 100.86 in TPC 22 and hits 1
 - RecoCol  Time,Y,Z ( 1314.81, 237.27, 1322.89 )
 - RecoInd0 Time,Y,Z ( 1314.14, 237.29, 1277.27 )
 - RecoInd1 Time,Y,Z ( 1314.20, 237.25, 1277.27 )
*** Matched flash: 3880 from 9508
 - Purity 0.00 % Plane 0 #Hits 12 PE 182.29 MainOpHitPE 142.55
 - Time -388.29 (us) Fast 78.75 % Residual 10967.71
 - Reco Time,Y,Z ( -388.29, 217.95, 1308.67 )
 - Found valid waveform: false
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -216.08, 238.14, 1322.31 )
 - Main X,Y,Z ( -212.53, 236.58, 1323.73 )
 - EDep X,Y,Z ( -215.31, 237.96, 1322.38 )
 - Reco X,Y,Z ( -273.45, 237.27, 1322.89 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  04-Jan-2026 21:15:32 UTC run: 5092 subRun: 0 event: 184400
-----------------------------------------------------------------------------------------

%MSG
04-Jan-2026 21:15:32 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/30/ce/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250207T180906Z_gen_003688_supernova_g4_detsim_reco_20250724T130248Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 04-Jan-2026 21:15:32 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.135462       7.29992       15.8842       11.6798       6.55873        50     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)             0.0010877     0.0122563     0.150065      0.0101843     0.0214458       50     
end_path:solarnuana:SolarNuAna      0.13391       7.2875        15.8697       11.6721       6.56118        50     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 04-Jan-2026 21:15:32 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1551.37 MB
  Peak resident set size usage (VmHWM): 905.851 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 50 passed = 50 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         50         50          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 376.050871 Real = 388.950699

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1551.37 VmHWM = 905.851

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-06 21:01:50 UTC       justIN version: 01.06.00