justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 47140.1@dunegpschedd01.fnal.gov

Jobsub ID47140.1@dunegpschedd01.fnal.gov
Workflow ID2624
Stage ID1
User namesmanthey@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-09-16 19:26:15
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-09-16 19:45:34
From worker nodeHostnamedunegli-6879621-0-fnpc9005.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-16 19:27:23
Input filesfardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250209T165004Z_gen_000192_supernova_g4_halfActiveVol_detsim_reco_20250725T011229Z_reco2.root
JobscriptExit code0
Real time17m (1068s)
CPU time17m (1044s = 97%)
Max RSS bytes861130752 (821 MiB)
Outputting started2025-09-16 19:45:12
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dune10kt_1x2x6_lateralAPA/fnal/02624/1/001/fdhd_ana_2025-09-16T_192738Z_hist.root
Finished2025-09-16 19:45:34
Saved logsjustin-logs:47140.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

00	(403.30, 555.09, 715.95)	33062	32980
marley	2212		0.03	(411.01, 558.58, 728.26)	33061	32980
marley	2212		0.02	(400.26, 557.91, 751.72)	33060	32980
marley	1000180380	0.01	(-236.22, 568.07, 1150.93)	33059	32980
marley	1000180400	0.01	(-226.01, 560.37, 1137.63)	33058	32980
marley	1000180360	0.00	(-331.24, 537.18, 1287.86)	33057	32980
marley	1000180400	0.01	(-325.88, 507.31, 1302.61)	33056	32980
marley	1000180400	0.01	(-326.02, 507.45, 1302.38)	33055	32980
marley	1000180400	0.00	(-325.78, 507.34, 1302.52)	33054	32980
marley	1000180400	0.01	(-325.69, 505.03, 1302.42)	33053	32980
marley	1000180400	0.01	(-323.69, 506.69, 1307.69)	33052	32980
marley	1000180360	0.01	(-322.35, 491.11, 1295.29)	33051	32980
marley	1000180400	0.00	(-324.87, 490.45, 1301.54)	33050	32980
marley	1000180400	0.01	(-328.83, 462.83, 1306.06)	33049	32980
marley	1000180400	0.00	(-326.36, 464.57, 1308.58)	33048	32980
marley	1000180400	0.01	(-239.27, 447.01, 1264.45)	33047	32980
marley	1000180360	0.01	(-244.77, 452.75, 1271.18)	33046	32980
marley	1000180400	0.01	(-231.06, 456.29, 1279.95)	33045	32980
marley	1000180400	0.00	(-211.93, 430.64, 1251.63)	33044	32980
marley	1000180360	0.01	(-33.28, 402.76, 1246.09)	33043	32980
marley	1000180400	0.01	(-15.69, 379.52, 1194.05)	33042	32980
marley	1000180400	0.00	(-15.02, 389.12, 1190.27)	33041	32980
marley	1000180400	0.01	(-15.10, 390.04, 1189.67)	33040	32980
marley	1000180400	0.00	(-13.61, 377.74, 1185.27)	33039	32980
marley	1000180400	0.02	(-13.42, 375.74, 1186.24)	33038	32980
marley	1000180400	0.01	(3.93, 396.71, 1167.24)	33037	32980
marley	1000180400	0.02	(-86.16, 421.69, 1162.19)	33036	32980
marley	1000180400	0.02	(-62.48, 430.25, 1152.95)	33035	32980
marley	1000180400	0.03	(-64.18, 432.25, 1157.14)	33034	32980
marley	1000180400	0.03	(-64.93, 429.98, 1153.64)	33033	32980
marley	1000180400	0.00	(-54.56, 469.91, 1201.12)	33032	32980
marley	1000180400	0.03	(-53.90, 496.38, 1207.74)	33031	32980
marley	1000180400	0.02	(-56.20, 492.42, 1209.12)	33030	32980
marley	1000180400	0.01	(-56.00, 495.26, 1213.02)	33029	32980
marley	1000180400	0.03	(-60.26, 510.53, 1210.49)	33028	32980
marley	1000180400	0.03	(-74.19, 501.18, 1207.85)	33027	32980
marley	1000180360	0.04	(-62.50, 491.66, 1201.46)	33026	32980
marley	1000180400	0.02	(-102.84, 512.97, 1160.90)	33025	32980
marley	1000180400	0.03	(-101.29, 517.96, 1159.44)	33024	32980
marley	1000180400	0.01	(-168.62, 488.56, 1092.69)	33023	32980
marley	1000180400	0.05	(-163.92, 488.94, 1059.07)	33022	32980
marley	1000180400	0.03	(-174.73, 529.05, 1091.59)	33021	32980
marley	1000180400	0.01	(-161.35, 539.88, 1085.81)	33020	32980
marley	1000180400	0.01	(-154.97, 539.75, 1086.09)	33019	32980
marley	1000180400	0.01	(-136.10, 523.04, 1088.80)	33018	32980
marley	1000180400	0.02	(-128.35, 504.83, 1101.59)	33017	32980
marley	1000180400	0.04	(-145.10, 509.02, 1132.49)	33016	32980
marley	1000180400	0.07	(-91.59, 500.06, 1146.08)	33015	32980
marley	1000180400	0.07	(-93.21, 500.80, 1146.42)	33014	32980
marley	1000180400	0.04	(-35.92, 455.39, 1179.99)	33013	32980
marley	1000180400	0.08	(-11.83, 465.90, 1155.16)	33012	32980
marley	1000180400	0.01	(-23.13, 468.70, 1189.64)	33011	32980
marley	1000180400	0.06	(9.84, 502.31, 1270.84)	33010	32980
marley	1000180400	0.10	(30.80, 472.13, 1268.08)	33009	32980
marley	1000180400	0.02	(11.02, 493.30, 1260.86)	33008	32980
marley	1000180400	0.01	(11.42, 495.80, 1260.98)	33007	32980
marley	1000180400	0.09	(12.04, 512.32, 1251.18)	33006	32980
marley	1000180400	0.11	(10.08, 510.51, 1250.83)	33005	32980
marley	1000180400	0.13	(17.49, 514.18, 1245.26)	33004	32980
marley	1000180400	0.02	(14.71, 508.11, 1248.43)	33003	32980
marley	22		0.66	(12.88, 507.32, 1250.23)	32983	32979
marley	22		1.46	(12.88, 507.32, 1250.23)	32982	32979
marley	1000180400	0.04	(12.88, 507.32, 1250.23)	32981	32979
marley	2112		1.51	(12.88, 507.32, 1250.23)	32980	32979
marley	2112		3.67	(12.16, 507.88, 1251.38)	32979	0
marley	1000190390	0.13	(12.16, 507.88, 1251.38)	32978	0
marley	11		20.52	(12.16, 507.88, 1251.38)	32977	0
Signal Track IDs: 32977; 32978; 32979; 32980; 32981; 32982; 32983; 33003; 33004; 33005; 33006; 33007; 33008; 33009; 33010; 33011; 33012; 33013; 33014; 33015; 33016; 33017; 33018; 33019; 33020; 33021; 33022; 33023; 33024; 33025; 33026; 33027; 33028; 33029; 33030; 33031; 33032; 33033; 33034; 33035; 33036; 33037; 33038; 33039; 33040; 33041; 33042; 33043; 33044; 33045; 33046; 33047; 33048; 33049; 33050; 33051; 33052; 33053; 33054; 33055; 33056; 33057; 33058; 33059; 33060; 33061; 33062; 33063; 33064; 33065; 33066; 33067; 33068; 33069; 33105; 33106; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:44:56 UTC run: 5100 subRun: 0 event: 9600
OpFlash PE 1305.24 with purity 0.93 time 0.00 plane 1
 - Vertex (0.05, 517.40, 1258.61)
	*** 1st Sanity check: Ratio 0.37 <= 1.00
	*** 2nd Sanity check: #OpHits 44 >= 44
OpFlash PE 10.61 with purity 0.37 time 0.00 plane 1
 - Vertex (0.05, 225.34, 613.42)
	*** 1st Sanity check: Ratio 0.26 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 70.96 with purity 1.00 time 0.02 plane 1
 - Vertex (0.05, 505.80, 1287.17)
	*** 1st Sanity check: Ratio 0.24 <= 1.00
	*** 2nd Sanity check: #OpHits 18 >= 18
OpFlash PE 5.55 with purity 0.33 time 0.03 plane 1
 - Vertex (0.05, 328.91, 543.36)
	*** 1st Sanity check: Ratio 0.37 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 14.92 with purity 1.00 time 0.05 plane 1
 - Vertex (0.05, 535.57, 1212.57)
	*** 1st Sanity check: Ratio 0.39 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 68.95 with purity 0.37 time 0.05 plane 1
 - Vertex (0.05, 217.95, 548.70)
	*** 1st Sanity check: Ratio 0.95 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 14.98 with purity 1.00 time 0.07 plane 1
 - Vertex (0.05, 467.03, 1197.07)
	*** 1st Sanity check: Ratio 0.49 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 12.54 with purity 1.00 time 0.09 plane 1
 - Vertex (0.05, 470.27, 1245.82)
	*** 1st Sanity check: Ratio 0.30 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5

# of OpFlashes (solarflash) in full geometry: 1113

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:44:56 UTC run: 5100 subRun: 0 event: 9600

# OpHits (ophitspe) in full geometry: 39200
# OpFlashes (solarflash) in full geometry: 1113
# Hits (hitfd) in each view: 167, 155, 298, 0
# Cluster from the hits: 98, 97, 266, 0
# Tracks (pmtracktc) in full geometry: 1
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:45:11 UTC run: 5100 subRun: 0 event: 9600

# ClusterReco: Looping over 161 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:45:11 UTC run: 5100 subRun: 0 event: 9600
*** Matched preselection cluster: 12
 - MainTrackID 32978
 - Gen 1 -> marley TPC 23
 - Purity 1.00 Hits 12
 - Charge 2953.71 ( MaxHit 532.84 )
 - #AdjCl 0 ( 0 signal ):
 - RecoCol  Time,Y,Z ( 83.55, 507.10, 1251.94 )
 - RecoInd0 Time,Y,Z ( 82.77, 506.86, 1240.43 )
 - RecoInd1 Time,Y,Z ( 78.57, 507.33, 1288.79 )
*** Matched flash: 
 - Purity 0.93 Plane 1 #Hits 44 PE 1305.24 MaxPE 487.35
 - Time 0.00 Fast 0.92 Residual 317.58
 - Reco Time,Y,Z ( 0.00, 517.40, 1258.61 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 12.16, 507.88, 1251.38 )
 - Main X,Y,Z ( 12.16, 507.88, 1251.38 )
 - EDep X,Y,Z ( 12.20, 507.88, 1251.38 )
 - Reco X,Y,Z ( 13.42, 507.10, 1251.94 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:45:11 UTC run: 5100 subRun: 0 event: 9600
-----------------------------------------------------------------------------------------

%MSG
16-Sep-2025 19:45:11 UTC  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/cb/ca/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250209T165004Z_gen_000192_supernova_g4_halfActiveVol_detsim_reco_20250725T011229Z_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          14.8365       19.9031       27.9746       18.7918       3.42462        50     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00138101    0.00622007     0.0284584    0.00200053    0.00759104       50     
end_path:solarnuana:SolarNuAna      14.8343       19.8966       27.9662       18.7898       3.42477        50     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 16-Sep-2025 19:45:12 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1494.9 MB
  Peak resident set size usage (VmHWM): 849.347 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 50 passed = 50 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         50         50          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1016.822661 Real = 1030.166051

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1494.9 VmHWM = 849.347

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2025-09-19 14:30:33 UTC       justIN version: 01.05.00