justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 47136.0@dunegpschedd01.fnal.gov

Jobsub ID47136.0@dunegpschedd01.fnal.gov
Workflow ID2624
Stage ID1
User namesmanthey@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-09-16 19:12:14
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-09-16 19:22:28
From worker nodeHostnamedunegli-6878711-0-fnpc23032.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-16 19:13:53
Input filesfardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250210T161937Z_gen_001469_supernova_g4_halfActiveVol_detsim_reco_20250724T190105Z_reco2.root
JobscriptExit code0
Real time8m (502s)
CPU time8m (486s = 96%)
Max RSS bytes854032384 (814 MiB)
Outputting started2025-09-16 19:22:15
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dune10kt_1x2x6_lateralAPA/fnal/02624/1/001/fdhd_ana_2025-09-16T_191403Z_hist.root
Finished2025-09-16 19:22:28
Saved logsjustin-logs:47136.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

, 714.23)	33210	33156
marley	1000180400	0.00	(118.29, 357.28, 713.82)	33209	33156
marley	1000180400	0.00	(118.45, 357.03, 713.50)	33208	33156
marley	1000180400	0.01	(119.31, 356.68, 712.98)	33207	33156
marley	1000180400	0.00	(116.90, 357.58, 713.03)	33206	33156
marley	1000180400	0.00	(107.45, 354.24, 695.08)	33205	33156
marley	1000180400	0.00	(106.30, 354.08, 694.79)	33204	33156
marley	1000180400	0.01	(104.60, 354.04, 695.36)	33203	33156
marley	1000180400	0.00	(115.55, 354.54, 706.02)	33202	33156
marley	1000180400	0.00	(107.98, 350.17, 726.74)	33201	33156
marley	1000180400	0.01	(114.46, 348.06, 730.10)	33200	33156
marley	1000180400	0.01	(114.53, 348.15, 729.94)	33199	33156
marley	1000180400	0.01	(107.50, 349.63, 733.13)	33198	33156
marley	1000180400	0.00	(156.92, 297.24, 746.35)	33197	33156
marley	1000180400	0.01	(216.09, 280.80, 756.95)	33196	33156
marley	1000180400	0.01	(112.72, 368.34, 539.04)	33195	33156
marley	1000180400	0.01	(325.35, 405.91, 526.93)	33194	33156
marley	1000180360	0.00	(228.02, 232.76, 423.17)	33193	33156
marley	1000180400	0.01	(222.36, 205.99, 424.15)	33192	33156
marley	1000180400	0.02	(222.01, 206.56, 423.39)	33191	33156
marley	1000180400	0.02	(244.11, 199.60, 435.91)	33190	33156
marley	1000180400	0.01	(182.91, 245.89, 414.21)	33189	33156
marley	1000180400	0.02	(187.16, 247.43, 411.32)	33188	33156
marley	1000180400	0.02	(138.72, 230.61, 372.87)	33187	33156
marley	1000180400	0.01	(149.47, 218.36, 377.73)	33186	33156
marley	1000180400	0.01	(148.91, 207.69, 363.46)	33185	33156
marley	1000180400	0.01	(258.90, 245.32, 323.32)	33184	33156
marley	1000180400	0.03	(258.95, 247.09, 324.48)	33183	33156
marley	1000180360	0.02	(248.03, 239.93, 319.62)	33182	33156
marley	1000180400	0.02	(239.21, 263.99, 308.21)	33181	33156
marley	1000180400	0.04	(239.94, 262.39, 305.91)	33180	33156
marley	1000180400	0.04	(243.00, 276.84, 317.94)	33179	33156
marley	22		0.00	(250.96, 267.29, 309.15)	33159	33103
marley	22		1.46	(250.96, 267.29, 309.15)	33158	33103
marley	1000180400	0.08	(250.96, 267.29, 309.15)	33157	33103
marley	2112		0.45	(250.96, 267.29, 309.15)	33156	33103
marley	1000180400	0.01	(242.02, 270.47, 304.51)	33155	33103
marley	22		8.59	(237.44, 273.58, 304.04)	33104	0
marley	2112		2.00	(237.44, 273.58, 304.04)	33103	0
marley	1000190390	0.12	(237.44, 273.58, 304.04)	33102	0
marley	11		29.92	(237.44, 273.58, 304.04)	33101	0
Signal Track IDs: 33101; 33102; 33103; 33104; 33155; 33156; 33157; 33158; 33159; 33179; 33180; 33181; 33182; 33183; 33184; 33185; 33186; 33187; 33188; 33189; 33190; 33191; 33192; 33193; 33194; 33195; 33196; 33197; 33198; 33199; 33200; 33201; 33202; 33203; 33204; 33205; 33206; 33207; 33208; 33209; 33210; 33211; 33212; 33213; 33214; 33215; 33216; 33217; 33218; 33219; 33220; 33221; 33222; 33223; 33224; 33225; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:22:05 UTC run: 5117 subRun: 0 event: 73450
OpFlash PE 452.37 with purity 0.98 time 0.00 plane 1
 - Vertex (0.05, 267.07, 281.13)
	*** 1st Sanity check: Ratio 0.04 <= 1.00
	*** 2nd Sanity check: #OpHits 91 >= 91
OpFlash PE 37.73 with purity 0.89 time 0.01 plane 0
 - Vertex (-0.05, -123.00, 324.68)
	*** 1st Sanity check: Ratio 0.19 <= 1.00
	*** 2nd Sanity check: #OpHits 14 >= 14
OpFlash PE 121.12 with purity 0.99 time 0.03 plane 1
 - Vertex (0.05, 295.25, 340.12)
	*** 1st Sanity check: Ratio 0.07 <= 1.00
	*** 2nd Sanity check: #OpHits 40 >= 40
OpFlash PE 8.05 with purity 1.00 time 0.03 plane 0
 - Vertex (-0.05, -79.02, 631.12)
	*** 1st Sanity check: Ratio 0.34 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 7.52 with purity 1.00 time 0.05 plane 0
 - Vertex (-0.05, -89.76, 408.71)
	*** 1st Sanity check: Ratio 0.31 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 202.95 with purity 0.90 time 0.06 plane 1
 - Vertex (0.05, 529.30, 781.09)
	*** 1st Sanity check: Ratio 0.27 <= 1.00
	*** 2nd Sanity check: #OpHits 44 >= 44
OpFlash PE 11.87 with purity 0.82 time 0.07 plane 0
 - Vertex (-0.05, -188.44, 478.70)
	*** 1st Sanity check: Ratio 0.33 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 30.05 with purity 1.00 time 0.10 plane 1
 - Vertex (0.05, 388.22, 700.20)
	*** 1st Sanity check: Ratio 0.47 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 7.03 with purity 0.78 time 0.13 plane 1
 - Vertex (0.05, 214.76, 617.60)
	*** 1st Sanity check: Ratio 0.29 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4

# of OpFlashes (solarflash) in full geometry: 1130

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:22:05 UTC run: 5117 subRun: 0 event: 73450

# OpHits (ophitspe) in full geometry: 41635
# OpFlashes (solarflash) in full geometry: 1130
# Hits (hitfd) in each view: 167, 166, 293, 0
# Cluster from the hits: 91, 95, 254, 0
# Tracks (pmtracktc) in full geometry: 2
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:22:15 UTC run: 5117 subRun: 0 event: 73450

# ClusterReco: Looping over 151 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:22:15 UTC run: 5117 subRun: 0 event: 73450
*** Matched preselection cluster: 59
 - MainTrackID 33217
 - Gen 1 -> marley TPC 11
 - Purity 1.00 Hits 2
 - Charge 440.13 ( MaxHit 355.22 )
 - #AdjCl 4 ( 4 signal ):
    - Cluster 64 at distance 13.80 with time 1246.34 and charge 265.09 in TPC 11 and hits 2
    - Cluster 71 at distance 16.82 with time 1284.38 and charge 172.61 in TPC 11 and hits 1
    - Cluster 72 at distance 18.68 with time 1286.12 and charge 140.02 in TPC 11 and hits 1
    - Cluster 76 at distance 17.01 with time 1299.73 and charge 353.02 in TPC 11 and hits 2
 - RecoCol  Time,Y,Z ( 1206.13, 408.90, 643.66 )
 - RecoInd0 Time,Y,Z ( 1206.13, 409.16, 580.10 )
 - RecoInd1 Time,Y,Z ( 1205.54, 408.65, 600.60 )
*** Matched flash: 
 - Purity 0.00 Plane 1 #Hits 7 PE 94.04 MaxPE 83.06
 - Time -31.91 Fast 0.93 Residual 2367.56
 - Reco Time,Y,Z ( -31.91, 404.76, 660.30 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 237.44, 273.58, 304.04 )
 - Main X,Y,Z ( 250.96, 267.29, 309.15 )
 - EDep X,Y,Z ( 195.86, 408.80, 643.48 )
 - Reco X,Y,Z ( 198.78, 408.90, 643.66 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:22:15 UTC run: 5117 subRun: 0 event: 73450
*** Matched preselection cluster: 90
 - MainTrackID 33101
 - Gen 1 -> marley TPC 7
 - Purity 1.00 Hits 13
 - Charge 3192.64 ( MaxHit 381.00 )
 - #AdjCl 5 ( 4 signal ):
    - Cluster 52 at distance 86.20 with time 1008.12 and charge 229.53 in TPC 7 and hits 2
    - Cluster 78 at distance 38.74 with time 1318.48 and charge 88.03 in TPC 7 and hits 1
    - Cluster 87 at distance 8.01 with time 1434.89 and charge 71.06 in TPC 7 and hits 1
    - Cluster 88 at distance 46.51 with time 1449.98 and charge 171.10 in TPC 7 and hits 1
    - Cluster 95 at distance 31.88 with time 1526.77 and charge 866.48 in TPC 7 and hits 5
 - RecoCol  Time,Y,Z ( 1463.09, 274.96, 301.47 )
 - RecoInd0 Time,Y,Z ( 1462.49, 274.88, 347.71 )
 - RecoInd1 Time,Y,Z ( 1462.79, 275.04, 347.71 )
*** Matched flash: 
 - Purity 0.98 Plane 1 #Hits 91 PE 452.37 MaxPE 17.07
 - Time 0.00 Fast 0.76 Residual 33.74
 - Reco Time,Y,Z ( 0.00, 267.07, 281.13 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 237.44, 273.58, 304.04 )
 - Main X,Y,Z ( 240.17, 276.38, 300.34 )
 - EDep X,Y,Z ( 237.55, 274.87, 301.51 )
 - Reco X,Y,Z ( 234.92, 274.96, 301.47 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:22:15 UTC run: 5117 subRun: 0 event: 73450
-----------------------------------------------------------------------------------------

%MSG
16-Sep-2025 19:22:15 UTC  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/25/81/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250210T161937Z_gen_001469_supernova_g4_halfActiveVol_detsim_reco_20250724T190105Z_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          8.00069       9.26036       10.9329       9.20911      0.762401        50     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00102662    0.00212162     0.0191924    0.00142322    0.00312065       50     
end_path:solarnuana:SolarNuAna      7.99917       9.2581        10.9313       9.20768      0.761933        50     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 16-Sep-2025 19:22:15 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1494 MB
  Peak resident set size usage (VmHWM): 847.847 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 50 passed = 50 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         50         50          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 470.973850 Real = 480.716853

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1494 VmHWM = 847.847

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2025-09-19 11:34:42 UTC       justIN version: 01.05.00