justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 47134.4@dunegpschedd01.fnal.gov

Jobsub ID47134.4@dunegpschedd01.fnal.gov
Workflow ID2624
Stage ID1
User namesmanthey@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-09-16 19:10:14
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-09-16 19:20:44
From worker nodeHostnamedunegli-7031861-0-fnpc23037.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-16 19:11:15
Input filesfardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250210T173343Z_gen_003457_supernova_g4_halfActiveVol_detsim_reco_20250724T181635Z_reco2.root
JobscriptExit code0
Real time9m (560s)
CPU time9m (547s = 97%)
Max RSS bytes866881536 (826 MiB)
Outputting started2025-09-16 19:20:36
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dune10kt_1x2x6_lateralAPA/fnal/02624/1/001/fdhd_ana_2025-09-16T_191122Z_hist.root
Finished2025-09-16 19:20:44
Saved logsjustin-logs:47134.4-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

3, 607.87, 729.27)	33306	33271
marley	1000180400	0.02	(56.30, 433.98, 903.96)	33305	33271
marley	1000180400	0.01	(56.24, 434.06, 903.80)	33304	33271
marley	1000180400	0.02	(45.24, 435.89, 907.81)	33303	33271
marley	1000180400	0.00	(46.39, 436.24, 907.60)	33302	33271
marley	1000180400	0.02	(55.62, 438.41, 903.64)	33301	33271
marley	1000180400	0.02	(51.09, 437.00, 905.92)	33300	33271
marley	1000180400	0.01	(60.17, 451.73, 897.90)	33299	33271
marley	1000180400	0.02	(61.88, 450.76, 897.12)	33298	33271
marley	1000180400	0.02	(54.28, 449.31, 888.02)	33297	33271
marley	1000180400	0.03	(53.45, 448.14, 889.26)	33296	33271
marley	1000180400	0.01	(52.00, 451.04, 885.49)	33295	33271
marley	1000180400	0.01	(131.18, 452.45, 827.45)	33294	33271
marley	1000180360	0.00	(133.02, 464.27, 820.56)	33293	33271
marley	1000180400	0.02	(141.69, 481.65, 811.33)	33292	33271
marley	1000180400	0.02	(82.34, 501.05, 781.08)	33291	33271
marley	1000180400	0.02	(73.93, 501.44, 797.70)	33290	33271
marley	1000180400	0.01	(69.82, 491.30, 795.31)	33289	33271
marley	1000180400	0.02	(98.19, 466.80, 759.73)	33288	33271
marley	1000180400	0.00	(116.67, 428.75, 793.98)	33287	33271
marley	1000180400	0.02	(118.71, 411.84, 820.88)	33286	33271
marley	22		1.46	(33.88, 450.06, 869.11)	33273	33231
marley	1000180400	0.05	(33.88, 450.06, 869.11)	33272	33231
marley	2112		0.44	(33.88, 450.06, 869.11)	33271	33231
marley	1000180400	0.12	(35.87, 460.16, 871.59)	33270	33231
marley	1000180400	0.16	(37.98, 458.56, 874.23)	33269	33231
marley	1000180400	0.16	(38.12, 458.58, 873.89)	33268	33231
marley	1000180400	0.14	(83.32, 469.05, 921.96)	33267	33231
marley	1000180400	0.02	(83.02, 468.83, 922.21)	33266	33231
marley	22		0.00	(80.49, 467.77, 922.55)	33234	33188
marley	22		3.91	(80.49, 467.77, 922.55)	33233	33188
marley	1000180400	0.05	(80.49, 467.77, 922.55)	33232	33188
marley	2112		2.54	(80.49, 467.77, 922.55)	33231	33188
marley	1000180400	0.01	(73.63, 465.90, 920.14)	33230	33188
marley	22		6.50	(71.65, 465.08, 918.92)	33189	0
marley	2112		6.51	(71.65, 465.08, 918.92)	33188	0
marley	1000190390	0.15	(71.65, 465.08, 918.92)	33187	0
marley	11		31.65	(71.65, 465.08, 918.92)	33186	0
Signal Track IDs: 33186; 33187; 33188; 33189; 33230; 33231; 33232; 33233; 33234; 33266; 33267; 33268; 33269; 33270; 33271; 33272; 33273; 33286; 33287; 33288; 33289; 33290; 33291; 33292; 33293; 33294; 33295; 33296; 33297; 33298; 33299; 33300; 33301; 33302; 33303; 33304; 33305; 33306; 33307; 33308; 33309; 33310; 33311; 33312; 33313; 33314; 33315; 33316; 33317; 33318; 33319; 33320; 33321; 33322; 33323; 33324; 33325; 33326; 33327; 33328; 33329; 33330; 33331; 33332; 33333; 33334; 33335; 33336; 33337; 33352; 33372; 33373; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:20:25 UTC run: 5117 subRun: 0 event: 172850
OpFlash PE 18.92 with purity 0.13 time -0.06 plane 0
 - Vertex (-0.05, -267.72, 997.01)
	*** 1st Sanity check: Ratio 0.27 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 232.35 with purity 0.32 time -0.02 plane 1
 - Vertex (0.05, 93.41, 1357.47)
	*** 1st Sanity check: Ratio 0.96 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 1913.38 with purity 0.96 time 0.00 plane 1
 - Vertex (0.05, 445.02, 900.08)
	*** 1st Sanity check: Ratio 0.12 <= 1.00
	*** 2nd Sanity check: #OpHits 114 >= 114
OpFlash PE 11.77 with purity 0.73 time 0.01 plane 0
 - Vertex (-0.05, -77.47, 840.66)
	*** 1st Sanity check: Ratio 0.34 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 9.25 with purity 0.10 time 0.03 plane 0
 - Vertex (-0.05, -432.16, 1034.73)
	*** 1st Sanity check: Ratio 0.46 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 154.92 with purity 0.98 time 0.03 plane 1
 - Vertex (0.05, 436.93, 897.58)
	*** 1st Sanity check: Ratio 0.10 <= 1.00
	*** 2nd Sanity check: #OpHits 36 >= 36
OpFlash PE 109.17 with purity 0.96 time 0.06 plane 1
 - Vertex (0.05, 356.28, 911.13)
	*** 1st Sanity check: Ratio 0.15 <= 1.00
	*** 2nd Sanity check: #OpHits 25 >= 25
OpFlash PE 27.78 with purity 0.89 time 0.08 plane 1
 - Vertex (0.05, 475.77, 942.67)
	*** 1st Sanity check: Ratio 0.19 <= 1.00
	*** 2nd Sanity check: #OpHits 11 >= 11
OpFlash PE 15.34 with purity 1.00 time 0.12 plane 1
 - Vertex (0.05, 397.13, 830.05)
	*** 1st Sanity check: Ratio 0.50 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3

# of OpFlashes (solarflash) in full geometry: 1177

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:20:25 UTC run: 5117 subRun: 0 event: 172850

# OpHits (ophitspe) in full geometry: 42223
# OpFlashes (solarflash) in full geometry: 1177
# Hits (hitfd) in each view: 174, 178, 312, 0
# Cluster from the hits: 107, 105, 282, 0
# Tracks (pmtracktc) in full geometry: 4
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:20:35 UTC run: 5117 subRun: 0 event: 172850

# ClusterReco: Looping over 192 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:20:35 UTC run: 5117 subRun: 0 event: 172850
*** Matched preselection cluster: 24
 - MainTrackID 33186
 - Gen 1 -> marley TPC 15
 - Purity 1.00 Hits 7
 - Charge 2097.78 ( MaxHit 621.60 )
 - #AdjCl 7 ( 7 signal ):
    - Cluster 17 at distance 60.84 with time 233.98 and charge 103.42 in TPC 15 and hits 1
    - Cluster 20 at distance 23.35 with time 382.82 and charge 722.40 in TPC 15 and hits 3
    - Cluster 26 at distance 41.79 with time 464.96 and charge 467.21 in TPC 15 and hits 3
    - Cluster 28 at distance 13.67 with time 517.91 and charge 385.10 in TPC 15 and hits 2
    - Cluster 31 at distance 28.12 with time 571.99 and charge 159.29 in TPC 19 and hits 1
    - Cluster 41 at distance 33.83 with time 626.00 and charge 484.22 in TPC 15 and hits 2
    - Cluster 50 at distance 43.75 with time 647.30 and charge 451.20 in TPC 15 and hits 1
 - RecoCol  Time,Y,Z ( 445.25, 463.74, 918.14 )
 - RecoInd0 Time,Y,Z ( 448.89, 463.95, 812.49 )
 - RecoInd1 Time,Y,Z ( 445.61, 463.52, 873.76 )
*** Matched flash: 
 - Purity 0.96 Plane 1 #Hits 114 PE 1913.38 MaxPE 234.73
 - Time 0.00 Fast 0.89 Residual 414.94
 - Reco Time,Y,Z ( 0.00, 445.02, 900.08 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 71.65, 465.08, 918.92 )
 - Main X,Y,Z ( 77.09, 463.41, 918.54 )
 - EDep X,Y,Z ( 103.64, 448.87, 909.23 )
 - Reco X,Y,Z ( 71.49, 463.74, 918.14 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:20:35 UTC run: 5117 subRun: 0 event: 172850
*** Matched preselection cluster: 39
 - MainTrackID 33186
 - Gen 1 -> marley TPC 15
 - Purity 1.00 Hits 1
 - Charge 67.95 ( MaxHit 67.95 )
 - #AdjCl 3 ( 2 signal ):
    - Cluster 40 at distance 39.35 with time 623.63 and charge 44.99 in TPC 19 and hits 1
    - Cluster 52 at distance 46.41 with time 674.01 and charge 39.87 in TPC 15 and hits 1
    - Cluster 53 at distance 8.70 with time 674.53 and charge 53.37 in TPC 15 and hits 1
 - RecoCol  Time,Y,Z ( 623.50, -141.45, 905.65 )
 - RecoInd0 Time,Y,Z ( 618.82, -730.92, 1079.98 )
 - RecoInd1 Time,Y,Z ( 623.19, 448.03, 861.94 )
*** Matched flash: 
 - Purity 0.00 Plane 0 #Hits 13 PE 101.92 MaxPE 71.58
 - Time 16.87 Fast 0.91 Residual 1103.81
 - Reco Time,Y,Z ( 16.87, -155.68, 892.69 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 71.65, 465.08, 918.92 )
 - Main X,Y,Z ( 77.09, 463.41, 918.54 )
 - EDep X,Y,Z ( 103.64, 448.87, 909.23 )
 - Reco X,Y,Z ( 97.40, -141.45, 905.65 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:20:35 UTC run: 5117 subRun: 0 event: 172850
-----------------------------------------------------------------------------------------

%MSG
16-Sep-2025 19:20:35 UTC  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/40/89/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250210T173343Z_gen_003457_supernova_g4_halfActiveVol_detsim_reco_20250724T181635Z_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          8.05565       10.4435       12.0101       10.3985      0.780406        50     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00144476     0.0049514     0.032571     0.00191096    0.00661593       50     
end_path:solarnuana:SolarNuAna      8.05381       10.4383       12.0079       10.3899      0.780614        50     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 16-Sep-2025 19:20:35 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1495.32 MB
  Peak resident set size usage (VmHWM): 850.293 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 50 passed = 50 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         50         50          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 529.501124 Real = 540.073769

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1495.32 VmHWM = 850.293

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2025-09-19 19:00:25 UTC       justIN version: 01.05.00