justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 40700.0@dunegpschedd02.fnal.gov

Jobsub ID40700.0@dunegpschedd02.fnal.gov
Workflow ID2626
Stage ID1
User namesmanthey@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-09-16 23:44:28
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-09-17 05:42:39
From worker nodeHostnamedunegli-6878175-0-fnpc22029.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-16 23:45:16
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T065328Z_gen_000926_supernova_g4stage1_g4stage2_detsim_reco_20250701T081436Z_reco2.root
JobscriptExit code0
Real time5h (21435s)
CPU time5h (21254s = 99%)
Max RSS bytes1925324800 (1836 MiB)
Outputting started2025-09-17 05:42:32
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_dunevd10kt_1x8x14_3view_30deg/fnal/02626/1/001/fdhd_ana_2025-09-16T_234522Z_hist.root
Finished2025-09-17 05:42:39
Saved logsjustin-logs:40700.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

marley	1000180400	0.00	(-186.09, 360.44, 597.98)	133033	132994
marley	1000180400	0.07	(-140.84, 365.44, 552.63)	133032	132994
marley	1000180400	0.00	(-146.14, 364.64, 555.78)	133031	132994
marley	1000180400	0.01	(-148.62, 365.33, 556.79)	133030	132994
marley	1000180400	0.03	(-166.56, 368.89, 619.17)	133029	132994
marley	1000180400	0.00	(-158.92, 362.64, 624.26)	133028	132994
marley	1000180400	0.08	(-107.14, 336.99, 701.63)	133027	132994
marley	1000180400	0.09	(-147.60, 370.83, 649.71)	133026	132994
marley	1000180400	0.07	(-121.62, 357.89, 677.85)	133025	132994
marley	1000180400	0.02	(-121.44, 348.19, 659.71)	133024	132994
marley	1000180400	0.09	(-138.92, 328.86, 653.45)	133023	132994
marley	1000180400	0.02	(-155.63, 521.81, 682.75)	133022	132994
marley	1000180400	0.05	(-167.93, 529.31, 685.73)	133021	132994
marley	1000180400	0.01	(-155.95, 570.32, 673.20)	133020	132994
marley	1000180400	0.07	(-144.98, 595.23, 650.07)	133019	132994
marley	1000180400	0.03	(-145.01, 595.23, 650.07)	133018	132994
marley	22		2.52	(-171.53, 559.75, 626.80)	132995	0
marley	2112		1.31	(-171.53, 559.75, 626.80)	132994	0
marley	1000190390	0.02	(-171.53, 559.75, 626.80)	132993	0
marley	11		35.93	(-171.53, 559.75, 626.80)	132992	0
Signal Track IDs: 132992; 132993; 132994; 132995; 133018; 133019; 133020; 133021; 133022; 133023; 133024; 133025; 133026; 133027; 133028; 133029; 133030; 133031; 133032; 133033; 133034; 133035; 133036; 133037; 133038; 133039; 133040; 133041; 133042; 133043; 133044; 133045; 133046; 133047; 133048; 133049; 133050; 133051; 133052; 133053; 133054; 133055; 133056; 133057; 133058; 133059; 133060; 133061; 133062; 133063; 133064; 133065; 133066; 133067; 133068; 133069; 133070; 133071; 133072; 133073; 133074; 133075; 133076; 133077; 133078; 133079; 133080; 133081; 133082; 133083; 133084; 133085; 133086; 133087; 133088; 133090; 133091; 133092; 133093; 133094; 133095; 133109; 133110; 133111; 133112; 133113; 133114; 133115; 133116; 133117; 133119; 133120; 133127; 133128; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  17-Sep-2025 05:18:33 UTC run: 5042 subRun: 0 event: 9260
OpFlash PE 26.95 with purity 0.41 time 0.02 plane 4
 - Vertex (195.59, 129.20, -96.50)
	*** 1st Sanity check: Ratio 0.30 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 25.18 with purity 0.09 time 0.02 plane 1
 - Vertex (60.07, 743.30, 1848.38)
	*** 1st Sanity check: Ratio 0.44 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 257.36 with purity 0.23 time 0.02 plane 1
 - Vertex (123.82, 743.30, 660.54)
	*** 1st Sanity check: Ratio 0.12 <= 1.00
	*** 2nd Sanity check: #OpHits 19 >= 19
OpFlash PE 38.98 with purity 0.27 time 0.02 plane 2
 - Vertex (123.69, -743.30, 1269.38)
	*** 1st Sanity check: Ratio 0.36 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 2180.79 with purity 0.28 time 0.02 plane 0
 - Vertex (-327.50, 541.17, 642.66)
	*** 1st Sanity check: Ratio 0.09 <= 1.00
	*** 2nd Sanity check: #OpHits 44 >= 44
OpFlash PE 9.59 with purity 0.21 time 0.07 plane 1
 - Vertex (60.07, 743.30, 323.24)
	*** 1st Sanity check: Ratio 0.57 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 158.52 with purity 0.56 time 0.10 plane 1
 - Vertex (60.07, 743.30, 748.10)
	*** 1st Sanity check: Ratio 0.45 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 12.90 with purity 0.29 time 0.11 plane 1
 - Vertex (146.70, 743.30, 152.42)
	*** 1st Sanity check: Ratio 0.58 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 27.60 with purity 0.93 time 7.28 plane 1
 - Vertex (89.70, 743.30, 921.71)
	*** 1st Sanity check: Ratio 0.29 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 874.99 with purity 0.71 time 7.28 plane 0
 - Vertex (-327.50, 456.91, 870.02)
	*** 1st Sanity check: Ratio 0.15 <= 1.00
	*** 2nd Sanity check: #OpHits 25 >= 25
OpFlash PE 1681.16 with purity 0.07 time 7.29 plane 1
 - Vertex (233.01, 743.30, 243.53)
	*** 1st Sanity check: Ratio 0.24 <= 1.00
	*** 2nd Sanity check: #OpHits 14 >= 14
OpFlash PE 16.07 with purity 0.32 time 7.30 plane 0
 - Vertex (-327.50, -16.79, 228.89)
	*** 1st Sanity check: Ratio 0.68 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 13.69 with purity 0.31 time 7.30 plane 0
 - Vertex (-327.50, 565.03, 1457.81)
	*** 1st Sanity check: Ratio 0.61 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 732.28 with purity 0.05 time 7.32 plane 3
 - Vertex (135.07, -220.00, 2188.38)
	*** 1st Sanity check: Ratio 0.35 <= 1.00
	*** 2nd Sanity check: #OpHits 9 >= 9
OpFlash PE 86.00 with purity 0.12 time 7.33 plane 0
 - Vertex (-327.50, -41.96, 1070.36)
	*** 1st Sanity check: Ratio 0.34 <= 1.00
	*** 2nd Sanity check: #OpHits 6 >= 6
OpFlash PE 19.95 with purity 0.10 time 7.34 plane 0
 - Vertex (-327.50, 477.01, 1049.51)
	*** 1st Sanity check: Ratio 0.41 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 618.38 with purity 0.13 time 7.36 plane 1
 - Vertex (210.07, 743.30, 748.10)
	*** 1st Sanity check: Ratio 0.39 <= 1.00
	*** 2nd Sanity check: #OpHits 15 >= 15
OpFlash PE 58.63 with purity 0.58 time 7.41 plane 0
 - Vertex (-327.50, 309.41, 742.69)
	*** 1st Sanity check: Ratio 0.19 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7

# of OpFlashes (solarflash) in full geometry: 18819

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  17-Sep-2025 05:18:35 UTC run: 5042 subRun: 0 event: 9260

# OpHits (ophit10ppm) in full geometry: 52845
# OpFlashes (solarflash) in full geometry: 18819
# Hits (gaushit) in each view: 6968, 6883, 6722, 0
# Cluster from the hits: 2882, 2898, 5682, 0
# Tracks (pmtracktc) in full geometry: 477
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  17-Sep-2025 05:42:32 UTC run: 5042 subRun: 0 event: 9260

# ClusterReco: Looping over 5672 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  17-Sep-2025 05:42:32 UTC run: 5042 subRun: 0 event: 9260
*** Matched preselection cluster: 4120
 - MainTrackID 132992
 - Gen 1 -> marley TPC 39
 - Purity 1.00 Hits 19
 - Charge 3529.72 ( MaxHit 378.43 )
 - #AdjCl 9 ( 0 signal ):
    - Cluster 3481 at distance 99.69 with time 2664.49 and charge 36.44 in TPC 38 and hits 1
    - Cluster 3643 at distance 68.06 with time 2767.74 and charge 49.65 in TPC 39 and hits 1
    - Cluster 3674 at distance 69.11 with time 2789.02 and charge 112.22 in TPC 35 and hits 2
    - Cluster 3845 at distance 57.06 with time 2909.52 and charge 46.24 in TPC 31 and hits 2
    - Cluster 4038 at distance 78.82 with time 3053.29 and charge 43.60 in TPC 39 and hits 1
    - Cluster 4097 at distance 73.78 with time 3101.91 and charge 18.14 in TPC 32 and hits 1
    - Cluster 4198 at distance 63.88 with time 3173.32 and charge 22.84 in TPC 38 and hits 1
    - Cluster 4277 at distance 48.53 with time 3217.22 and charge 56.74 in TPC 31 and hits 1
    - Cluster 4336 at distance 93.22 with time 3259.86 and charge 33.60 in TPC 37 and hits 1
 - RecoCol  Time,Y,Z ( 3117.20, 562.74, 623.63 )
 - RecoInd0 Time,Y,Z ( 3117.48, 562.76, 661.33 )
 - RecoInd1 Time,Y,Z ( 3117.24, 562.73, 672.64 )
*** Matched flash: 
 - Purity 0.28 Plane 0 #Hits 44 PE 2180.79 MaxPE 188.89
 - Time 0.02 Fast 0.64 Residual 643.16
 - Reco Time,Y,Z ( 0.02, 541.17, 642.66 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -171.53, 559.75, 626.80 )
 - Main X,Y,Z ( -177.38, 566.05, 619.93 )
 - EDep X,Y,Z ( -176.85, 564.01, 622.98 )
 - Reco X,Y,Z ( -175.47, 562.74, 623.63 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  17-Sep-2025 05:42:32 UTC run: 5042 subRun: 0 event: 9260
-----------------------------------------------------------------------------------------

%MSG
17-Sep-2025 05:42:32 UTC  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/f7/47/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T065328Z_gen_000926_supernova_g4stage1_g4stage2_detsim_reco_20250701T081436Z_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          1471.53       2139.78       2585.88       2157.71       380.985        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000656415   0.00921304     0.0209444     0.0071996    0.00872053       10     
end_path:solarnuana:SolarNuAna      1471.53       2139.77       2585.86       2157.69       380.982        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 17-Sep-2025 05:42:32 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2547.69 MB
  Peak resident set size usage (VmHWM): 1925.32 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 21242.518421 Real = 21421.296238

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 2547.69 VmHWM = 1925.32

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2025-09-20 07:25:40 UTC       justIN version: 01.05.00