justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 19437.0@dunegpschedd01.fnal.gov

Jobsub ID19437.0@dunegpschedd01.fnal.gov
Workflow ID159
Stage ID1
User namesmanthey@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-07-30 15:37:45
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2025-07-30 20:44:49
From worker nodeHostnamewn2209241.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7513 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-07-30 15:39:12
Input filesusertests:fdvd_lowBg_reco2_2025-05-12T_044201Z.root
JobscriptExit code0
Real time5h (18312s)
CPU time4h (17900s = 97%)
Max RSS bytes1378816000 (1314 MiB)
Outputting started2025-07-30 20:44:25
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_optimistic/fnal/00159/1/001/fdhd_ana_2025-07-30T_153922Z_hist.root
Finished2025-07-30 20:44:49
Saved logsjustin-logs:19437.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

76782
marley	1000180360	33494.37 (-406.72, 248.16, 1128.23)	76782
marley	1000180400	37215.54 (-401.95, 252.45, 1126.90)	76782
marley	1000180360	33494.37 (-406.33, 255.90, 1118.21)	76782
marley	1000180360	33494.37 (-403.31, 256.24, 1118.36)	76782
marley	1000180360	33494.37 (-400.87, 249.75, 1104.02)	76782
marley	1000180360	33494.37 (-401.60, 252.87, 1104.92)	76782
marley	1000180360	33494.37 (-396.24, 251.63, 1104.87)	76782
marley	1000180360	33494.37 (-394.48, 252.43, 1112.17)	76782
marley	1000180360	33494.37 (-396.19, 255.79, 1112.47)	76782
marley	1000180360	33494.37 (-392.44, 251.89, 1112.87)	76782
marley	1000180360	33494.37 (-389.91, 255.07, 1110.23)	76782
marley	1000180360	33494.37 (-357.53, 246.36, 1111.19)	76782
marley	1000180360	33494.37 (-357.15, 245.98, 1112.42)	76782
marley	1000180360	33494.37 (-355.93, 247.20, 1122.14)	76782
marley	1000180360	33494.37 (-360.63, 252.65, 1122.32)	76782
marley	1000180360	33494.37 (-335.06, 274.05, 1089.60)	76782
marley	1000180360	33494.37 (-338.67, 265.15, 1099.12)	76782
marley	1000180400	37215.54 (-326.95, 274.50, 1089.29)	76782
marley	1000180360	33494.37 (-339.33, 256.95, 1096.71)	76782
marley	1000140280	26053.19 (-329.79, 249.27, 1090.79)	76782
marley	1000180400	37215.54 (-327.67, 261.92, 1069.65)	76782
marley	1000180400	37215.54 (-327.67, 262.01, 1069.66)	76782
marley	1000180400	37215.54 (-327.04, 263.18, 1071.48)	76782
marley	1000180400	37215.54 (-322.38, 248.01, 1098.06)	76782
marley	1000180360	33494.37 (-326.89, 193.17, 1130.43)	76782
marley	2212		938.30	 (-328.08, 194.58, 1129.84)	76782
marley	1000060120	11174.88 (-328.30, 194.91, 1130.31)	76782
marley	22		1.46	 (-259.61, 214.25, 1117.23)	76746
marley	1000180400	37215.57 (-282.29, 171.56, 1106.37)	76746
marley	2112		939.61	 (-325.39, 329.90, 1017.25)	76746
marley	1000180400	37215.61 (-280.89, 172.35, 1103.53)	76746
marley	1000180400	37215.67 (-279.01, 168.62, 1102.83)	76746
marley	1000180400	37215.56 (-283.04, 169.61, 1102.16)	76746
marley	1000180400	37215.65 (-287.62, 171.09, 1104.63)	76746
marley	1000180400	37215.72 (-285.01, 176.37, 1102.77)	76746
marley	1000180400	37215.54 (-283.80, 168.92, 1103.56)	76746
marley	22		4.51	 (-184.56, 175.29, 1096.16)	0
marley	2112		941.63	 (-282.29, 171.56, 1106.37)	0
marley	1000190390	36284.87 (-279.73, 155.46, 1102.21)	0
marley	11		11.82	 (-281.34, 153.71, 1106.05)	0
Signal Track IDs: 76744; 76745; 76746; 76747; 76776; 76777; 76778; 76779; 76780; 76781; 76782; 76783; 76784; 76805; 76806; 76807; 76808; 76809; 76810; 76811; 76812; 76813; 76814; 76815; 76816; 76817; 76818; 76819; 76820; 76821; 76822; 76823; 76824; 76825; 76826; 76827; 76828; 76829; 76830; 76831; 76833; 76834; 76835; 76836; 76838; 76839; 76840; 76841; 76842; 76843; 76844; 76845; 76846; 76847; 76848; 76849; 76865; 76877; 76878; 76879; 76880; 76882; 76883; 76884; 76885; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  30-Jul-2025 21:24:36 BST run: 20000047 subRun: 0 event: 10
OpFlash PE 988.13 with purity 0.11 time 0.88 plane 0
 - Vertex (-327.50, 179.77, 1141.05)
	*** 1st Sanity check: Ratio 0.30 <= 1.00
	*** 2nd Sanity check: #OpHits 13 >= 13
OpFlash PE 30.38 with purity 0.39 time 1.01 plane 0
 - Vertex (-327.50, 360.82, 1282.72)
	*** 1st Sanity check: Ratio 0.43 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 34.73 with purity 0.11 time 0.88 plane 0
 - Vertex (-327.50, 420.95, 876.59)
	*** 1st Sanity check: Ratio 0.63 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 139.93 with purity 0.43 time 1.06 plane 0
 - Vertex (-327.50, 62.51, 1040.49)
	*** 1st Sanity check: Ratio 0.55 <= 1.00
	*** 2nd Sanity check: #OpHits 6 >= 6
OpFlash PE 95.36 with purity 0.00 time 1.08 plane 0
 - Vertex (-327.50, 128.70, 1231.78)
	*** 1st Sanity check: Ratio 0.82 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 38.55 with purity 0.12 time 1.99 plane 0
 - Vertex (-327.50, 128.70, 933.94)
	*** 1st Sanity check: Ratio 0.74 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 33.08 with purity 0.00 time 2.59 plane 0
 - Vertex (-327.50, 300.36, 502.85)
	*** 1st Sanity check: Ratio 0.31 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 26.41 with purity 0.00 time 2.81 plane 3
 - Vertex (60.07, -220.00, 2188.38)
	*** 1st Sanity check: Ratio 0.52 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  30-Jul-2025 21:24:37 BST run: 20000047 subRun: 0 event: 10

# OpHits (ophit10ppm) in full geometry: 24973
# OpFlashes (solarflash) in full geometry: 1489
# Hits (gaushit) in each view: 3340, 3245, 4193, 0
# Cluster from the hits: 1495, 1500, 3588, 0
# Tracks (pmtracktc) in full geometry: 202
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  30-Jul-2025 21:44:24 BST run: 20000047 subRun: 0 event: 10

# ClusterReco: Looping over 3559 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  30-Jul-2025 21:44:24 BST run: 20000047 subRun: 0 event: 10
*** Matched preselection cluster: 3185
 - MainTrackID 76744
 - Gen 1 -> marley TPC 60
 - Purity 1.00 Hits 9
 - #AdjCl 6 ( 2 signal ):
    - Cluster 2776 at distance 88.74 with time 3271.20 and charge 385.97 in TPC 61 and hits 3
    - Cluster 2972 at distance 92.17 with time 3514.43 and charge 44.85 in TPC 56 and hits 2
    - Cluster 3099 at distance 69.98 with time 3664.94 and charge 89.89 in TPC 61 and hits 2
    - Cluster 3154 at distance 93.11 with time 3734.03 and charge 43.12 in TPC 59 and hits 1
    - Cluster 3249 at distance 55.41 with time 3854.13 and charge 27.34 in TPC 63 and hits 1
    - Cluster 3287 at distance 94.95 with time 3889.18 and charge 31.65 in TPC 51 and hits 1
 - RecoCol  Time,Y,Z ( 3771.41, 154.69, 1104.45 )
 - RecoInd0 Time,Y,Z ( 3771.24, 154.70, 1137.90 )
 - RecoInd1 Time,Y,Z ( 3771.37, 154.68, 1086.97 )
*** Matched flash: 
 - Purity 0.11 Plane 0 #Hits 13 PE 988.13 MaxPE 292.91
 - Time 0.44 Fast 0.82 Residual 27456.36
 - Reco Time,Y,Z ( 0.44, 179.77, 1141.05 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -279.73, 155.46, 1102.21 )
 - Reco X,Y,Z ( -280.44, 154.69, 1104.45 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  30-Jul-2025 21:44:24 BST run: 20000047 subRun: 0 event: 10
*** Matched preselection cluster: 3448
 - MainTrackID 76877
 - Gen 1 -> marley TPC 53
 - Purity 1.00 Hits 4
 - #AdjCl 9 ( 1 signal ):
    - Cluster 3279 at distance 76.64 with time 3881.33 and charge 31.41 in TPC 53 and hits 1
    - Cluster 3287 at distance 70.43 with time 3889.18 and charge 31.65 in TPC 51 and hits 1
    - Cluster 3291 at distance 52.42 with time 3894.47 and charge 41.81 in TPC 52 and hits 2
    - Cluster 3317 at distance 52.66 with time 3912.19 and charge 43.79 in TPC 53 and hits 1
    - Cluster 3369 at distance 96.80 with time 4010.04 and charge 57.62 in TPC 52 and hits 2
    - Cluster 3388 at distance 85.70 with time 4038.81 and charge 53.45 in TPC 52 and hits 1
    - Cluster 3432 at distance 64.78 with time 4080.45 and charge 33.68 in TPC 48 and hits 1
    - Cluster 3455 at distance 24.70 with time 4109.57 and charge 99.14 in TPC 53 and hits 2
    - Cluster 3508 at distance 21.34 with time 4178.99 and charge 38.96 in TPC 51 and hits 1
 - RecoCol  Time,Y,Z ( 4099.55, 187.27, 1014.30 )
 - RecoInd0 Time,Y,Z ( 4098.43, 325.96, 1021.45 )
 - RecoInd1 Time,Y,Z ( 4098.01, 48.59, 522.72 )
*** Matched flash: 
 - Purity 0.00 Plane 0 #Hits 8 PE 714.93 MaxPE 338.71
 - Time 604.19 Fast 0.98 Residual 51641.04
 - Reco Time,Y,Z ( 604.19, 202.70, 853.10 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -279.73, 155.46, 1102.21 )
 - Reco X,Y,Z ( -236.19, 187.27, 1014.30 )
%MSG
30-Jul-2025 21:44:24 BST  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/usertests/da/dd/fdvd_lowBg_reco2_2025-05-12T_044201Z.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          1192.91       1823.17       2547.4        1752.78       427.091        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00204541     0.155094       0.85345      0.0391771     0.252564        10     
end_path:solarnuana:SolarNuAna      1192.91       1823.01       2547.4        1752.63       427.176        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 30-Jul-2025 21:44:24 BST  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2012.82 MB
  Peak resident set size usage (VmHWM): 1378.82 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 17877.792542 Real = 18285.987569

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 2012.82 VmHWM = 1378.82

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Output file: fdhd_ana_2025-07-30T_153922Z.root
Output hist file: fdhd_ana_2025-07-30T_153922Z_hist.root
lar exit code 0
justIN time: 2025-08-10 06:36:38 UTC       justIN version: 01.04.00