justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 255137.0@dunegpschedd02.fnal.gov

Jobsub ID255137.0@dunegpschedd02.fnal.gov
Workflow ID10893
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-29 07:12:50
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-11-29 17:33:53
From worker nodeHostnamedunegli-7929865-0-fnpc18005.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-29 07:13:58
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T161718Z_gen_000627_supernova_g4stage1_g4stage2_detsim_reco_20250701T232852Z_reco2.root
JobscriptExit code0
Real time10h (37100s)
CPU time10h (36678s = 98%)
Max RSS bytes2565447680 (2446 MiB)
Outputting started2025-11-29 17:32:19
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/10893/1/001/fdhd_ana_2025-11-29T_071439Z_hist.root
Finished2025-11-29 17:33:53
Saved logsjustin-logs:255137.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

54.59)	133057	133037
marley	1000180400	0.03	(-52.52, -281.80, 1359.59)	133056	133037
marley	1000180400	0.01	(-55.15, -268.17, 1355.12)	133055	133037
marley	1000180400	0.05	(-76.55, -231.65, 1310.64)	133054	133037
marley	1000180400	0.06	(-76.58, -231.63, 1310.75)	133053	133037
marley	1000180400	0.00	(-42.71, -266.35, 1284.47)	133052	133037
marley	1000180400	0.00	(-18.35, -292.14, 1279.28)	133051	133037
marley	1000180400	0.02	(-7.52, -304.74, 1273.94)	133050	133037
marley	1000180400	0.08	(-37.65, -363.49, 1236.98)	133049	133037
marley	1000180400	0.03	(-36.82, -362.73, 1237.08)	133048	133037
marley	1000180400	0.08	(-50.03, -335.84, 1226.29)	133047	133037
marley	1000180400	0.09	(-50.53, -341.21, 1225.70)	133046	133037
marley	22		1.46	(-48.18, -338.81, 1226.19)	133039	132980
marley	1000180400	0.12	(-48.18, -338.81, 1226.19)	133038	132980
marley	2112		1.06	(-48.18, -338.81, 1226.19)	133037	132980
marley	1000180400	0.18	(-52.14, -337.26, 1222.27)	133036	132980
marley	22		3.60	(-33.36, -349.60, 1208.84)	132982	0
marley	22		1.95	(-33.36, -349.60, 1208.84)	132981	0
marley	2112		2.82	(-33.36, -349.60, 1208.84)	132980	0
marley	1000190390	0.08	(-33.36, -349.60, 1208.84)	132979	0
marley	11		10.96	(-33.36, -349.60, 1208.84)	132978	0
Signal Track IDs: 132978; 132979; 132980; 132981; 132982; 133036; 133037; 133038; 133039; 133046; 133047; 133048; 133049; 133050; 133051; 133052; 133053; 133054; 133055; 133056; 133057; 133058; 133059; 133060; 133061; 133062; 133063; 133064; 133065; 133066; 133067; 133068; 133069; 133070; 133071; 133072; 133073; 133074; 133075; 133076; 133077; 133078; 133079; 133080; 133081; 133082; 133083; 133084; 133085; 133086; 133087; 133088; 133089; 133090; 133091; 133092; 133093; 133094; 133095; 133096; 133097; 133098; 133099; 133100; 133101; 133102; 133103; 133104; 133105; 133106; 133107; 133108; 133109; 133110; 133111; 133112; 133113; 133114; 133115; 133116; 133131; 133132; 133134; 133135; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  29-Nov-2025 16:10:56 UTC run: 5025 subRun: 0 event: 6270

Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  29-Nov-2025 16:12:23 UTC run: 5025 subRun: 0 event: 6270
OpFlash PE 298.65 with purity 0.01 time -1.94 plane 0
 - Vertex (-327.50, -42.00, 111.42)
	*** 1st Sanity check: Ratio 0.54 <= 1.00
	*** 2nd Sanity check: #OpHits 8 >= 8
OpFlash PE 633.97 with purity 0.40 time 0.57 plane 0
 - Vertex (-327.50, -285.76, 1297.01)
	*** 1st Sanity check: Ratio 0.07 <= 1.00
	*** 2nd Sanity check: #OpHits 43 >= 43
OpFlash PE 629.31 with purity 0.19 time 1.79 plane 1
 - Vertex (215.50, 743.30, 450.26)
	*** 1st Sanity check: Ratio 0.18 <= 1.00
	*** 2nd Sanity check: #OpHits 8 >= 8
OpFlash PE 160.28 with purity 0.57 time 2.00 plane 2
 - Vertex (147.95, -743.30, 784.79)
	*** 1st Sanity check: Ratio 0.30 <= 1.00
	*** 2nd Sanity check: #OpHits 9 >= 9
OpFlash PE 8.88 with purity 0.37 time 1.68 plane 0
 - Vertex (-327.50, 425.29, 1542.01)
	*** 1st Sanity check: Ratio 0.54 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 23.43 with purity 0.23 time 2.18 plane 3
 - Vertex (155.52, 220.00, 2188.38)
	*** 1st Sanity check: Ratio 0.61 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 26.17 with purity 0.58 time 5.82 plane 2
 - Vertex (116.48, -743.30, 1261.43)
	*** 1st Sanity check: Ratio 0.49 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3

# of OpHits (ophit10ppm): 53417 for times between -4254.41 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 12311 for times between -4254.41 us and 295147919198126080.00 us.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  29-Nov-2025 16:12:26 UTC run: 5025 subRun: 0 event: 6270

# OpHits (ophit10ppm) in full geometry: 53417
# OpFlashes (solarflash) in full geometry: 12311
# Hits (gaushit) in each view: 6694, 6596, 6661, 0
# Cluster from the hits: 2787, 2810, 5682, 0
# Tracks (pmtracktc) in full geometry: 434
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  29-Nov-2025 17:32:13 UTC run: 5025 subRun: 0 event: 6270

# ClusterReco: Looping over 5678 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  29-Nov-2025 17:32:14 UTC run: 5025 subRun: 0 event: 6270
*** Matched preselection cluster: 2687 from 5678
 - MainTrackID 132982
 - Gen 1 -> marley TPC 58
 - Purity 1.00 Hits 2
 - Charge 59.61 ( MaxHit 40.23 )
 - #AdjCl 5 ( 0 signal ):
    - Cluster 2115 at distance 95.80 with time 1598.02 and charge 32.45 in TPC 60 and hits 1
    - Cluster 2224 at distance 65.10 with time 1693.45 and charge 38.28 in TPC 56 and hits 1
    - Cluster 2517 at distance 57.48 with time 1951.88 and charge 22.27 in TPC 62 and hits 1
    - Cluster 2862 at distance 78.07 with time 2198.54 and charge 35.79 in TPC 58 and hits 1
    - Cluster 3497 at distance 99.36 with time 2672.73 and charge 37.38 in TPC 58 and hits 2
 - RecoCol  Time,Y,Z ( 2071.47, -51.12, 1173.53 )
 - RecoInd0 Time,Y,Z ( 2071.80, -272.70, 944.83 )
 - RecoInd1 Time,Y,Z ( 2071.70, 170.47, 373.80 )
*** Matched flash: 6190 from 12311
 - Purity 0.00 % Plane 0 #Hits 6 PE 80.72 MainOpHitPE 38.82
 - Time 20.47 (us) Fast 49.33 % Residual 59.22
 - Reco Time,Y,Z ( 20.47, -132.70, 1150.94 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -33.36, -349.60, 1208.84 )
 - Main X,Y,Z ( -3.46, -292.22, 1158.72 )
 - EDep X,Y,Z ( -18.97, -337.92, 1206.13 )
 - Reco X,Y,Z ( -4.28, -51.12, 1173.53 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  29-Nov-2025 17:32:14 UTC run: 5025 subRun: 0 event: 6270
*** Matched preselection cluster: 2918 from 5678
 - MainTrackID 132978
 - Gen 1 -> marley TPC 65
 - Purity 1.00 Hits 6
 - Charge 699.05 ( MaxHit 158.35 )
 - #AdjCl 9 ( 2 signal ):
    - Cluster 2379 at distance 77.72 with time 1846.43 and charge 33.04 in TPC 65 and hits 1
    - Cluster 2536 at distance 77.47 with time 1958.73 and charge 25.30 in TPC 71 and hits 1
    - Cluster 2658 at distance 32.25 with time 2055.78 and charge 55.08 in TPC 65 and hits 2
    - Cluster 2869 at distance 90.45 with time 2203.16 and charge 52.89 in TPC 59 and hits 1
    - Cluster 3086 at distance 31.04 with time 2368.46 and charge 34.50 in TPC 65 and hits 1
    - Cluster 3272 at distance 76.14 with time 2512.27 and charge 164.97 in TPC 67 and hits 1
    - Cluster 3346 at distance 77.20 with time 2561.08 and charge 49.72 in TPC 65 and hits 1
    - Cluster 3405 at distance 91.23 with time 2603.38 and charge 382.67 in TPC 65 and hits 2
    - Cluster 3494 at distance 86.20 with time 2671.29 and charge 25.14 in TPC 59 and hits 1
 - RecoCol  Time,Y,Z ( 2238.24, -349.63, 1210.11 )
 - RecoInd0 Time,Y,Z ( 2238.53, -349.64, 1270.32 )
 - RecoInd1 Time,Y,Z ( 2238.35, -349.62, 1214.06 )
*** Matched flash: 5637 from 12311
 - Purity 0.00 % Plane 0 #Hits 6 PE 366.41 MainOpHitPE 140.47
 - Time -359.38 (us) Fast 96.63 % Residual 1513.60
 - Reco Time,Y,Z ( -359.38, -377.40, 1302.78 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -33.36, -349.60, 1208.84 )
 - Main X,Y,Z ( -35.06, -349.57, 1211.03 )
 - EDep X,Y,Z ( -93.11, -350.47, 1280.02 )
 - Reco X,Y,Z ( -92.05, -349.63, 1210.11 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  29-Nov-2025 17:32:14 UTC run: 5025 subRun: 0 event: 6270
-----------------------------------------------------------------------------------------

%MSG
29-Nov-2025 17:32:15 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/f4/cd/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T161718Z_gen_000627_supernova_g4stage1_g4stage2_detsim_reco_20250701T232852Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 29-Nov-2025 17:32:15 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          1.34391       3697.63       6130.43       4781.28       2461.93        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00152303    0.00935242     0.0223162    0.00757281    0.00735237       10     
end_path:solarnuana:SolarNuAna      1.34134       3697.62       6130.41       4781.27       2461.93        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 29-Nov-2025 17:32:15 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3175.13 MB
  Peak resident set size usage (VmHWM): 2565.45 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 36640.887511 Real = 37026.956178

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3175.13 VmHWM = 2565.45

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-08 02:45:15 UTC       justIN version: 01.06.00