justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 250256.2@dunegpschedd02.fnal.gov

Jobsub ID250256.2@dunegpschedd02.fnal.gov
Workflow ID10473
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-24 01:40:07
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-11-24 04:56:08
From worker nodeHostnamedunegli-7869725-0-fnpc22034.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-24 01:41:38
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T001919Z_gen_001758_supernova_g4stage1_g4stage2_detsim_reco_20250626T051644Z_reco2.root
JobscriptExit code0
Real time2h (10171s)
CPU time2h (10111s = 99%)
Max RSS bytes2551160832 (2432 MiB)
Outputting started2025-11-24 04:31:10
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/10473/1/001/fdhd_ana_2025-11-24T_014144Z_hist.root
Finished2025-11-24 04:56:08
Saved logsjustin-logs:250256.2-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

marley	1000180400	0.01	(-257.62, -2.68, 624.72)	133231	133170
marley	1000180400	0.01	(-315.98, 55.29, 827.29)	133230	133170
marley	1000180400	0.00	(-315.99, 55.63, 826.95)	133229	133170
marley	1000180400	0.01	(-312.11, 64.27, 829.03)	133228	133170
marley	1000180400	0.01	(-296.18, 14.82, 853.45)	133227	133170
marley	1000180400	0.01	(-320.40, -1.00, 853.45)	133226	133170
marley	1000180400	0.00	(-314.56, -19.79, 843.46)	133225	133170
marley	1000180400	0.02	(-310.27, -35.07, 833.88)	133224	133170
marley	1000180400	0.01	(-311.16, -32.99, 834.20)	133223	133170
marley	1000180400	0.02	(-309.48, -29.52, 845.81)	133222	133170
marley	1000180400	0.01	(-287.39, -55.72, 841.23)	133221	133170
marley	1000180400	0.00	(-286.92, -56.87, 839.08)	133220	133170
marley	1000180400	0.01	(-286.86, -56.97, 838.98)	133219	133170
marley	1000180400	0.01	(-280.16, -64.25, 847.16)	133218	133170
marley	1000180400	0.03	(-278.33, -69.42, 844.76)	133217	133170
marley	1000180400	0.02	(-315.21, -50.25, 893.21)	133216	133170
marley	1000180400	0.01	(-315.66, -50.03, 891.88)	133215	133170
marley	1000180400	0.02	(-296.13, -7.75, 866.54)	133214	133170
marley	1000180400	0.02	(-282.62, -20.91, 869.14)	133213	133170
marley	1000180400	0.01	(-284.21, -23.40, 868.27)	133212	133170
marley	1000180400	0.03	(-242.34, -90.05, 814.19)	133211	133170
marley	1000180400	0.00	(-251.57, -115.33, 870.74)	133210	133170
marley	1000180400	0.01	(-295.06, -140.23, 959.49)	133209	133170
marley	1000180400	0.04	(-299.90, -137.47, 960.27)	133208	133170
marley	1000180400	0.03	(-293.57, -148.75, 960.34)	133207	133170
marley	1000180400	0.02	(-323.57, -158.68, 959.16)	133206	133170
marley	1000180400	0.01	(-316.63, -256.86, 1007.51)	133205	133170
marley	1000180400	0.04	(-316.04, -275.68, 994.37)	133204	133170
marley	1000180400	0.02	(-296.85, -277.46, 1014.86)	133203	133170
marley	1000180400	0.00	(-277.11, -296.41, 1001.75)	133202	133170
marley	1000180400	0.06	(-234.41, -335.38, 982.25)	133201	133170
marley	1000180400	0.00	(-244.05, -316.57, 980.23)	133200	133170
marley	1000180400	0.01	(-299.48, -267.35, 1001.80)	133199	133170
marley	1000180400	0.04	(-314.66, -260.72, 993.85)	133198	133170
marley	1000180400	0.07	(-294.73, -225.33, 1005.12)	133197	133170
marley	1000180400	0.06	(-297.29, -233.12, 1005.89)	133196	133170
marley	1000180400	0.04	(-286.01, -232.16, 1001.05)	133195	133170
marley	1000180400	0.03	(-287.63, -228.15, 995.33)	133194	133170
marley	1000180400	0.05	(-315.44, -267.64, 940.84)	133193	133170
marley	22		2.82	(-319.18, -266.19, 942.39)	133171	0
marley	2112		0.94	(-319.18, -266.19, 942.39)	133170	0
marley	1000190390	0.04	(-319.18, -266.19, 942.39)	133169	0
marley	11		13.69	(-319.18, -266.19, 942.39)	133168	0
Signal Track IDs: 133168; 133169; 133170; 133171; 133193; 133194; 133195; 133196; 133197; 133198; 133199; 133200; 133201; 133202; 133203; 133204; 133205; 133206; 133207; 133208; 133209; 133210; 133211; 133212; 133213; 133214; 133215; 133216; 133217; 133218; 133219; 133220; 133221; 133222; 133223; 133224; 133225; 133226; 133227; 133228; 133229; 133230; 133231; 133232; 133233; 133234; 133235; 133236; 133237; 133238; 133239; 133240; 133241; 133242; 133243; 133244; 133245; 133246; 133247; 133248; 133294; 133295; 133296; 133297; 133298; 133299; 133300; 133301; 133302; 133310; 133311; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  24-Nov-2025 04:11:43 UTC run: 5028 subRun: 0 event: 17580

Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  24-Nov-2025 04:12:19 UTC run: 5028 subRun: 0 event: 17580
OpFlash PE 102.07 with purity 0.45 time -2.96 plane 2
 - Vertex (210.07, -743.30, 1343.78)
	*** 1st Sanity check: Ratio 0.55 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 1194.18 with purity 0.25 time 0.07 plane 0
 - Vertex (-327.50, -206.70, 933.94)
	*** 1st Sanity check: Ratio 0.35 <= 1.00
	*** 2nd Sanity check: #OpHits 29 >= 29
OpFlash PE 736.36 with purity 0.22 time 0.79 plane 2
 - Vertex (135.07, -743.30, 748.10)
	*** 1st Sanity check: Ratio 0.29 <= 1.00
	*** 2nd Sanity check: #OpHits 12 >= 12
OpFlash PE 43.50 with purity 0.52 time 4.83 plane 0
 - Vertex (-327.50, 166.58, 932.75)
	*** 1st Sanity check: Ratio 0.26 <= 1.00
	*** 2nd Sanity check: #OpHits 6 >= 6
OpFlash PE 11.64 with purity 0.11 time 1323.56 plane 0
 - Vertex (-327.50, 399.84, 385.31)
	*** 1st Sanity check: Ratio 0.66 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 4.22 with purity 1.00 time 1326.02 plane 4
 - Vertex (210.07, 220.00, -96.50)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 8.78 with purity 0.67 time 1326.84 plane 1
 - Vertex (135.07, 743.30, 152.42)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 28.74 with purity 0.16 time 1327.98 plane 0
 - Vertex (-327.50, -469.87, 409.97)
	*** 1st Sanity check: Ratio 0.31 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 54.65 with purity 0.04 time 1329.67 plane 0
 - Vertex (-327.50, 257.74, 875.41)
	*** 1st Sanity check: Ratio 0.41 <= 1.00
	*** 2nd Sanity check: #OpHits 6 >= 6

# of OpHits (ophit10ppm): 52936 for times between -4254.02 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 12310 for times between -4254.02 us and 295147919198126080.00 us.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  24-Nov-2025 04:12:21 UTC run: 5028 subRun: 0 event: 17580

# OpHits (ophit10ppm) in full geometry: 52936
# OpFlashes (solarflash) in full geometry: 12310
# Hits (gaushit) in each view: 6863, 6804, 6653, 0
# Cluster from the hits: 2851, 2862, 5623, 0
# Tracks (pmtracktc) in full geometry: 499
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  24-Nov-2025 04:31:10 UTC run: 5028 subRun: 0 event: 17580

# ClusterReco: Looping over 5610 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  24-Nov-2025 04:31:10 UTC run: 5028 subRun: 0 event: 17580
*** Matched preselection cluster: 5311 from 5610
 - MainTrackID 133168
 - Gen 1 -> marley TPC 50
 - Purity 1.00 Hits 8
 - Charge 1160.62 ( MaxHit 409.77 )
 - #AdjCl 5 ( 1 signal ):
    - Cluster 5119 at distance 61.59 with time 3866.84 and charge 31.51 in TPC 40 and hits 1
    - Cluster 5191 at distance 39.36 with time 3933.78 and charge 109.40 in TPC 50 and hits 2
    - Cluster 5280 at distance 89.61 with time 4000.75 and charge 47.07 in TPC 42 and hits 1
    - Cluster 5298 at distance 41.37 with time 4013.16 and charge 101.77 in TPC 52 and hits 3
    - Cluster 5392 at distance 59.27 with time 4087.03 and charge 40.24 in TPC 42 and hits 1
 - RecoCol  Time,Y,Z ( 4027.70, -266.65, 942.74 )
 - RecoInd0 Time,Y,Z ( 4027.70, -266.63, 971.48 )
 - RecoInd1 Time,Y,Z ( 4028.28, -266.67, 971.48 )
*** Matched flash: 6087 from 12310
 - Purity 25.50 % Plane 0 #Hits 29 PE 1194.18 MainOpHitPE 423.60
 - Time 0.07 (us) Fast 38.32 % Residual 62180.46
 - Reco Time,Y,Z ( 0.07, -206.70, 933.94 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -319.18, -266.19, 942.39 )
 - Main X,Y,Z ( -323.24, -267.58, 943.29 )
 - EDep X,Y,Z ( -323.36, -267.47, 943.03 )
 - Reco X,Y,Z ( -321.65, -266.65, 942.74 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  24-Nov-2025 04:31:10 UTC run: 5028 subRun: 0 event: 17580
-----------------------------------------------------------------------------------------

%MSG
24-Nov-2025 04:31:10 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/6e/f8/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250203T001919Z_gen_001758_supernova_g4stage1_g4stage2_detsim_reco_20250626T051644Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 24-Nov-2025 04:31:10 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.540189       1013.65       2323.11       1164.45       909.934        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000502581   0.00634006     0.0152638    0.00421584     0.0056185       10     
end_path:solarnuana:SolarNuAna     0.527587       1013.64       2323.11       1164.45       909.935        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 24-Nov-2025 04:31:10 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3169.45 MB
  Peak resident set size usage (VmHWM): 2551.16 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 10100.848198 Real = 10160.490317

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3169.45 VmHWM = 2551.16

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-09 00:34:14 UTC       justIN version: 01.06.00