justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 40577.1@dunegpschedd02.fnal.gov

Jobsub ID40577.1@dunegpschedd02.fnal.gov
Workflow ID2624
Stage ID1
User namesmanthey@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-09-16 19:16:14
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-09-16 19:24:57
From worker nodeHostnamedunegli-6878590-0-fnpc23028.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-16 19:16:47
Input filesfardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250210T073259Z_gen_003864_supernova_g4_halfActiveVol_detsim_reco_20250724T175604Z_reco2.root
JobscriptExit code0
Real time8m (482s)
CPU time7m (473s = 98%)
Max RSS bytes863154176 (823 MiB)
Outputting started2025-09-16 19:24:49
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dune10kt_1x2x6_lateralAPA/fnal/02624/1/001/fdhd_ana_2025-09-16T_191653Z_hist.root
Finished2025-09-16 19:24:57
Saved logsjustin-logs:40577.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

sterReco: Looping over 127 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:24:39 UTC run: 5102 subRun: 0 event: 193199
*** Matched preselection cluster: 1
 - MainTrackID 32830
 - Gen 1 -> marley TPC 7
 - Purity 1.00 Hits 1
 - Charge 165.12 ( MaxHit 165.12 )
 - #AdjCl 0 ( 0 signal ):
 - RecoCol  Time,Y,Z ( 36.05, 227.99, 409.74 )
 - RecoInd0 Time,Y,Z ( 36.04, 228.19, 354.72 )
 - RecoInd1 Time,Y,Z ( 36.40, 227.78, 347.71 )
*** Matched flash: 
 - Purity 0.99 Plane 1 #Hits 21 PE 238.03 MaxPE 136.90
 - Time 0.00 Fast 0.90 Residual 49.91
 - Reco Time,Y,Z ( 0.00, 217.95, 415.33 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 14.29, 228.17, 410.04 )
 - Main X,Y,Z ( 31.11, 232.15, 402.13 )
 - EDep X,Y,Z ( 8.77, 227.99, 409.58 )
 - Reco X,Y,Z ( 5.79, 227.99, 409.74 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:24:39 UTC run: 5102 subRun: 0 event: 193199
-----------------------------------------------------------------------------------------

%MSG
Begin processing the 50th record. run: 5102 subRun: 0 event: 193200 at 16-Sep-2025 19:24:39 UTC
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:24:40 UTC run: 5102 subRun: 0 event: 193200

#########################################
Event: 193200 Flag: 621873295
Geometry: dune10kt_v6_1x2x6 (HD)
Signal Label: marley
PDS Frequency in [MHz]: 62.50
PDS Tick in [us]: 0.016
TPC Frequency in [MHz]: 2.00
TPC Tick in [us]: 0.50
TPC Map: 25 TPCs found
TPC DriftLength in [cm]: 360.37
TPC DriftTime in [us]: 2244.44
Fiducial Volume in [cm]: 759.89, 1357.70, 1746.48
#########################################
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:24:40 UTC run: 5102 subRun: 0 event: 193200

There are a total of 33215 Particles in the event

# of particles 13	from gen 1 marley
# of particles 11154	from gen 2 Ar39GenInLAr
# of particles 1166	from gen 3 Kr85GenInLAr
# of particles 1	from gen 4 Ar42GenInLAr
# of particles 1	from gen 5 K42From42ArGenInLAr
# of particles 8	from gen 6 Rn222ChainRn222GenInLAr
# of particles 9	from gen 7 Rn222ChainPo218GenInLAr
# of particles 2	from gen 8 Rn222ChainPb214GenInLAr
# of particles 15	from gen 9 Rn222ChainBi214GenInLAr
# of particles 6	from gen 10 Rn222ChainPb210GenInLAr
# of particles 5	from gen 11 Rn220ChainPb212GenInLAr
# of particles 17	from gen 12 K40GenInCPA
# of particles 266	from gen 13 U238ChainGenInCPA
# of particles 294	from gen 14 Th232ChainGenInCPA
# of particles 0	from gen 15 K42From42ArGenInCPA
# of particles 2	from gen 16 Rn222ChainPo218GenInCPA
# of particles 10	from gen 17 Rn222ChainPb214GenInCPA
# of particles 24	from gen 18 Rn222ChainBi214GenInCPA
# of particles 37	from gen 19 Rn222ChainPb210GenInCPA
# of particles 31	from gen 20 Rn222ChainFromBi210GenInCPA
# of particles 50	from gen 21 Rn220ChainFromPb212GenInCPA
# of particles 0	from gen 22 Co60GenInAPA
# of particles 6	from gen 23 U238ChainGenInAPA
# of particles 3	from gen 24 Th232ChainGenInAPA
# of particles 52	from gen 25 U238Th232K40GenInLArAPAboards1x2x6
# of particles 0	from gen 26 Rn222ChainGenInPDS
# of particles 19242	from gen 27 CavernwallGammasAtLAr1x2x6
# of particles 801	from gen 28 foamGammasAtLAr1x2x6
# of particles 0	from gen 29 CavernwallNeutronsAtLAr1x2x6
# of particles 0	from gen 30 CryostatNGammasAtLAr1x2x6
# of particles 0	from gen 31 CavernNGammasAtLAr1x2x6
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:24:40 UTC run: 5102 subRun: 0 event: 193200

Number of Signal Particles: 8
Neutrino Interaction: -1
Neutrino Energy: 21.92 MeV
Position (85.18, 450.62, 1277.03) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	22		1.46	(85.18, 450.62, 1277.03)	33267	33203
marley	1000180400	0.00	(85.18, 450.62, 1277.03)	33266	33203
marley	12		0.04	(85.18, 450.62, 1277.03)	33265	33203
marley	11		0.00	(85.18, 450.62, 1277.03)	33263	33203
marley	11		0.00	(85.18, 450.62, 1277.03)	33262	33203
marley	11		0.00	(85.18, 450.62, 1277.03)	33261	33203
marley	11		0.00	(85.18, 450.62, 1277.03)	33260	33203
marley	22		0.03	(85.18, 450.62, 1277.03)	33207	0
marley	22		0.77	(85.18, 450.62, 1277.03)	33206	0
marley	22		1.30	(85.18, 450.62, 1277.03)	33205	0
marley	22		2.40	(85.18, 450.62, 1277.03)	33204	0
marley	1000190400	0.00	(85.18, 450.62, 1277.03)	33203	0
marley	11		15.90	(85.18, 450.62, 1277.03)	33202	0
Signal Track IDs: 33202; 33203; 33204; 33205; 33206; 33207; 33260; 33261; 33262; 33263; 33265; 33266; 33267; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:24:41 UTC run: 5102 subRun: 0 event: 193200
OpFlash PE 518.80 with purity 0.99 time 0.00 plane 1
 - Vertex (0.05, 457.20, 1299.05)
	*** 1st Sanity check: Ratio 0.13 <= 1.00
	*** 2nd Sanity check: #OpHits 48 >= 48
OpFlash PE 111.36 with purity 0.82 time 0.03 plane 1
 - Vertex (0.05, 484.32, 1095.66)
	*** 1st Sanity check: Ratio 0.17 <= 1.00
	*** 2nd Sanity check: #OpHits 26 >= 26
OpFlash PE 61.96 with purity 0.92 time 0.05 plane 1
 - Vertex (0.05, 464.20, 1259.49)
	*** 1st Sanity check: Ratio 0.17 <= 1.00
	*** 2nd Sanity check: #OpHits 17 >= 17
OpFlash PE 30.99 with purity 0.71 time 0.07 plane 1
 - Vertex (0.05, 370.59, 1151.10)
	*** 1st Sanity check: Ratio 0.18 <= 1.00
	*** 2nd Sanity check: #OpHits 12 >= 12
OpFlash PE 23.94 with purity 0.85 time 0.09 plane 1
 - Vertex (0.05, 529.30, 1013.48)
	*** 1st Sanity check: Ratio 0.55 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 5.42 with purity 0.68 time 0.11 plane 1
 - Vertex (0.05, 444.99, 1046.91)
	*** 1st Sanity check: Ratio 0.34 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 12.12 with purity 0.86 time 0.13 plane 1
 - Vertex (0.05, 467.03, 1076.28)
	*** 1st Sanity check: Ratio 0.68 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3

# of OpFlashes (solarflash) in full geometry: 1216

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:24:41 UTC run: 5102 subRun: 0 event: 193200

# OpHits (ophitspe) in full geometry: 42195
# OpFlashes (solarflash) in full geometry: 1216
# Hits (hitfd) in each view: 153, 137, 270, 0
# Cluster from the hits: 81, 75, 245, 0
# Tracks (pmtracktc) in full geometry: 4
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:24:49 UTC run: 5102 subRun: 0 event: 193200

# ClusterReco: Looping over 131 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:24:49 UTC run: 5102 subRun: 0 event: 193200
*** Matched preselection cluster: 22
 - MainTrackID 33202
 - Gen 1 -> marley TPC 23
 - Purity 1.00 Hits 4
 - Charge 2308.49 ( MaxHit 1337.45 )
 - #AdjCl 1 ( 1 signal ):
    - Cluster 18 at distance 19.28 with time 459.75 and charge 228.15 in TPC 23 and hits 2
 - RecoCol  Time,Y,Z ( 509.17, 454.28, 1277.02 )
 - RecoInd0 Time,Y,Z ( 509.17, 454.26, 1271.87 )
 - RecoInd1 Time,Y,Z ( 509.09, 454.29, 1282.27 )
*** Matched flash: 
 - Purity 0.99 Plane 1 #Hits 48 PE 518.80 MaxPE 65.50
 - Time 0.00 Fast 0.83 Residual 324.47
 - Reco Time,Y,Z ( 0.00, 457.20, 1299.05 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 85.18, 450.62, 1277.03 )
 - Main X,Y,Z ( 84.73, 456.61, 1277.97 )
 - EDep X,Y,Z ( 84.41, 454.33, 1276.89 )
 - Reco X,Y,Z ( 81.75, 454.28, 1277.02 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  16-Sep-2025 19:24:49 UTC run: 5102 subRun: 0 event: 193200
-----------------------------------------------------------------------------------------

%MSG
16-Sep-2025 19:24:49 UTC  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/11/b9/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250210T073259Z_gen_003864_supernova_g4_halfActiveVol_detsim_reco_20250724T175604Z_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          6.5631        8.99709       11.1045       9.05373      0.851184        50     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000974402   0.00168649     0.0156225    0.00140254    0.00200605       50     
end_path:solarnuana:SolarNuAna      6.56187       8.99526       11.1028       9.05213      0.850897        50     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 16-Sep-2025 19:24:49 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1493.85 MB
  Peak resident set size usage (VmHWM): 846.393 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 50 passed = 50 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         50         50          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 458.162967 Real = 464.755400

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1493.85 VmHWM = 846.393

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2025-09-19 11:33:41 UTC       justIN version: 01.05.00