justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 250036.0@dunegpschedd02.fnal.gov

Jobsub ID250036.0@dunegpschedd02.fnal.gov
Workflow ID10532
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-23 13:52:55
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-11-23 14:06:15
From worker nodeHostnamedunegli-7863035-0-fnpc9033.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-23 13:53:43
Input filesfardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250206T115539Z_gen_002191_supernova_g4_detsim_reco_20250724T052023Z_reco2.root
JobscriptExit code0
Real time12m (740s)
CPU time12m (732s = 98%)
Max RSS bytes921804800 (879 MiB)
Outputting started2025-11-23 14:06:03
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dune10kt_1x2x6_centralAPA/fnal/10532/1/001/fdhd_ana_2025-11-23T_135350Z_hist.root
Finished2025-11-23 14:06:15
Saved logsjustin-logs:250036.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

5:40 UTC run: 5082 subRun: 0 event: 109549
Invalid OpWaveform handle
%MSG
%MSG-e ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 14:05:40 UTC run: 5082 subRun: 0 event: 109549
Invalid OpWaveform handle
%MSG
%MSG-e ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 14:05:40 UTC run: 5082 subRun: 0 event: 109549
Invalid OpWaveform handle
%MSG
%MSG-e ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 14:05:40 UTC run: 5082 subRun: 0 event: 109549
Invalid OpWaveform handle
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 14:05:40 UTC run: 5082 subRun: 0 event: 109549
OpFlash PE 24.88 with purity 0.26 time -27.43 plane 0
 - Vertex (0.05, 591.57, 548.70)
	*** 1st Sanity check: Ratio 0.92 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 19.16 with purity 0.11 time -23.63 plane 0
 - Vertex (0.05, 342.49, 843.89)
	*** 1st Sanity check: Ratio 0.89 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 80.61 with purity 0.56 time -22.04 plane 0
 - Vertex (0.05, 529.30, 892.69)
	*** 1st Sanity check: Ratio 0.93 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 48.86 with purity 0.83 time -17.91 plane 0
 - Vertex (0.05, 487.56, 819.78)
	*** 1st Sanity check: Ratio 0.14 <= 1.00
	*** 2nd Sanity check: #OpHits 15 >= 15
OpFlash PE 5.44 with purity 0.48 time -16.97 plane 0
 - Vertex (-0.02, -54.60, 1194.98)
	*** 1st Sanity check: Ratio 0.35 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3
OpFlash PE 18.25 with purity 0.94 time -16.61 plane 0
 - Vertex (0.05, 407.21, 783.18)
	*** 1st Sanity check: Ratio 0.18 <= 1.00
	*** 2nd Sanity check: #OpHits 9 >= 9
OpFlash PE 10.81 with purity 0.81 time -15.81 plane 0
 - Vertex (0.05, 342.76, 927.69)
	*** 1st Sanity check: Ratio 0.19 <= 1.00
	*** 2nd Sanity check: #OpHits 6 >= 6
OpFlash PE 7.11 with purity 0.22 time -15.22 plane 0
 - Vertex (-0.05, -107.51, 340.28)
	*** 1st Sanity check: Ratio 0.28 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 17.88 with purity 0.61 time -14.58 plane 0
 - Vertex (0.05, 529.30, 892.69)
	*** 1st Sanity check: Ratio 0.63 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 7.15 with purity 0.38 time -12.87 plane 0
 - Vertex (0.03, 252.96, 951.29)
	*** 1st Sanity check: Ratio 0.43 <= 1.00
	*** 2nd Sanity check: #OpHits 3 >= 3

# of OpHits (ophitspe): 71530 for times between -2262.42 us and 2226.82 us.
# of OpFlashes (solarflash): 5072 for times between -2262.39 us and 2226.58 us.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 14:05:40 UTC run: 5082 subRun: 0 event: 109549

# OpHits (ophitspe) in full geometry: 71530
# OpFlashes (solarflash) in full geometry: 5072
# Hits (hitfd) in each view: 182, 181, 491, 0
# Cluster from the hits: 117, 118, 453, 0
# Tracks (pmtracktc) in full geometry: 3
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 14:06:01 UTC run: 5082 subRun: 0 event: 109549

# ClusterReco: Looping over 287 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 14:06:01 UTC run: 5082 subRun: 0 event: 109549
*** Matched preselection cluster: 201 from 287
 - MainTrackID 32861
 - Gen 1 -> marley TPC 15
 - Purity 1.00 Hits 3
 - Charge 803.22 ( MaxHit 433.31 )
 - #AdjCl 1 ( 1 signal ):
    - Cluster 208 at distance 23.79 with time 1864.85 and charge 136.06 in TPC 15 and hits 2
 - RecoCol  Time,Y,Z ( 1767.66, 491.48, 836.83 )
 - RecoInd0 Time,Y,Z ( 1767.46, 491.36, 806.05 )
 - RecoInd1 Time,Y,Z ( 1767.31, 491.60, 843.19 )
*** Matched flash: 2499 from 5072
 - Purity 83.37 % Plane 0 #Hits 15 PE 48.86 MainOpHitPE 6.90
 - Time -17.91 (us) Fast 16.17 % Residual 4.24
 - Reco Time,Y,Z ( -17.91, 487.56, 819.78 )
 - Found valid waveform: false
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 287.67, 491.91, 835.98 )
 - Main X,Y,Z ( 286.53, 490.95, 837.12 )
 - EDep X,Y,Z ( 286.57, 491.06, 837.10 )
 - Reco X,Y,Z ( 286.70, 491.48, 836.83 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 14:06:01 UTC run: 5082 subRun: 0 event: 109549
-----------------------------------------------------------------------------------------

%MSG
Begin processing the 50th record. run: 5082 subRun: 0 event: 109550 at 23-Nov-2025 14:06:01 UTC
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 14:06:01 UTC run: 5082 subRun: 0 event: 109550

###################################################
Event:			109550
Flag:			1171644941
Geometry:		dune10kt_v6_1x2x6 (HD)
Signal Label:		marley
PDS Frequency in [MHz]:	62.50
PDS Tick in [us]:	0.016
TPC Frequency in [MHz]:	2.00
TPC Tick in [us]:	0.50
TPC Map:		24 TPCs
TPC DriftLength in [cm]:360.37
TPC DriftTime in [us]:	2244.44
Fiducial Volume in [cm]:759.89, 1357.70, 1746.48
###################################################
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 14:06:02 UTC run: 5082 subRun: 0 event: 109550

There are a total of 32790 Particles in the event

# of particles 3	from gen 1 marley
# of particles 10921	from gen 2 Ar39GenInLAr
# of particles 1154	from gen 3 Kr85GenInLAr
# of particles 1	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 13	from gen 6 Rn222ChainRn222GenInLAr
# of particles 7	from gen 7 Rn222ChainPo218GenInLAr
# of particles 12	from gen 8 Rn222ChainPb214GenInLAr
# of particles 12	from gen 9 Rn222ChainBi214GenInLAr
# of particles 9	from gen 10 Rn222ChainPb210GenInLAr
# of particles 11	from gen 11 Rn220ChainPb212GenInLAr
# of particles 27	from gen 12 K40GenInCPA
# of particles 234	from gen 13 U238ChainGenInCPA
# of particles 251	from gen 14 Th232ChainGenInCPA
# of particles 3	from gen 15 K42From42ArGenInCPA
# of particles 2	from gen 16 Rn222ChainPo218GenInCPA
# of particles 9	from gen 17 Rn222ChainPb214GenInCPA
# of particles 68	from gen 18 Rn222ChainBi214GenInCPA
# of particles 25	from gen 19 Rn222ChainPb210GenInCPA
# of particles 35	from gen 20 Rn222ChainFromBi210GenInCPA
# of particles 28	from gen 21 Rn220ChainFromPb212GenInCPA
# of particles 0	from gen 22 Co60GenInAPA
# of particles 0	from gen 23 U238ChainGenInAPA
# of particles 0	from gen 24 Th232ChainGenInAPA
# of particles 42	from gen 25 U238Th232K40GenInLArAPAboards1x2x6
# of particles 0	from gen 26 Rn222ChainGenInPDS
# of particles 19159	from gen 27 CavernwallGammasAtLAr1x2x6lowBgAPA
# of particles 764	from gen 28 foamGammasAtLAr1x2x6lowBgAPA
# of particles 0	from gen 29 CavernwallNeutronsAtLAr1x2x6lowBgAPA
# of particles 0	from gen 30 CryostatNGammasAtLAr1x2x6lowBgAPA
# of particles 0	from gen 31 CavernNGammasAtLAr1x2x6lowBgAPA
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 14:06:02 UTC run: 5082 subRun: 0 event: 109550

Number of Signal Particles: 5
Neutrino Interaction: -1
Neutrino Energy: 69.19 MeV
Position (-100.86, -359.33, 163.86) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	1000010020	2.38	(-100.86, -359.33, 163.86)	32790	0
marley	1000180380	0.27	(-100.86, -359.33, 163.86)	32789	0
marley	11		53.07	(-100.86, -359.33, 163.86)	32788	0
Signal Track IDs: 32788; 32789; 32790; 
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  23-Nov-2025 14:06:02 UTC run: 5082 subRun: 0 event: 109550

Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.

%MSG
23-Nov-2025 14:06:02 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/7d/cf/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250206T115539Z_gen_002191_supernova_g4_detsim_reco_20250724T052023Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 23-Nov-2025 14:06:02 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.270326       13.514        32.0504      0.919706       13.7139        50     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00130931    0.00223256     0.0229118    0.00185191    0.00296551       50     
end_path:solarnuana:SolarNuAna     0.268514       13.5116       32.0484      0.918126       13.7143        50     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 23-Nov-2025 14:06:02 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1553.36 MB
  Peak resident set size usage (VmHWM): 908.472 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 50 passed = 50 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         50         50          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 703.673616 Real = 707.600563

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1553.36 VmHWM = 908.472

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-08 21:29:33 UTC       justIN version: 01.06.00