justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 253018.12@dunegpschedd02.fnal.gov

Jobsub ID253018.12@dunegpschedd02.fnal.gov
Workflow ID10787
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-26 11:58:26
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-11-26 14:30:59
From worker nodeHostnamedunegli-7735039-0-fnpc18006.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-26 11:59:31
Input filesfardet-vd:fardet-vd_mc_le_mc_2024a_list-4319_input.list_out1_standard_reco1_dunevd10kt_1x8x14_3view_30deg_hit-reconstructed_merged_skip000175_lim000025_mergeLar_20241220T222235_20250610T121349Z_reco2.root
JobscriptExit code0
Real time2h (9057s)
CPU time2m (144s = 1%)
Max RSS bytes605454336 (577 MiB)
Outputting started2025-11-26 14:30:29
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_dunevd10kt_1x8x14_3view_30deg/fnal/10787/1/001/fdhd_ana_2025-11-26T_115945Z_hist.root
Finished2025-11-26 14:30:59
Saved logsjustin-logs:253018.12-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

.08	(222.04, 440.12, 92.78)	2	0
marley	11		52.83	(222.04, 440.12, 92.78)	1	0
Signal Track IDs: 1; 2; 3; 4; 5; 6; 93; 94; 95; 
%MSG
%MSG-w ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Nov-2025 12:02:06 UTC run: 4319 subRun: 0 event: 20399

Kinetic energy of signal particle is above threshold of 30.00 MeV. Skipping event.

%MSG
Begin processing the 2500th record. run: 4319 subRun: 0 event: 20400 at 26-Nov-2025 12:02:06 UTC
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Nov-2025 12:02:06 UTC run: 4319 subRun: 0 event: 20400

###################################################
Event:			20400
Flag:			2144702368
Geometry:		dunevd10kt_3view_30deg_v5_refactored_1x8x14ref (VD)
Signal Label:		marley
PDS Frequency in [MHz]:	62.50
PDS Tick in [us]:	0.016
TPC Frequency in [MHz]:	2.00
TPC Tick in [us]:	0.50
TPC Map:		112 TPCs
TPC DriftLength in [cm]:650.07
TPC DriftTime in [us]:	4048.69
Fiducial Volume in [cm]:850.32, 1507.84, 2306.12
###################################################
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Nov-2025 12:02:06 UTC run: 4319 subRun: 0 event: 20400

There are a total of 8 Particles in the event

# of particles 8	from gen 1 marley
# of particles 0	from gen 2 Ar39GenInLAr *not generated!
# of particles 0	from gen 3 Kr85GenInLAr *not generated!
# of particles 0	from gen 4 Ar42GenInLAr *not generated!
# of particles 0	from gen 5 K42From42ArGenInLAr *not generated!
# of particles 0	from gen 6 Rn222ChainRn222GenInLAr *not generated!
# of particles 0	from gen 7 Rn222ChainPo218GenInLAr *not generated!
# of particles 0	from gen 8 Rn222ChainPb214GenInLAr *not generated!
# of particles 0	from gen 9 Rn222ChainBi214GenInLAr *not generated!
# of particles 0	from gen 10 Rn222ChainPb210GenInLAr *not generated!
# of particles 0	from gen 11 Rn220ChainPb212GenInLAr *not generated!
# of particles 0	from gen 12 K40GenInCathode *not generated!
# of particles 0	from gen 13 U238ChainGenInCathode *not generated!
# of particles 0	from gen 14 Th232ChainGenInCathode *not generated!
# of particles 0	from gen 15 K40GenInAnode *not generated!
# of particles 0	from gen 16 U238ChainGenInAnode *not generated!
# of particles 0	from gen 17 Th232ChainGenInAnode *not generated!
# of particles 0	from gen 18 Rn222ChainGenInPDS *not generated!
# of particles 0	from gen 19 K42From42ArGenInUpperMesh1x8x14 *not generated!
# of particles 0	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14 *not generated!
# of particles 0	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14 *not generated!
# of particles 0	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14 *not generated!
# of particles 0	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14 *not generated!
# of particles 0	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14 *not generated!
# of particles 0	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14 *not generated!
# of particles 0	from gen 26 CavernwallGammasAtLAr1x8x14 *not generated!
# of particles 0	from gen 27 foamGammasAtLAr1x8x14 *not generated!
# of particles 0	from gen 28 CavernwallNeutronsAtLAr1x8x14 *not generated!
# of particles 0	from gen 29 CryostatNGammasAtLAr1x8x14 *not generated!
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14 *not generated!
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Nov-2025 12:02:06 UTC run: 4319 subRun: 0 event: 20400

Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 26.11 MeV
Position (222.95, 458.13, 1285.89) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.56	(222.95, 458.13, 1285.89)	54	2
marley	-12		0.75	(222.95, 458.13, 1285.89)	53	2
marley	1000200400	0.00	(222.95, 458.13, 1285.89)	52	2
marley	22		0.03	(222.95, 458.13, 1285.89)	5	0
marley	22		1.61	(222.95, 458.13, 1285.89)	4	0
marley	22		1.09	(222.95, 458.13, 1285.89)	3	0
marley	1000190400	0.03	(222.95, 458.13, 1285.89)	2	0
marley	11		21.84	(222.95, 458.13, 1285.89)	1	0
Signal Track IDs: 1; 2; 3; 4; 5; 52; 53; 54; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Nov-2025 12:02:06 UTC run: 4319 subRun: 0 event: 20400

Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Nov-2025 12:02:06 UTC run: 4319 subRun: 0 event: 20400
OpFlash PE 243.30 with purity 1.00 time 0.53 plane 1
 - Vertex (193.38, 743.30, 1291.45)
	*** 1st Sanity check: Ratio 0.13 <= 1.00
	*** 2nd Sanity check: #OpHits 16 >= 16
OpFlash PE 75.86 with purity 1.00 time 0.45 plane 0
 - Vertex (-327.50, 386.88, 1478.07)
	*** 1st Sanity check: Ratio 0.19 <= 1.00
	*** 2nd Sanity check: #OpHits 9 >= 9
OpFlash PE 52.66 with purity 1.00 time 0.80 plane 0
 - Vertex (-327.50, 419.26, 1150.52)
	*** 1st Sanity check: Ratio 0.26 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 11.41 with purity 1.00 time 2.17 plane 0
 - Vertex (-327.50, 142.81, 637.75)
	*** 1st Sanity check: Ratio 0.64 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 4.68 with purity 1.00 time 3.26 plane 0
 - Vertex (-327.50, -297.40, 1675.62)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1
OpFlash PE 7.51 with purity 1.00 time 3.72 plane 1
 - Vertex (210.07, 743.30, 1343.78)
	*** 1st Sanity check: Ratio 1.00 <= 1.00
	*** 2nd Sanity check: #OpHits 1 >= 1

# of OpHits (ophit10ppm): 43 for times between 0.02 us and 3.72 us.
# of OpFlashes (solarflash): 6 for times between 0.45 us and 3.72 us.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Nov-2025 12:02:06 UTC run: 4319 subRun: 0 event: 20400

# OpHits (ophit10ppm) in full geometry: 43
# OpFlashes (solarflash) in full geometry: 6
# Hits (gaushit) in each view: 21, 18, 12, 0
# Cluster from the hits: 4, 4, 4, 0
# Tracks (pmtracktc) in full geometry: 2
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Nov-2025 12:02:06 UTC run: 4319 subRun: 0 event: 20400

# ClusterReco: Looping over 4 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Nov-2025 12:02:06 UTC run: 4319 subRun: 0 event: 20400
*** Matched preselection cluster: 1 from 4
 - MainTrackID 1
 - Gen 1 -> marley TPC 70
 - Purity 1.00 Hits 9
 - Charge 2591.61 ( MaxHit 695.71 )
 - #AdjCl 3 ( 3 signal ):
    - Cluster 0 at distance 14.52 with time 609.06 and charge 63.75 in TPC 70 and hits 1
    - Cluster 2 at distance 59.38 with time 636.68 and charge 254.29 in TPC 70 and hits 1
    - Cluster 3 at distance 61.74 with time 746.31 and charge 54.17 in TPC 70 and hits 1
 - RecoCol  Time,Y,Z ( 627.42, 454.92, 1284.22 )
 - RecoInd0 Time,Y,Z ( 627.53, 454.93, 1271.91 )
 - RecoInd1 Time,Y,Z ( 627.38, 454.91, 1270.32 )
*** Matched flash: 0 from 6
 - Purity 100.00 % Plane 1 #Hits 16 PE 243.30 MainOpHitPE 31.75
 - Time 0.53 (us) Fast 38.19 % Residual 158.62
 - Reco Time,Y,Z ( 0.53, 743.30, 1291.45 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 222.95, 458.13, 1285.89 )
 - Main X,Y,Z ( 225.66, 452.57, 1282.96 )
 - EDep X,Y,Z ( 225.01, 452.78, 1282.92 )
 - Reco X,Y,Z ( 224.38, 454.92, 1284.22 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  26-Nov-2025 12:02:06 UTC run: 4319 subRun: 0 event: 20400
-----------------------------------------------------------------------------------------

%MSG
26-Nov-2025 12:02:06 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/d5/b1/fardet-vd_mc_le_mc_2024a_list-4319_input.list_out1_standard_reco1_dunevd10kt_1x8x14_3view_30deg_hit-reconstructed_merged_skip000175_lim000025_mergeLar_20241220T222235_20250610T121349Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 26-Nov-2025 12:02:06 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                        0.00506855     0.027889      0.244821      0.0155571     0.029987       2500    
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00027607    0.000884181   0.00948926    0.000888532   0.000610785     2500    
end_path:solarnuana:SolarNuAna    0.00391124     0.0268377     0.243499      0.0144907     0.0299821      2500    
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 26-Nov-2025 12:02:07 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1219.1 MB
  Peak resident set size usage (VmHWM): 601.244 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 2500 passed = 2500 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport       2500       2500          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 115.969716 Real = 123.137584

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1219.1 VmHWM = 601.244

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-08 07:16:18 UTC       justIN version: 01.06.00