justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 278122.1@dunegpschedd01.fnal.gov

Jobsub ID278122.1@dunegpschedd01.fnal.gov
Workflow ID11803
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-14 19:22:54
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2026-01-15 03:17:46
From worker nodeHostnamedunegli-8318365-0-fnpc9008.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-14 22:45:15
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T084148Z_gen_002095_supernova_g4stage1_g4stage2_detsim_reco_20250730T142129Z_reco2.root
JobscriptExit code0
Real time4h (16341s)
CPU time4h (16200s = 99%)
Max RSS bytes2559664128 (2441 MiB)
Outputting started2026-01-15 03:17:37
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/11803/1/001/fdhd_ana_2026-01-14T_224526Z_hist.root
Finished2026-01-15 03:17:46
Saved logsjustin-logs:278122.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

subRun: 0 event: 20950 at 15-Jan-2026 02:33:40 UTC
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 02:33:43 UTC run: 4991 subRun: 0 event: 20950

###################################################
Event:			20950
Flag:			1102607342
Geometry:		dunevd10kt_3view_30deg_v5_refactored_1x8x14ref (VD)
Signal Label:		marley
PDS Frequency in [MHz]:	62.50
PDS Tick in [us]:	0.016
TPC Frequency in [MHz]:	2.00
TPC Tick in [us]:	0.50
TPC Map:		112 TPCs
TPC DriftLength in [cm]:650.07
TPC DriftTime in [us]:	4048.69
Fiducial Volume in [cm]:850.32, 1507.84, 2306.12
###################################################
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 02:33:44 UTC run: 4991 subRun: 0 event: 20950

There are a total of 132853 Particles in the event

# of particles 8	from gen 1 marley
# of particles 31059	from gen 2 Ar39GenInLAr
# of particles 3494	from gen 3 Kr85GenInLAr
# of particles 3	from gen 4 Ar42GenInLAr
# of particles 1	from gen 5 K42From42ArGenInLAr
# of particles 35	from gen 6 Rn222ChainRn222GenInLAr
# of particles 21	from gen 7 Rn222ChainPo218GenInLAr
# of particles 37	from gen 8 Rn222ChainPb214GenInLAr
# of particles 36	from gen 9 Rn222ChainBi214GenInLAr
# of particles 13	from gen 10 Rn222ChainPb210GenInLAr
# of particles 23	from gen 11 Rn220ChainPb212GenInLAr
# of particles 216	from gen 12 K40GenInCathode
# of particles 3077	from gen 13 U238ChainGenInCathode
# of particles 3623	from gen 14 Th232ChainGenInCathode
# of particles 102	from gen 15 K40GenInAnode
# of particles 1337	from gen 16 U238ChainGenInAnode
# of particles 1641	from gen 17 Th232ChainGenInAnode
# of particles 0	from gen 18 Rn222ChainGenInPDS
# of particles 4	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 7	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 25	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 82	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 66	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 38	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 34	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 23	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 02:33:44 UTC run: 4991 subRun: 0 event: 20950

Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 11.06 MeV
Position (-264.70, 455.71, 1153.50) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.57	(-264.70, 455.71, 1153.50)	132880	132824
marley	-12		0.74	(-264.70, 455.71, 1153.50)	132879	132824
marley	1000200400	0.00	(-264.70, 455.71, 1153.50)	132878	132824
marley	22		0.03	(-264.70, 455.71, 1153.50)	132827	0
marley	22		0.77	(-264.70, 455.71, 1153.50)	132826	0
marley	22		3.71	(-264.70, 455.71, 1153.50)	132825	0
marley	1000190400	0.00	(-264.70, 455.71, 1153.50)	132824	0
marley	11		5.04	(-264.70, 455.71, 1153.50)	132823	0
Signal Track IDs: 132823; 132824; 132825; 132826; 132827; 132878; 132879; 132880; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 02:33:44 UTC run: 4991 subRun: 0 event: 20950

Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 02:35:30 UTC run: 4991 subRun: 0 event: 20950
OpFlash PE 78.19 with purity 0.03 time -0.93 plane 0
 - Vertex (-327.50, 58.43, 457.75)
	*** 1st Sanity check: Ratio 0.17 <= 1.00
	*** 2nd Sanity check: #OpHits 9 >= 9
OpFlash PE 48.34 with purity 0.38 time -0.69 plane 1
 - Vertex (230.42, 743.30, 1544.25)
	*** 1st Sanity check: Ratio 0.34 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 890.17 with purity 0.14 time -0.01 plane 0
 - Vertex (-327.50, 486.16, 1168.74)
	*** 1st Sanity check: Ratio 0.14 <= 1.00
	*** 2nd Sanity check: #OpHits 22 >= 22
OpFlash PE 42.47 with purity 0.15 time 0.29 plane 1
 - Vertex (105.90, 743.30, 1040.77)
	*** 1st Sanity check: Ratio 0.29 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 20.99 with purity 0.20 time 2.59 plane 1
 - Vertex (194.74, 743.30, 1939.46)
	*** 1st Sanity check: Ratio 0.27 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 39.64 with purity 0.09 time 2.49 plane 0
 - Vertex (-327.50, -200.47, 702.92)
	*** 1st Sanity check: Ratio 0.26 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5

# of OpHits (ophit10ppm): 52594 for times between -4254.20 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 18157 for times between -4254.20 us and 295147919198126080.00 us.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 02:35:32 UTC run: 4991 subRun: 0 event: 20950

# OpHits (ophit10ppm) in full geometry: 52594
# OpFlashes (solarflash) in full geometry: 18157
# Hits (gaushit) in each view: 6583, 6554, 6545, 0
# Cluster from the hits: 2753, 2793, 5536, 0
# Tracks (pmtracktc) in full geometry: 458
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 03:17:36 UTC run: 4991 subRun: 0 event: 20950

# ClusterReco: Looping over 5524 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 03:17:36 UTC run: 4991 subRun: 0 event: 20950
*** Matched preselection cluster: 4786 from 5524
 - MainTrackID 132823
 - Gen 1 -> marley TPC 62
 - Purity 1.00 Hits 7
 - Charge 817.19 ( MaxHit 196.42 )
 - #AdjCl 12 ( 0 signal ):
    - Cluster 4054 at distance 85.94 with time 3139.07 and charge 107.89 in TPC 62 and hits 1
    - Cluster 4146 at distance 75.50 with time 3203.78 and charge 122.90 in TPC 62 and hits 2
    - Cluster 4336 at distance 92.81 with time 3336.14 and charge 27.69 in TPC 56 and hits 1
    - Cluster 4637 at distance 89.94 with time 3562.64 and charge 79.25 in TPC 62 and hits 1
    - Cluster 4721 at distance 66.59 with time 3619.41 and charge 30.97 in TPC 58 and hits 1
    - Cluster 4829 at distance 21.20 with time 3705.60 and charge 53.51 in TPC 62 and hits 1
    - Cluster 4903 at distance 43.68 with time 3760.68 and charge 49.18 in TPC 62 and hits 1
    - Cluster 4959 at distance 65.19 with time 3803.85 and charge 329.13 in TPC 70 and hits 2
    - Cluster 5137 at distance 66.41 with time 3937.80 and charge 55.91 in TPC 62 and hits 1
    - Cluster 5209 at distance 84.41 with time 3993.41 and charge 32.77 in TPC 64 and hits 1
    - Cluster 5241 at distance 74.81 with time 4018.92 and charge 79.85 in TPC 62 and hits 2
    - Cluster 5509 at distance 95.22 with time 4234.49 and charge 128.27 in TPC 62 and hits 1
 - RecoCol  Time,Y,Z ( 3672.30, 455.73, 1152.33 )
 - RecoInd0 Time,Y,Z ( 3672.25, 455.73, 1131.21 )
 - RecoInd1 Time,Y,Z ( 3671.98, 455.74, 1120.40 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -264.70, 455.71, 1153.50 )
 - Main X,Y,Z ( -263.31, 455.69, 1152.12 )
 - EDep X,Y,Z ( -263.40, 455.91, 1152.22 )
 - Reco X,Y,Z ( -1000000.00, 455.73, 1152.33 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 03:17:36 UTC run: 4991 subRun: 0 event: 20950
-----------------------------------------------------------------------------------------

%MSG
15-Jan-2026 03:17:36 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/f4/46/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T084148Z_gen_002095_supernova_g4stage1_g4stage2_detsim_reco_20250730T142129Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 15-Jan-2026 03:17:36 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          1.45827       1619.6        3868.03       1317.48       1653.45        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000687654    0.0110774     0.0270231     0.0085151     0.0096547       10     
end_path:solarnuana:SolarNuAna      1.43846       1619.58       3868.01       1317.47       1653.44        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 15-Jan-2026 03:17:36 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3194.24 MB
  Peak resident set size usage (VmHWM): 2559.66 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 16173.735835 Real = 16309.898100

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3194.24 VmHWM = 2559.66

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-06 07:40:10 UTC       justIN version: 01.06.00