justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 293433.1@dunegpschedd02.fnal.gov

Jobsub ID293433.1@dunegpschedd02.fnal.gov
Workflow ID12149
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-22 07:54:44
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2026-01-22 10:52:37
From worker nodeHostnamedunegli-8388682-0-fnpc23024.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-22 07:56:16
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T193715Z_gen_002308_supernova_g4stage1_g4stage2_detsim_reco_20250623T224102Z_reco2.root
JobscriptExit code0
Real time2h (10573s)
CPU time2h (10486s = 99%)
Max RSS bytes2567892992 (2448 MiB)
Outputting started2026-01-22 10:52:30
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/12149/1/001/fdhd_ana_2026-01-22T_075624Z_hist.root
Finished2026-01-22 10:52:37
Saved logsjustin-logs:293433.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

of 133072 Particles in the event

# of particles 7	from gen 1 marley
# of particles 30970	from gen 2 Ar39GenInLAr
# of particles 3528	from gen 3 Kr85GenInLAr
# of particles 1	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 14	from gen 6 Rn222ChainRn222GenInLAr
# of particles 26	from gen 7 Rn222ChainPo218GenInLAr
# of particles 49	from gen 8 Rn222ChainPb214GenInLAr
# of particles 19	from gen 9 Rn222ChainBi214GenInLAr
# of particles 35	from gen 10 Rn222ChainPb210GenInLAr
# of particles 28	from gen 11 Rn220ChainPb212GenInLAr
# of particles 216	from gen 12 K40GenInCathode
# of particles 3088	from gen 13 U238ChainGenInCathode
# of particles 3746	from gen 14 Th232ChainGenInCathode
# of particles 108	from gen 15 K40GenInAnode
# of particles 1353	from gen 16 U238ChainGenInAnode
# of particles 1795	from gen 17 Th232ChainGenInAnode
# of particles 9	from gen 18 Rn222ChainGenInPDS
# of particles 2	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 4	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 23	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 42	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 42	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 46	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 57	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 16	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 10:23:01 UTC run: 5025 subRun: 0 event: 23080

Number of Signal Particles: 6
Neutrino Interaction: -1
Neutrino Energy: 24.44 MeV
Position (142.17, 517.34, 1631.35) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		1.08	(142.17, 517.34, 1631.35)	133114	133052
marley	-12		0.23	(142.17, 517.34, 1631.35)	133113	133052
marley	1000200400	0.00	(142.17, 517.34, 1631.35)	133112	133052
marley	22		2.75	(142.17, 517.34, 1631.35)	133054	0
marley	22		1.64	(142.17, 517.34, 1631.35)	133053	0
marley	1000190400	0.00	(142.17, 517.34, 1631.35)	133052	0
marley	11		18.55	(142.17, 517.34, 1631.35)	133051	0
Signal Track IDs: 133051; 133052; 133053; 133054; 133112; 133113; 133114; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 10:23:01 UTC run: 5025 subRun: 0 event: 23080

Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 10:23:46 UTC run: 5025 subRun: 0 event: 23080
OpFlash PE 483.29 with purity 0.09 time 0.13 plane 1
 - Vertex (134.05, 743.30, 1660.49)
	*** 1st Sanity check: Ratio 0.13 <= 1.00
	*** 2nd Sanity check: #OpHits 20 >= 20
OpFlash PE 215.43 with purity 0.14 time 0.73 plane 0
 - Vertex (-327.50, 527.70, 1502.42)
	*** 1st Sanity check: Ratio 0.15 <= 1.00
	*** 2nd Sanity check: #OpHits 19 >= 19
OpFlash PE 68.17 with purity 0.26 time 3.24 plane 1
 - Vertex (141.95, 743.30, 1706.73)
	*** 1st Sanity check: Ratio 0.22 <= 1.00
	*** 2nd Sanity check: #OpHits 6 >= 6
OpFlash PE 109.17 with purity 0.28 time 5.09 plane 3
 - Vertex (135.07, 220.00, 2188.38)
	*** 1st Sanity check: Ratio 0.57 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 177.30 with purity 0.02 time 8.04 plane 0
 - Vertex (-327.50, 538.10, 1448.78)
	*** 1st Sanity check: Ratio 0.45 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4

# of OpHits (ophit10ppm): 52473 for times between -4254.39 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 18132 for times between -4254.39 us and 295147919198126080.00 us.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 10:23:48 UTC run: 5025 subRun: 0 event: 23080

# OpHits (ophit10ppm) in full geometry: 52473
# OpFlashes (solarflash) in full geometry: 18132
# Hits (gaushit) in each view: 6510, 6504, 6563, 0
# Cluster from the hits: 2701, 2763, 5568, 0
# Tracks (pmtracktc) in full geometry: 497
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 10:52:30 UTC run: 5025 subRun: 0 event: 23080

# ClusterReco: Looping over 5563 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 10:52:30 UTC run: 5025 subRun: 0 event: 23080
*** Matched preselection cluster: 1424 from 5563
 - MainTrackID 133054
 - Gen 1 -> marley TPC 87
 - Purity 1.00 Hits 2
 - Charge 190.99 ( MaxHit 143.65 )
 - #AdjCl 8 ( 2 signal ):
    - Cluster 1333 at distance 97.38 with time 1056.33 and charge 189.63 in TPC 83 and hits 2
    - Cluster 1387 at distance 20.35 with time 1096.39 and charge 25.95 in TPC 87 and hits 1
    - Cluster 1389 at distance 98.97 with time 1097.65 and charge 45.24 in TPC 83 and hits 1
    - Cluster 1454 at distance 44.46 with time 1154.99 and charge 161.64 in TPC 87 and hits 5
    - Cluster 1461 at distance 66.44 with time 1163.30 and charge 29.43 in TPC 93 and hits 1
    - Cluster 1625 at distance 44.34 with time 1288.88 and charge 30.13 in TPC 85 and hits 1
    - Cluster 1664 at distance 65.41 with time 1326.74 and charge 38.17 in TPC 89 and hits 1
    - Cluster 1743 at distance 70.39 with time 1388.68 and charge 29.81 in TPC 95 and hits 1
 - RecoCol  Time,Y,Z ( 1127.35, -142.68, 1624.88 )
 - RecoInd0 Time,Y,Z ( 1125.81, -920.74, 223.88 )
 - RecoInd1 Time,Y,Z ( 1125.68, 635.39, 265.62 )
*** Matched flash: 10527 from 18132
 - Purity 0.00 % Plane 0 #Hits 7
 - MainOpHitPE 11.26 (PE);  TotalPE 51.02 vs expected 9.00 (PE)
 - Time 685.03 (us) Fast 24.03 % Residual 4.57
 - Reco Time,Y,Z ( 685.03, -192.07, 1629.48 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 142.17, 517.34, 1631.35 )
 - Main X,Y,Z ( 158.47, 502.58, 1621.00 )
 - EDep X,Y,Z ( 144.05, 518.61, 1624.87 )
 - Reco X,Y,Z ( 254.01, -142.68, 1624.88 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 10:52:30 UTC run: 5025 subRun: 0 event: 23080
*** Matched preselection cluster: 1436 from 5563
 - MainTrackID 133051
 - Gen 1 -> marley TPC 87
 - Purity 1.00 Hits 8
 - Charge 1574.83 ( MaxHit 569.77 )
 - #AdjCl 5 ( 2 signal ):
    - Cluster 1058 at distance 74.87 with time 862.02 and charge 44.78 in TPC 87 and hits 1
    - Cluster 1193 at distance 53.99 with time 955.77 and charge 138.38 in TPC 87 and hits 2
    - Cluster 1514 at distance 32.75 with time 1209.14 and charge 227.49 in TPC 87 and hits 2
    - Cluster 1574 at distance 43.52 with time 1259.39 and charge 280.35 in TPC 87 and hits 4
    - Cluster 1829 at distance 94.68 with time 1447.29 and charge 47.15 in TPC 87 and hits 1
 - RecoCol  Time,Y,Z ( 1139.70, 520.36, 1630.88 )
 - RecoInd0 Time,Y,Z ( 1136.87, 519.89, 1569.16 )
 - RecoInd1 Time,Y,Z ( 1136.84, 520.82, 1623.15 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( 142.17, 517.34, 1631.35 )
 - Main X,Y,Z ( 141.71, 520.22, 1630.96 )
 - EDep X,Y,Z ( 142.13, 518.87, 1631.28 )
 - Reco X,Y,Z ( -1000000.00, 520.36, 1630.88 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  22-Jan-2026 10:52:30 UTC run: 5025 subRun: 0 event: 23080
-----------------------------------------------------------------------------------------

%MSG
22-Jan-2026 10:52:30 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/c2/d5/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T193715Z_gen_002308_supernova_g4stage1_g4stage2_detsim_reco_20250623T224102Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 22-Jan-2026 10:52:30 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.516657       1053.41       1995.19       1576.61       868.885        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00126276    0.00756956     0.0206249     0.0059428    0.00656088       10     
end_path:solarnuana:SolarNuAna     0.514968       1053.4        1995.18       1576.61       868.882        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 22-Jan-2026 10:52:30 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3192.47 MB
  Peak resident set size usage (VmHWM): 2567.89 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 10472.909222 Real = 10557.707146

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3192.47 VmHWM = 2567.89

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-05 14:09:51 UTC       justIN version: 01.06.00