justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 278044.2@dunegpschedd01.fnal.gov

Jobsub ID278044.2@dunegpschedd01.fnal.gov
Workflow ID11808
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-14 18:44:52
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2026-01-15 05:01:30
From worker nodeHostnamedunegli-8167725-0-fnpc18001.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-14 22:11:26
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T155133Z_gen_000137_supernova_g4stage1_g4stage2_detsim_reco_20250730T232223Z_reco2.root
JobscriptExit code0
Real time6h (24577s)
CPU time6h (24005s = 97%)
Max RSS bytes2547933184 (2429 MiB)
Outputting started2026-01-15 05:01:03
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/11808/1/001/fdhd_ana_2026-01-14T_221140Z_hist.root
Finished2026-01-15 05:01:22
Saved logsjustin-logs:278044.2-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

s 44	from gen 8 Rn222ChainPb214GenInLAr
# of particles 47	from gen 9 Rn222ChainBi214GenInLAr
# of particles 30	from gen 10 Rn222ChainPb210GenInLAr
# of particles 34	from gen 11 Rn220ChainPb212GenInLAr
# of particles 229	from gen 12 K40GenInCathode
# of particles 3018	from gen 13 U238ChainGenInCathode
# of particles 3824	from gen 14 Th232ChainGenInCathode
# of particles 108	from gen 15 K40GenInAnode
# of particles 1329	from gen 16 U238ChainGenInAnode
# of particles 1537	from gen 17 Th232ChainGenInAnode
# of particles 0	from gen 18 Rn222ChainGenInPDS
# of particles 2	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 2	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 27	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 62	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 39	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 44	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 47	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 25	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 03:14:48 UTC run: 5048 subRun: 0 event: 1370

Number of Signal Particles: 7
Neutrino Interaction: -1
Neutrino Energy: 12.96 MeV
Position (-74.68, -46.54, 1271.83) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.68	(-74.68, -46.54, 1271.83)	132797	132753
marley	-12		0.63	(-74.68, -46.54, 1271.83)	132796	132753
marley	1000200400	0.00	(-74.68, -46.54, 1271.83)	132795	132753
marley	22		0.03	(-74.68, -46.54, 1271.83)	132756	0
marley	22		1.61	(-74.68, -46.54, 1271.83)	132755	0
marley	22		1.09	(-74.68, -46.54, 1271.83)	132754	0
marley	1000190400	0.01	(-74.68, -46.54, 1271.83)	132753	0
marley	11		8.71	(-74.68, -46.54, 1271.83)	132752	0
Signal Track IDs: 132752; 132753; 132754; 132755; 132756; 132795; 132796; 132797; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 03:14:48 UTC run: 5048 subRun: 0 event: 1370

Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 03:16:46 UTC run: 5048 subRun: 0 event: 1370
OpFlash PE 462.97 with purity 0.35 time 0.34 plane 0
 - Vertex (-327.50, -80.31, 1262.19)
	*** 1st Sanity check: Ratio 0.12 <= 1.00
	*** 2nd Sanity check: #OpHits 32 >= 32
OpFlash PE 587.57 with purity 0.38 time 0.30 plane 1
 - Vertex (285.07, 743.30, 1673.00)
	*** 1st Sanity check: Ratio 0.26 <= 1.00
	*** 2nd Sanity check: #OpHits 11 >= 11
OpFlash PE 63.03 with purity 0.17 time 1.75 plane 2
 - Vertex (97.11, -743.30, 1587.82)
	*** 1st Sanity check: Ratio 0.37 <= 1.00
	*** 2nd Sanity check: #OpHits 5 >= 5
OpFlash PE 91.24 with purity 0.05 time 2.13 plane 2
 - Vertex (60.07, -743.30, 484.42)
	*** 1st Sanity check: Ratio 0.30 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 55.53 with purity 0.28 time 3.94 plane 2
 - Vertex (135.07, -743.30, 1939.46)
	*** 1st Sanity check: Ratio 0.56 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4
OpFlash PE 51.22 with purity 0.19 time 3.70 plane 0
 - Vertex (-327.50, -200.28, 980.20)
	*** 1st Sanity check: Ratio 0.21 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 14.55 with purity 0.53 time 4.19 plane 0
 - Vertex (-327.50, 421.44, 1896.14)
	*** 1st Sanity check: Ratio 0.53 <= 1.00
	*** 2nd Sanity check: #OpHits 2 >= 2
OpFlash PE 30.85 with purity 0.24 time 5.06 plane 0
 - Vertex (-327.50, -140.00, 1461.83)
	*** 1st Sanity check: Ratio 0.37 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4

# of OpHits (ophit10ppm): 52245 for times between -4254.44 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 18100 for times between -4254.44 us and 295147919198126080.00 us.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 03:16:49 UTC run: 5048 subRun: 0 event: 1370

# OpHits (ophit10ppm) in full geometry: 52245
# OpFlashes (solarflash) in full geometry: 18100
# Hits (gaushit) in each view: 6633, 6576, 6529, 0
# Cluster from the hits: 2777, 2782, 5511, 0
# Tracks (pmtracktc) in full geometry: 495
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 05:01:01 UTC run: 5048 subRun: 0 event: 1370

# ClusterReco: Looping over 5507 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 05:01:01 UTC run: 5048 subRun: 0 event: 1370
*** Matched preselection cluster: 3135 from 5507
 - MainTrackID 132755
 - Gen 1 -> marley TPC 67
 - Purity 1.00 Hits 2
 - Charge 134.36 ( MaxHit 92.45 )
 - #AdjCl 3 ( 0 signal ):
    - Cluster 2576 at distance 91.43 with time 2056.78 and charge 69.01 in TPC 69 and hits 1
    - Cluster 2812 at distance 89.53 with time 2233.11 and charge 96.22 in TPC 69 and hits 2
    - Cluster 3401 at distance 75.57 with time 2673.58 and charge 67.94 in TPC 71 and hits 1
 - RecoCol  Time,Y,Z ( 2481.95, 110.86, 1268.69 )
 - RecoInd0 Time,Y,Z ( 2482.72, 94.06, 1270.32 )
 - RecoInd1 Time,Y,Z ( 2482.77, 127.67, 1267.44 )
*** Matched flash: 10640 from 18100
 - Purity 0.00 % Plane 0 #Hits 6
 - MainOpHitPE 62.12 (PE);  TotalPE 119.92 vs expected 22.95 (PE)
 - Time 803.08 (us) Fast 81.74 % Residual 188.82
 - Reco Time,Y,Z ( 803.08, 128.70, 1231.78 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -74.68, -46.54, 1271.83 )
 - Main X,Y,Z ( -105.51, -39.79, 1303.07 )
 - EDep X,Y,Z ( -73.42, -48.08, 1268.68 )
 - Reco X,Y,Z ( 55.47, 110.86, 1268.69 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 05:01:01 UTC run: 5048 subRun: 0 event: 1370
*** Matched preselection cluster: 3143 from 5507
 - MainTrackID 132752
 - Gen 1 -> marley TPC 67
 - Purity 1.00 Hits 6
 - Charge 960.17 ( MaxHit 211.19 )
 - #AdjCl 8 ( 0 signal ):
    - Cluster 2514 at distance 94.19 with time 2007.46 and charge 25.24 in TPC 65 and hits 1
    - Cluster 2647 at distance 99.72 with time 2105.06 and charge 289.68 in TPC 67 and hits 2
    - Cluster 2664 at distance 60.50 with time 2117.39 and charge 58.30 in TPC 69 and hits 1
    - Cluster 2770 at distance 54.87 with time 2196.30 and charge 84.40 in TPC 67 and hits 1
    - Cluster 2907 at distance 99.92 with time 2306.42 and charge 90.25 in TPC 59 and hits 1
    - Cluster 3163 at distance 95.63 with time 2503.73 and charge 47.26 in TPC 61 and hits 2
    - Cluster 3415 at distance 53.54 with time 2684.24 and charge 23.84 in TPC 65 and hits 1
    - Cluster 3891 at distance 98.20 with time 3041.70 and charge 87.93 in TPC 67 and hits 1
 - RecoCol  Time,Y,Z ( 2485.97, -47.63, 1272.94 )
 - RecoInd0 Time,Y,Z ( 2485.13, -47.89, 1270.32 )
 - RecoInd1 Time,Y,Z ( 2485.44, -47.36, 1270.32 )
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -74.68, -46.54, 1271.83 )
 - Main X,Y,Z ( -73.85, -47.43, 1274.04 )
 - EDep X,Y,Z ( -73.84, -47.70, 1273.65 )
 - Reco X,Y,Z ( -1000000.00, -47.63, 1272.94 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  15-Jan-2026 05:01:01 UTC run: 5048 subRun: 0 event: 1370
-----------------------------------------------------------------------------------------

%MSG
15-Jan-2026 05:01:02 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/e5/a8/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T155133Z_gen_000137_supernova_g4stage1_g4stage2_detsim_reco_20250730T232223Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 15-Jan-2026 05:01:02 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          1.38623       2427.01       6892.04       2.03527       2998.85        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000921829   0.00871058     0.0208537    0.00762204    0.00706215       10     
end_path:solarnuana:SolarNuAna      1.38371        2427         6892.02       2.02747       2998.85        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 15-Jan-2026 05:01:02 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3185.45 MB
  Peak resident set size usage (VmHWM): 2547.93 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 23972.061956 Real = 24541.720825

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3185.45 VmHWM = 2547.93

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-06 05:56:04 UTC       justIN version: 01.06.00