justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 300757.1@dunegpschedd01.fnal.gov

Jobsub ID300757.1@dunegpschedd01.fnal.gov
Workflow ID12378
Stage ID1
User namesmanthey@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-25 16:15:01
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2026-01-25 21:54:02
From worker nodeHostnamedunegli-8270161-0-fnpc17119.fnal.gov
cpuinfoIntel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-25 16:16:10
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250124T203702Z_gen_000263_supernova_g4stage1_g4stage2_detsim_reco_20250701T203908Z_reco2.root
JobscriptExit code0
Real time5h (20263s)
CPU time5h (20168s = 99%)
Max RSS bytes2562027520 (2443 MiB)
Outputting started2026-01-25 21:53:54
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/smanthey/ana/solar_ana_marley_flash_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_nominal/fnal/12378/1/001/fdhd_ana_2026-01-25T_161616Z_hist.root
Finished2026-01-25 21:54:02
Saved logsjustin-logs:300757.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

particles 7	from gen 1 marley
# of particles 31113	from gen 2 Ar39GenInLAr
# of particles 3648	from gen 3 Kr85GenInLAr
# of particles 1	from gen 4 Ar42GenInLAr
# of particles 0	from gen 5 K42From42ArGenInLAr
# of particles 35	from gen 6 Rn222ChainRn222GenInLAr
# of particles 23	from gen 7 Rn222ChainPo218GenInLAr
# of particles 48	from gen 8 Rn222ChainPb214GenInLAr
# of particles 33	from gen 9 Rn222ChainBi214GenInLAr
# of particles 26	from gen 10 Rn222ChainPb210GenInLAr
# of particles 27	from gen 11 Rn220ChainPb212GenInLAr
# of particles 237	from gen 12 K40GenInCathode
# of particles 3129	from gen 13 U238ChainGenInCathode
# of particles 3626	from gen 14 Th232ChainGenInCathode
# of particles 114	from gen 15 K40GenInAnode
# of particles 1251	from gen 16 U238ChainGenInAnode
# of particles 1707	from gen 17 Th232ChainGenInAnode
# of particles 1	from gen 18 Rn222ChainGenInPDS
# of particles 0	from gen 19 K42From42ArGenInUpperMesh1x8x14
# of particles 2	from gen 20 Rn222ChainFromPo218GenInUpperMesh1x8x14
# of particles 26	from gen 21 Rn222ChainFromPb214GenInUpperMesh1x8x14
# of particles 29	from gen 22 Rn222ChainFromBi214GenInUpperMesh1x8x14
# of particles 58	from gen 23 Rn222ChainFromPb210GenInUpperMesh1x8x14
# of particles 45	from gen 24 Rn222ChainFromBi210GenInUpperMesh1x8x14
# of particles 59	from gen 25 Rn220ChainFromPb212GenInUpperMesh1x8x14
# of particles 84313	from gen 26 CavernwallGammasAtLAr1x8x14
# of particles 3534	from gen 27 foamGammasAtLAr1x8x14
# of particles 23	from gen 28 CavernwallNeutronsAtLAr1x8x14
# of particles 1	from gen 29 CryostatNGammasAtLAr1x8x14
# of particles 0	from gen 30 CavernNGammasAtLAr1x8x14
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 21:19:50 UTC run: 4879 subRun: 0 event: 2630

Number of Signal Particles: 6
Neutrino Interaction: -1
Neutrino Energy: 18.86 MeV
Position (-195.16, 8.61, 598.33) cm
Gen.	PdgCode		Energy		EndPosition		TrackID	MotherID
--------------------------------------------------------------------------------
marley	11		0.35	(-195.16, 8.61, 598.33)	133121	133085
marley	-12		0.96	(-195.16, 8.61, 598.33)	133120	133085
marley	1000200400	0.00	(-195.16, 8.61, 598.33)	133119	133085
marley	22		2.05	(-195.16, 8.61, 598.33)	133087	0
marley	22		2.46	(-195.16, 8.61, 598.33)	133086	0
marley	1000190400	0.01	(-195.16, 8.61, 598.33)	133085	0
marley	11		12.84	(-195.16, 8.61, 598.33)	133084	0
Signal Track IDs: 133084; 133085; 133086; 133087; 133119; 133120; 133121; 
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 21:19:50 UTC run: 4879 subRun: 0 event: 2630

Kinetic energy of signal particle is below threshold of 30.00 MeV. Selecting event.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 21:22:06 UTC run: 4879 subRun: 0 event: 2630
OpFlash PE 690.95 with purity 0.22 time 0.18 plane 0
 - Vertex (-327.50, 18.58, 612.26)
	*** 1st Sanity check: Ratio 0.07 <= 1.00
	*** 2nd Sanity check: #OpHits 36 >= 36
OpFlash PE 44.79 with purity 0.54 time 2.38 plane 0
 - Vertex (-327.50, -2.38, 609.19)
	*** 1st Sanity check: Ratio 0.21 <= 1.00
	*** 2nd Sanity check: #OpHits 7 >= 7
OpFlash PE 22.93 with purity 0.15 time 8.09 plane 0
 - Vertex (-327.50, -423.05, 426.12)
	*** 1st Sanity check: Ratio 0.39 <= 1.00
	*** 2nd Sanity check: #OpHits 4 >= 4

# of OpHits (ophit10ppm): 51566 for times between -4254.62 us and 295147919198126080.00 us.
# of OpFlashes (solarflash): 18195 for times between -4254.62 us and 295147919198126080.00 us.

%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 21:22:08 UTC run: 4879 subRun: 0 event: 2630

# OpHits (ophit10ppm) in full geometry: 51566
# OpFlashes (solarflash) in full geometry: 18195
# Hits (gaushit) in each view: 6667, 6636, 6713, 0
# Cluster from the hits: 2820, 2858, 5729, 0
# Tracks (pmtracktc) in full geometry: 454
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 21:53:52 UTC run: 4879 subRun: 0 event: 2630

# ClusterReco: Looping over 5724 matched clusters
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 21:53:52 UTC run: 4879 subRun: 0 event: 2630
*** Matched preselection cluster: 4354 from 5724
 - MainTrackID 133086
 - Gen 1 -> marley TPC 27
 - Purity 1.00 Hits 3
 - Charge 215.65 ( MaxHit 112.11 )
 - #AdjCl 9 ( 0 signal ):
    - Cluster 4102 at distance 68.22 with time 3063.24 and charge 26.53 in TPC 25 and hits 1
    - Cluster 4176 at distance 42.89 with time 3119.45 and charge 40.24 in TPC 25 and hits 1
    - Cluster 4240 at distance 57.10 with time 3161.76 and charge 27.70 in TPC 33 and hits 1
    - Cluster 4698 at distance 85.34 with time 3490.45 and charge 34.21 in TPC 29 and hits 1
    - Cluster 4699 at distance 95.34 with time 3491.62 and charge 57.60 in TPC 27 and hits 1
    - Cluster 4703 at distance 48.68 with time 3494.31 and charge 24.60 in TPC 31 and hits 1
    - Cluster 4754 at distance 71.83 with time 3536.22 and charge 157.44 in TPC 27 and hits 1
    - Cluster 4792 at distance 71.57 with time 3559.92 and charge 36.32 in TPC 37 and hits 1
    - Cluster 5112 at distance 95.34 with time 3806.14 and charge 53.35 in TPC 33 and hits 1
 - RecoCol  Time,Y,Z ( 3238.19, -9.73, 578.23 )
 - RecoInd0 Time,Y,Z ( 3238.20, -9.70, 579.68 )
 - RecoInd1 Time,Y,Z ( 3238.20, -9.76, 521.33 )
*** Matched flash: 9084 from 18195
 - Purity 22.47 % Plane 0 #Hits 36
 - MainOpHitPE 48.61 (PE);  TotalPE 690.95 vs expected 134.23 (PE)
 - Time 0.18 (us) Fast 23.79 % Residual 251.16
 - Reco Time,Y,Z ( 0.18, 18.58, 612.26 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -195.16, 8.61, 598.33 )
 - Main X,Y,Z ( -192.88, -35.54, 573.23 )
 - EDep X,Y,Z ( -194.89, -9.72, 578.22 )
 - Reco X,Y,Z ( -194.87, -9.73, 578.23 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 21:53:52 UTC run: 4879 subRun: 0 event: 2630
*** Matched preselection cluster: 4366 from 5724
 - MainTrackID 133084
 - Gen 1 -> marley TPC 36
 - Purity 1.00 Hits 3
 - Charge 396.58 ( MaxHit 195.59 )
 - #AdjCl 6 ( 2 signal ):
    - Cluster 3742 at distance 90.23 with time 2776.26 and charge 31.46 in TPC 38 and hits 1
    - Cluster 3970 at distance 83.13 with time 2964.66 and charge 139.94 in TPC 28 and hits 2
    - Cluster 4205 at distance 77.34 with time 3142.41 and charge 30.23 in TPC 34 and hits 1
    - Cluster 4337 at distance 6.94 with time 3229.72 and charge 168.88 in TPC 28 and hits 3
    - Cluster 4430 at distance 10.69 with time 3293.42 and charge 163.20 in TPC 36 and hits 2
    - Cluster 4507 at distance 49.26 with time 3369.44 and charge 63.09 in TPC 36 and hits 1
 - RecoCol  Time,Y,Z ( 3243.76, 8.23, 598.96 )
 - RecoInd0 Time,Y,Z ( 3243.75, 8.29, 605.38 )
 - RecoInd1 Time,Y,Z ( 3243.78, 8.17, 672.64 )
*** Matched flash: 9084 from 18195
 - Purity 22.47 % Plane 0 #Hits 36
 - MainOpHitPE 48.61 (PE);  TotalPE 690.95 vs expected 182.16 (PE)
 - Time 0.18 (us) Fast 23.79 % Residual 182.90
 - Reco Time,Y,Z ( 0.18, 18.58, 612.26 )
 - Found valid waveform: true
*** Reconstructed Interaction Vertex: 
 - True X,Y,Z ( -195.16, 8.61, 598.33 )
 - Main X,Y,Z ( -196.22, 8.17, 599.34 )
 - EDep X,Y,Z ( -196.18, 8.12, 599.25 )
 - Reco X,Y,Z ( -195.76, 8.23, 598.96 )
%MSG
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@BeginModule  25-Jan-2026 21:53:52 UTC run: 4879 subRun: 0 event: 2630
-----------------------------------------------------------------------------------------

%MSG
25-Jan-2026 21:53:53 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/1e/68/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250124T203702Z_gen_000263_supernova_g4stage1_g4stage2_detsim_reco_20250701T203908Z_reco2.root"
%MSG-i ProducerUtils:  SolarNuAna:solarnuana@EndJob 25-Jan-2026 21:53:53 UTC  ModuleEndJob
Finished running the SolarNuAna module
%MSG

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          1.22821       2021.03       2856.42       2400.36       1042.88        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00153985    0.00787396     0.0190944    0.00718343    0.00537073       10     
end_path:solarnuana:SolarNuAna      1.21571       2021.02       2856.42       2400.35       1042.88        10     
====================================================================================================================
%MSG-i NuRandomService:  SolarNuAna:solarnuana@EndJob 25-Jan-2026 21:53:53 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3187.93 MB
  Peak resident set size usage (VmHWM): 2562.03 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 solarnuana

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 20152.658601 Real = 20246.333547

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3187.93 VmHWM = 2562.03

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-04 07:21:08 UTC       justIN version: 01.06.00