justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 262235.1@dunegpschedd02.fnal.gov

Jobsub ID262235.1@dunegpschedd02.fnal.gov
Workflow ID11168
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-13 16:08:48
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-13 21:20:00
From worker nodeHostnamedunegli-7890611-0-fnpc9038.fnal.gov
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-13 16:10:19
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250116T142357Z_gen_000917_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time5h (18571s)
CPU time5h (18457s = 99%)
Max RSS bytes2845577216 (2713 MiB)
Outputting started2025-12-13 21:19:51
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11168/1/001/analysisLowE_20251213T161020Z.root
Finished2025-12-13 21:20:00
Saved logsjustin-logs:262235.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

cedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 21:19:03 UTC run: 4696 subRun: 0 event: 9170
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  13-Dec-2025 21:19:03 UTC run: 4696 subRun: 0 event: 9170
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6894, 6890, 6685
minwire 0: 25
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.158143, 
Output 1: 0.0661536, 0.0750859, 0.172553, 0.686208, 
Output 2: 0.132253, 0.167074, 0.671449, 0.0292242, 
Output 3: 0.987214, 0.00859175, 0.000559197, 0.0036349, 
Output 4: 0.224073, 0.745966, 0.0281212, 0.00183922, 
Output 5: 0.376908, 0.538553, 0.0671766, 0.0173623, 
Output 6: 0.0213792, 0.0637114, 0.0746496, 0.84026, 

13-Dec-2025 21:19:06 UTC  Closed output file "matt_reco2.root"
13-Dec-2025 21:19:06 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/c4/f4/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250116T142357Z_gen_000917_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1527.11       1830.67       2622.09       1645.03       346.884        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000779937   0.00595228     0.0298536    0.000937988    0.0101514       10     
reco:pandora:StandardPandora                            1525.47       1828.58       2616.23       1643.38       345.882        10     
reco:pandoraTrack:LArPandoraTrackCreation              0.0357752     0.0489311     0.0722069     0.0466746     0.0112294       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00154323    0.00815091     0.0443244     0.0049588     0.012158        10     
reco:pandoracalo:Calorimetry                          0.000366039   0.00140073    0.00977903    0.000457564   0.00279338       10     
reco:pandorapid:Chi2ParticleID                        0.000102139   0.000534217    0.0043069    0.000115775   0.00125758       10     
reco:cvnmap:CVNMapper                                  0.0583214     0.0744518     0.114085      0.0664363     0.0169664       10     
reco:cvneva:CVNEvaluator                                1.04936       1.49083       4.96391       1.09596       1.15833        10     
reco:energyrecnumu:EnergyReco                          0.0753839     0.0927387     0.140807      0.081061      0.0229525       10     
reco:energyrecnue:EnergyReco                          0.00134156     0.001793     0.00428354    0.00144387    0.000852136      10     
reco:energyrecnc:EnergyReco                           0.00800108    0.00857755    0.00993561    0.00822226    0.00067323       10     
[art]:TriggerResults:TriggerResultInserter             1.537e-05    3.19296e-05   0.000144986   1.8094e-05    3.79789e-05      10     
end_path:out1:RootOutput                               6.013e-06    1.3256e-05    6.4735e-05    6.9085e-06    1.72513e-05      10     
end_path:out1:RootOutput(write)                        0.334319      0.359674      0.497088      0.342553      0.0465243       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11908.8 MB
  Peak resident set size usage (VmHWM): 2845.58 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
 Looking at view: 1 | Number of hits in view: 16
hit initial : 14.4003 | hit correction : 1.16702
hit initial : 93.1428 | hit correction : 1.167
hit initial : 46.5347 | hit correction : 1.17061
hit initial : 302.123 | hit correction : 1.17015
hit initial : 545.864 | hit correction : 1.1706
hit initial : 289.524 | hit correction : 1.17091
hit initial : 440.06 | hit correction : 1.17016
hit initial : 61.1448 | hit correction : 1.17037
hit initial : 359.441 | hit correction : 1.17127
hit initial : 226.777 | hit correction : 1.17144
hit initial : 132.648 | hit correction : 1.17168
hit initial : 14.8621 | hit correction : 1.17229
hit initial : 307.249 | hit correction : 1.1721
hit initial : 302.28 | hit correction : 1.17207
hit initial : 215.084 | hit correction : 1.17221
hit initial : 165.562 | hit correction : 1.17247
hit initial : 158.301 | hit correction : 1.1728
hit initial : 159.806 | hit correction : 1.17306
hit initial : 163.935 | hit correction : 1.17326
hit initial : 120.994 | hit correction : 1.1734
hit initial : 18.8536 | hit correction : 1.17351
 *** Total Charge : 4847.72
 Looking at view: 2 | Number of hits in view: 21
Begin processing the 10th record. run: 4696 subRun: 0 event: 9170 at 13-Dec-2025 21:19:47 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  5
This pfp has size:  40
Added hit list length: 40 | Max was set to: -3.40282e+38
This pfp has size:  8
This pfp has size:  7
True Neutron Energy: 939.581
True Electron Energy: 24.6097
Completed MCParticle Loop
True Neutrino Energy: 29.992
 Size of all hits: 40
hit initial : 30.3497 | hit correction : 1.45714
hit initial : 42.2005 | hit correction : 1.45716
hit initial : 45.9586 | hit correction : 1.47056
hit initial : 196.822 | hit correction : 1.47055
hit initial : 342.825 | hit correction : 1.4705
hit initial : 285.846 | hit correction : 1.47028
hit initial : 191.779 | hit correction : 1.46982
hit initial : 158.937 | hit correction : 1.46943
hit initial : 191.207 | hit correction : 1.46913
hit initial : 203.139 | hit correction : 1.46879
hit initial : 175.939 | hit correction : 1.46848
hit initial : 284.924 | hit correction : 1.46772
hit initial : 138.689 | hit correction : 1.46734
hit initial : 43.712 | hit correction : 1.4672
 *** Total Charge : 3426.03
 Looking at view: 0 | Number of hits in view: 14
hit initial : 30.861 | hit correction : 1.45717
hit initial : 38.7774 | hit correction : 1.45718
hit initial : 17.4406 | hit correction : 1.47055
hit initial : 97.0164 | hit correction : 1.47055
hit initial : 190.799 | hit correction : 1.47056
hit initial : 223.857 | hit correction : 1.47053
hit initial : 205.352 | hit correction : 1.47034
hit initial : 188.43 | hit correction : 1.46995
hit initial : 184.266 | hit correction : 1.46959
hit initial : 182.869 | hit correction : 1.46925
hit initial : 172.758 | hit correction : 1.46894
hit initial : 188.574 | hit correction : 1.46856
hit initial : 255.827 | hit correction : 1.46797
hit initial : 200.921 | hit correction : 1.46758
hit initial : 93.7875 | hit correction : 1.46742
 *** Total Charge : 3336.7
 Looking at view: 1 | Number of hits in view: 15
hit initial : 34.6149 | hit correction : 1.45721
hit initial : 50.2094 | hit correction : 1.45719
hit initial : 124.172 | hit correction : 1.47057
hit initial : 298.023 | hit correction : 1.47056
hit initial : 153.94 | hit correction : 1.4704
hit initial : 162.396 | hit correction : 1.46999
hit initial : 103.353 | hit correction : 1.46923
hit initial : 779.144 | hit correction : 1.46914
hit initial : 234.861 | hit correction : 1.46854
hit initial : 155.899 | hit correction : 1.46741
hit initial : 98.7764 | hit correction : 1.46729
 *** Total Charge : 3224.67
 Looking at view: 2 | Number of hits in view: 11
13-Dec-2025 21:19:50 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0862084     0.0930094     0.111589      0.0904168     0.0077639       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000396982   0.000513901   0.00105704    0.000473345   0.000183835      10     
end_path:ana:AnalyzeEvents         0.0856557     0.092317       0.10999      0.0898423    0.00753101       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9815.76 MB
  Peak resident set size usage (VmHWM): 1543.04 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 12:05:49 UTC       justIN version: 01.06.00