justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 258496.1@dunegpschedd02.fnal.gov

Jobsub ID258496.1@dunegpschedd02.fnal.gov
Workflow ID11023
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-06 10:33:54
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-06 15:01:46
From worker nodeHostnamedunegli-7832435-0-fnpc17108.fnal.gov
cpuinfoIntel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-06 10:34:40
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T201024Z_gen_002563_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time4h (16016s)
CPU time4h (15916s = 99%)
Max RSS bytes3104579584 (2960 MiB)
Outputting started2025-12-06 15:01:36
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11023/1/001/analysisLowE_20251206T103441Z.root
Finished2025-12-06 15:01:46
Saved logsjustin-logs:258496.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

, 
Output 4: 0.305038, 0.592157, 0.0948581, 0.00794665, 
Output 5: 0.337547, 0.479886, 0.156614, 0.0259534, 
Output 6: 0.0332839, 0.0894299, 0.100548, 0.776739, 

Begin processing the 10th record. run: 5026 subRun: 0 event: 25630 at 06-Dec-2025 14:36:01 UTC
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  06-Dec-2025 15:00:49 UTC run: 5026 subRun: 0 event: 25630
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6570, 6553, 6597
minwire 0: 56
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.159676, 
Output 1: 0.0704492, 0.081714, 0.116019, 0.731818, 
Output 2: 0.0659043, 0.391969, 0.504386, 0.03774, 
Output 3: 0.949183, 0.0337788, 0.00625813, 0.0107802, 
Output 4: 0.284927, 0.619325, 0.0904643, 0.00528437, 
Output 5: 0.452437, 0.480574, 0.0609113, 0.00607791, 
Output 6: 0.0213997, 0.0545455, 0.0796174, 0.844437, 

06-Dec-2025 15:00:53 UTC  Closed output file "matt_reco2.root"
06-Dec-2025 15:00:53 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/3e/62/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T201024Z_gen_002563_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1472.18       1586.74       1788.88       1557.93       109.735        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00152169    0.00789262     0.0240602    0.00543422    0.00643195       10     
reco:pandora:StandardPandora                            1470.3        1584.7        1787.39       1556.28       109.722        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000385581    0.0203027     0.108815     0.00536292     0.0319049       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000365923    0.034054      0.299642     0.00430562     0.0886042       10     
reco:pandoracalo:Calorimetry                          0.000213556   0.00371167     0.0291092    0.000420914   0.00852732       10     
reco:pandorapid:Chi2ParticleID                        6.8065e-05    0.000310714   0.00145509    9.73435e-05   0.000422337      10     
reco:cvnmap:CVNMapper                                  0.0473465     0.0535776     0.0694848     0.0509854    0.00668716       10     
reco:cvneva:CVNEvaluator                               0.868618       1.34041       3.72825       1.10214      0.818023        10     
reco:energyrecnumu:EnergyReco                         0.00525084     0.144711       0.82022      0.0882156     0.229207        10     
reco:energyrecnue:EnergyReco                          0.00129602    0.00392789    0.00971751    0.00181406    0.00349399       10     
reco:energyrecnc:EnergyReco                           0.00807774     0.0355963     0.127497     0.00975823     0.0418696       10     
[art]:TriggerResults:TriggerResultInserter            1.7331e-05    2.64482e-05   8.2403e-05    1.85965e-05   1.90215e-05      10     
end_path:out1:RootOutput                               3.763e-06    9.3394e-06    2.5025e-05     7.499e-06    5.55611e-06      10     
end_path:out1:RootOutput(write)                        0.341282      0.401849      0.702165      0.371102      0.101133        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 14271.2 MB
  Peak resident set size usage (VmHWM): 3104.58 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
Completed MCParticle Loop
True Neutrino Energy: 50.7588
 Size of all hits: 38
hit initial : 32.9621 | hit correction : 1.03132
hit initial : 33.3967 | hit correction : 1.03081
hit initial : 41.6365 | hit correction : 1.03083
hit initial : 34.9228 | hit correction : 1.03458
hit initial : 69.7611 | hit correction : 1.03458
hit initial : 124.994 | hit correction : 1.03123
hit initial : 282.91 | hit correction : 1.03123
hit initial : 155.75 | hit correction : 1.03168
hit initial : 548.974 | hit correction : 1.03171
hit initial : 333.161 | hit correction : 1.03178
hit initial : 132.381 | hit correction : 1.03266
hit initial : 162.037 | hit correction : 1.0318
hit initial : 460.756 | hit correction : 1.03268
hit initial : 652.911 | hit correction : 1.03272
hit initial : 693.645 | hit correction : 1.03276
hit initial : 774.59 | hit correction : 1.03218
hit initial : 568.338 | hit correction : 1.03195
hit initial : 732.442 | hit correction : 1.0326
 *** Total Charge : 6023.79
 Looking at view: 0 | Number of hits in view: 18
hit initial : 86.6601 | hit correction : 1.0312
hit initial : 83.7677 | hit correction : 1.03121
hit initial : 215.317 | hit correction : 1.0312
hit initial : 65.8409 | hit correction : 1.03164
hit initial : 104.904 | hit correction : 1.03175
hit initial : 159.068 | hit correction : 1.03178
hit initial : 376.835 | hit correction : 1.03189
hit initial : 45.8896 | hit correction : 1.03268
hit initial : 241.238 | hit correction : 1.03267
hit initial : 373.131 | hit correction : 1.03269
hit initial : 348.386 | hit correction : 1.03271
hit initial : 338.71 | hit correction : 1.03275
hit initial : 323.54 | hit correction : 1.03279
hit initial : 307.414 | hit correction : 1.03278
hit initial : 465.136 | hit correction : 1.03222
hit initial : 318.489 | hit correction : 1.03265
hit initial : 129.03 | hit correction : 1.0317
hit initial : 361.403 | hit correction : 1.03187
hit initial : 509.627 | hit correction : 1.03206
hit initial : 357.594 | hit correction : 1.03249
 *** Total Charge : 5380.21
 Looking at view: 1 | Number of hits in view: 20
Begin processing the 9th record. run: 5026 subRun: 0 event: 25629 at 06-Dec-2025 15:01:30 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 3.72716
Completed MCParticle Loop
True Neutrino Energy: 7.0117
 Size of all hits: 0
Begin processing the 10th record. run: 5026 subRun: 0 event: 25630 at 06-Dec-2025 15:01:33 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  16
Added hit list length: 16 | Max was set to: -3.40282e+38
True Neutron Energy: 939.569
True Electron Energy: 10.9383
Completed MCParticle Loop
True Neutrino Energy: 17.1306
 Size of all hits: 16
hit initial : 25.6673 | hit correction : 1.34517
hit initial : 297.966 | hit correction : 1.34408
hit initial : 162.973 | hit correction : 1.34373
hit initial : 68.3432 | hit correction : 1.34606
hit initial : 68.723 | hit correction : 1.34496
hit initial : 44.9226 | hit correction : 1.34494
hit initial : 103.415 | hit correction : 1.34504
hit initial : 204.708 | hit correction : 1.34475
hit initial : 259.274 | hit correction : 1.34441
 *** Total Charge : 1661.8
 Looking at view: 1 | Number of hits in view: 9
hit initial : 39.4393 | hit correction : 1.34511
hit initial : 30.2511 | hit correction : 1.34351
hit initial : 480.991 | hit correction : 1.34453
hit initial : 106.873 | hit correction : 1.3435
hit initial : 399.963 | hit correction : 1.34432
hit initial : 43.0257 | hit correction : 1.34497
hit initial : 105.225 | hit correction : 1.34495
 *** Total Charge : 1621.05
 Looking at view: 2 | Number of hits in view: 7
06-Dec-2025 15:01:36 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0712539      0.09065      0.117963      0.0899622     0.0141356       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000351487   0.000498393   0.000918714   0.000459309   0.000149218      10     
end_path:ana:AnalyzeEvents         0.0706184     0.0899951     0.116558      0.0894585     0.0139843       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 11961.6 MB
  Peak resident set size usage (VmHWM): 1543.27 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 19:08:57 UTC       justIN version: 01.06.00