justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 267022.1@dunegpschedd01.fnal.gov

Jobsub ID267022.1@dunegpschedd01.fnal.gov
Workflow ID11115
Stage ID1
User nameosbiston@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-11 21:26:36
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2025-12-12 02:52:58
From worker nodeHostnamedunegli-8035306-0-fnpc19118.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-11 21:27:55
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T213307Z_gen_004185_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time5h (19479s)
CPU time5h (19319s = 99%)
Max RSS bytes2913079296 (2778 MiB)
Outputting started2025-12-12 02:52:35
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/11115/1/001/analysisLowE_20251211T212756Z.root
Finished2025-12-12 02:52:58
Saved logsjustin-logs:267022.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ing to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  12-Dec-2025 02:51:35 UTC run: 5026 subRun: 0 event: 41850
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 6945, 6825, 6672
minwire 0: 29
minwire 1: 1
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1650, 2149
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0824283, 
Output 1: 0.0580379, 0.0458321, 0.113338, 0.782792, 
Output 2: 0.0625382, 0.253644, 0.658844, 0.0249737, 
Output 3: 0.945711, 0.040511, 0.00610422, 0.00767402, 
Output 4: 0.307585, 0.546061, 0.131747, 0.0146076, 
Output 5: 0.79495, 0.185633, 0.0165194, 0.00289703, 
Output 6: 0.0226264, 0.070409, 0.0799129, 0.827052, 

12-Dec-2025 02:51:38 UTC  Closed output file "matt_reco2.root"
12-Dec-2025 02:51:38 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/c0/2a/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T213307Z_gen_004185_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1870.05       1929.92       1999.93       1922.82       38.688         10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00141616    0.00810976     0.0212126    0.00409188    0.00705101       10     
reco:pandora:StandardPandora                            1868.17       1927.78       1998.02       1920.9        38.3411        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.00141631     0.0227755     0.0768352     0.0128448     0.0252132       10     
reco:pandoraShower:LArPandoraModularShowerCreation     0.0016553    0.00498325     0.0183348    0.00360002    0.00460895       10     
reco:pandoracalo:Calorimetry                          0.000329272    0.0108502     0.0490137    0.00209594     0.016146        10     
reco:pandorapid:Chi2ParticleID                         7.785e-05    0.000297669   0.00141723    0.000134801   0.000388202      10     
reco:cvnmap:CVNMapper                                  0.0310759     0.0382872     0.0580079     0.0353149    0.00792897       10     
reco:cvneva:CVNEvaluator                                1.23808       1.48235       3.46561       1.26305      0.661173        10     
reco:energyrecnumu:EnergyReco                         0.00560856     0.0507545     0.111917      0.0407308     0.0411897       10     
reco:energyrecnue:EnergyReco                          0.00135982    0.00534835     0.0118423    0.00251352     0.0045037       10     
reco:energyrecnc:EnergyReco                           0.00752168     0.070301       0.1441        0.09086      0.052541        10     
[art]:TriggerResults:TriggerResultInserter             1.223e-05    2.86863e-05   0.000111791   1.97205e-05   2.79849e-05      10     
end_path:out1:RootOutput                               6.98e-06     1.1808e-05     3.506e-05     8.255e-06    8.37962e-06      10     
end_path:out1:RootOutput(write)                        0.389034      0.438029      0.521963      0.430581      0.0371351       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21677.7 MB
  Peak resident set size usage (VmHWM): 2913.08 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
=== Start last 100 lines of lar log file ===
hit initial : 159.565 | hit correction : 1.38128
 *** Total Charge : 3889.24
 Looking at view: 2 | Number of hits in view: 23
Begin processing the 9th record. run: 5026 subRun: 0 event: 41849 at 12-Dec-2025 02:52:27 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Electron Energy: 44.8254
Completed MCParticle Loop
True Neutrino Energy: 58.9039
 Size of all hits: 0
Begin processing the 10th record. run: 5026 subRun: 0 event: 41850 at 12-Dec-2025 02:52:31 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  3
This pfp has size:  56
Added hit list length: 56 | Max was set to: -3.40282e+38
True Neutron Energy: 939.576
True Electron Energy: 58.3184
Completed MCParticle Loop
True Neutrino Energy: 63.7454
 Size of all hits: 56
hit initial : 44.0133 | hit correction : 1.07398
hit initial : 106.014 | hit correction : 1.0718
hit initial : 42.6945 | hit correction : 1.07394
hit initial : 51.8633 | hit correction : 1.07332
hit initial : 241.594 | hit correction : 1.07177
hit initial : 45.2563 | hit correction : 1.07334
hit initial : 97.1285 | hit correction : 1.07174
hit initial : 63.3538 | hit correction : 1.06942
hit initial : 434.248 | hit correction : 1.07398
hit initial : 327.817 | hit correction : 1.07452
hit initial : 308.353 | hit correction : 1.07526
hit initial : 50.1903 | hit correction : 1.07575
hit initial : 64.7366 | hit correction : 1.0759
hit initial : 523.845 | hit correction : 1.07658
hit initial : 68.9199 | hit correction : 1.07662
hit initial : 58.6679 | hit correction : 1.07732
hit initial : 110.187 | hit correction : 1.07734
hit initial : 607.726 | hit correction : 1.07794
hit initial : 92.2993 | hit correction : 1.07837
hit initial : 104.279 | hit correction : 1.07845
 *** Total Charge : 3702.75
 Looking at view: 0 | Number of hits in view: 20
hit initial : 59.2087 | hit correction : 1.0718
hit initial : 11.1671 | hit correction : 1.07112
hit initial : 30.2606 | hit correction : 1.07345
hit initial : 234.93 | hit correction : 1.07177
hit initial : 21.6734 | hit correction : 1.07111
hit initial : 219.972 | hit correction : 1.07392
hit initial : 48.5596 | hit correction : 1.07332
hit initial : 127.51 | hit correction : 1.07175
hit initial : 102.841 | hit correction : 1.07564
hit initial : 514.785 | hit correction : 1.07402
hit initial : 28.7405 | hit correction : 1.0733
hit initial : 114.7 | hit correction : 1.07398
hit initial : 29.0621 | hit correction : 1.07527
hit initial : 22.3825 | hit correction : 1.07576
hit initial : 618.459 | hit correction : 1.07763
hit initial : 588.725 | hit correction : 1.07866
hit initial : 104.584 | hit correction : 1.07892
hit initial : 16.7012 | hit correction : 1.0796
hit initial : 88.4037 | hit correction : 1.08013
 *** Total Charge : 3208.65
 Looking at view: 1 | Number of hits in view: 19
hit initial : 245.442 | hit correction : 1.07186
hit initial : 188.976 | hit correction : 1.07165
hit initial : 277.44 | hit correction : 1.07339
hit initial : 17.4748 | hit correction : 1.07391
hit initial : 13.4669 | hit correction : 1.07324
hit initial : 456.354 | hit correction : 1.07394
hit initial : 268.785 | hit correction : 1.0743
hit initial : 311.375 | hit correction : 1.07486
hit initial : 578.362 | hit correction : 1.07582
hit initial : 39.8665 | hit correction : 1.07597
hit initial : 459.961 | hit correction : 1.0771
hit initial : 390.505 | hit correction : 1.07776
hit initial : 363.134 | hit correction : 1.07853
hit initial : 337.807 | hit correction : 1.07918
hit initial : 371.077 | hit correction : 1.0797
hit initial : 222.168 | hit correction : 1.08029
hit initial : 17.9432 | hit correction : 1.08049
 *** Total Charge : 4907.8
 Looking at view: 2 | Number of hits in view: 17
12-Dec-2025 02:52:35 UTC  Closed input file "matt_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0906434     0.113473      0.141925      0.112453      0.014752        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000441144   0.000706919    0.0014191    0.000631765   0.00027447       10     
end_path:ana:AnalyzeEvents         0.0895798      0.11258      0.140061      0.111819      0.0145989       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19476.6 MB
  Peak resident set size usage (VmHWM): 1535.77 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-07 15:00:04 UTC       justIN version: 01.06.00