justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297985.122@dunegpschedd02.fnal.gov

Jobsub ID297985.122@dunegpschedd02.fnal.gov
Workflow ID12719
Stage ID2
User nameykermaid@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2026-02-04 00:50:30
SiteUS_BNL
EntryDUNE_US_BNL_spoolce01
Last heartbeat2026-02-04 02:06:35
From worker nodeHostnamespool0258.sdcc.bnl.gov
cpuinfoAMD EPYC 7351 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-04 01:21:12
Input filesusertests:np02vd_raw_run042433_0552_df-s04-d0_dw_0_20260203T221155_reco_stage0_20260204T003843_offline.root
JobscriptExit code0
Real time43m (2603s)
CPU time40m (2424s = 93%)
Max RSS bytes1359355904 (1296 MiB)
Outputting started2026-02-04 02:04:35
Output filesusertests:np02vd_raw_run042433_0552_df-s04-d0_dw_0_20260203T221155_reco_stage0_20260204T003843_offline_reco_stage1_20260204T020422_offline.root
usertests:np02vd_raw_run042433_0552_df-s04-d0_dw_0_20260203T221155_reco_stage0_20260204T003843_offline_reco_stage1_20260204T020422_offline_larcv.root
Finished2026-02-04 02:06:35
Saved logsjustin-logs:297985.122-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

[DEBUG]  <IOManager::set_id> IOManager.cxx::L593 Updating event id for product sparse3d by reco_hit_key1
     [DEBUG]  <IOManager::set_id> IOManager.cxx::L593 Updating event id for product sparse3d by reco_hit_key2
     [DEBUG]  <IOManager::save_entry> IOManager.cxx::L416 Saving sparse3d_reco_tree entry 18
     [DEBUG]  <IOManager::save_entry> IOManager.cxx::L416 Saving sparse3d_reco_chi2_tree entry 18
     [DEBUG]  <IOManager::save_entry> IOManager.cxx::L416 Saving sparse3d_reco_cryo_tree entry 18
     [DEBUG]  <IOManager::save_entry> IOManager.cxx::L416 Saving sparse3d_reco_tpc_tree entry 18
     [DEBUG]  <IOManager::save_entry> IOManager.cxx::L416 Saving sparse3d_reco_hit_charge0_tree entry 18
     [DEBUG]  <IOManager::save_entry> IOManager.cxx::L416 Saving sparse3d_reco_hit_charge1_tree entry 18
     [DEBUG]  <IOManager::save_entry> IOManager.cxx::L416 Saving sparse3d_reco_hit_charge2_tree entry 18
     [DEBUG]  <IOManager::save_entry> IOManager.cxx::L416 Saving sparse3d_reco_hit_key0_tree entry 18
     [DEBUG]  <IOManager::save_entry> IOManager.cxx::L416 Saving sparse3d_reco_hit_key1_tree entry 18
     [DEBUG]  <IOManager::save_entry> IOManager.cxx::L416 Saving sparse3d_reco_hit_key2_tree entry 18
     [DEBUG]  <IOManager::clear_entry> IOManager.cxx::L460 Set _last_event_id to externally set values: run = 42433 subrun = 1 event = 63046
03-Feb-2026 21:04:22 EST  Closed output file "np02vd_raw_run042433_0552_df-s04-d0_dw_0_20260203T221155_reco_stage0_20260204T003843_offline_reco_stage1_20260204T020422_offline.root"
03-Feb-2026 21:04:22 EST  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/c2/ee/np02vd_raw_run042433_0552_df-s04-d0_dw_0_20260203T221155_reco_stage0_20260204T003843_offline.root"
     [DEBUG]  <ProcessDriver::finalize> ProcessDriver.cxx::L424 called
      [INFO]  <ProcessDriver::finalize::L427> Finalizing: SuperaBBoxInteraction
      [INFO]  <ProcessDriver::finalize::L427> Finalizing: SuperaSpacePoint
      [INFO]  <ProcessDriver::finalize::L434> Compiling time profile...
      [INFO]  <ProcessDriver::finalize::L457> Finalizing IO...
     [DEBUG]  <IOManager::finalize> IOManager.cxx::L611 start
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_tree with 19 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_chi2_tree with 19 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_cryo_tree with 19 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_tpc_tree with 19 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_charge0_tree with 19 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_charge1_tree with 19 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_charge2_tree with 19 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_key0_tree with 19 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_key1_tree with 19 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_key2_tree with 19 entries
    [NORMAL]  <IOManager::finalize> Closing output file
      [INFO]  <IOManager::finalize::L639> Deleting data pointers
     [DEBUG]  <IOManager::reset> IOManager.cxx::L647 start
      [INFO]  <ProcessDriver::finalize::L459> Resetting...
     [DEBUG]  <ProcessDriver::reset> ProcessDriver.cxx::L25 Called
     [DEBUG]  <IOManager::reset> IOManager.cxx::L647 start

===========================================================================================================================================
TimeTracker printout (sec)                                   Min           Avg           Max         Median          RMS         nEvts   
===========================================================================================================================================
Full event                                                  69.11        129.146       273.678       117.053       47.8738        19     
-------------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                   0.00103688     0.0109132     0.0613495    0.00136148     0.0191234       19     
produce:opflash:OpFlashFinderVerticalDrift                0.0762307     0.129433      0.190442      0.132145      0.0232985       19     
produce:pandora:StandardPandora                            64.7909       120.651       255.036       108.936       45.1436        19     
produce:pandoraWriter:StandardPandora                      0.18774      0.243004      0.332905      0.233853      0.0402587       19     
produce:pandoraTrack:LArPandoraTrackCreation               2.05707       4.42926       11.6128       3.57795       2.21654        19     
produce:pandoraShower:LArPandoraModularShowerCreation     0.343147      0.522121       0.70477       0.51242      0.116285        19     
produce:pandoraGnocalo:GnocchiCalorimetry                 0.0462158     0.0713659     0.102893      0.0655827     0.0177391       19     
produce:pandorapid:Chi2ParticleID                        0.00297082    0.00514415    0.00789992    0.00458159    0.00130806       19     
[art]:TriggerResults:TriggerResultInserter                1.812e-05    2.62955e-05    6.341e-05    2.4471e-05    8.97545e-06      19     
end_path:out1:RootOutput                                  4.56e-06      9.349e-06    3.2911e-05     8.39e-06     5.63677e-06      19     
end_path:supera:LArSoftSuperaDriver                        1.0637        2.49951       4.83233       2.13774      0.971801        19     
end_path:out1:RootOutput(write)                           0.319549      0.528237      0.875586      0.496421      0.135975        19     
===========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2475.26 MB
  Peak resident set size usage (VmHWM): 1342.96 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0552_df-s04-d0_dw_0_20260203T221155_reco_stage0_20260204T003843_offline_reco_stage1_20260204T020422_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0552_df-s04-d0_dw_0_20260203T221155_reco_stage0_20260204T003843_offline_reco_stage1_20260204T020422_offline.root
Ran successfully
{
  "name": "np02vd_raw_run042433_0552_df-s04-d0_dw_0_20260203T221155_reco_stage0_20260204T003843_offline_reco_stage1_20260204T020422_offline.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_17_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_offline.fcl",
    "dune.campaign": "vd-protodune-det-reco-test",
    "core.start_time": 1770168094.0,
    "core.end_time": 1770170663.0,
    "core.events": [
      62938,
      62944,
      62950,
      62956,
      62962,
      62968,
      62974,
      62980,
      62986,
      62992,
      62998,
      63004,
      63010,
      63016,
      63022,
      63028,
      63034,
      63040,
      63046
    ],
    "core.event_count": 19,
    "core.first_event_number": 62938,
    "core.last_event_number": 63046,
    "core.data_stream": "cosmics",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      42433
    ],
    "core.runs_subruns": [
      4243300001
    ]
  },
  "parents": [
    {
      "did": "usertests:np02vd_raw_run042433_0552_df-s04-d0_dw_0_20260203T221155_reco_stage0_20260204T003843_offline.root"
    }
  ]
}\tLArCV: np02vd_raw_run042433_0552_df-s04-d0_dw_0_20260203T221155_reco_stage0_20260204T003843_offline_reco_stage1_20260204T020422_offline_larcv.root
Forming larcv metadata
formed
{
  "name": "np02vd_raw_run042433_0552_df-s04-d0_dw_0_20260203T221155_reco_stage0_20260204T003843_offline_reco_stage1_20260204T020422_offline_larcv.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_17_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_offline.fcl",
    "dune.campaign": "vd-protodune-det-reco-test",
    "core.start_time": 1770168094.0,
    "core.end_time": 1770170663.0,
    "core.data_stream": "cosmics",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      42433
    ],
    "core.runs_subruns": [
      4243300001
    ]
  },
  "parents": [
    {
      "did": "usertests:np02vd_raw_run042433_0552_df-s04-d0_dw_0_20260203T221155_reco_stage0_20260204T003843_offline.root"
    }
  ]
}
justIN time: 2026-02-04 04:31:50 UTC       justIN version: 01.06.00