justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 293523.3@dunegpschedd02.fnal.gov

Jobsub ID293523.3@dunegpschedd02.fnal.gov
Workflow ID12228
Stage ID1
User nameykermaid@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit3600 (1 hours)
Submitted time2026-01-22 11:20:57
SiteUS_UChicago
EntryEngage_US_MWT2_uct2_condce_mcore
Last heartbeat2026-01-22 11:38:40
From worker nodeHostnameuct2-c546.mwt2.org
cpuinfoAMD EPYC 7402 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit86400 (24 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-22 11:22:23
Input filesusertests:np02vd_raw_run039305_0016_df-s05-d3_dw_0_20250904T144801_reco_stage0_20260121T155056_offline.root
JobscriptExit code0
Real time14m (880s)
CPU time13m (833s = 94%)
Max RSS bytes1416765440 (1351 MiB)
Outputting started2026-01-22 11:37:05
Output filesusertests:np02vd_raw_run039305_0016_df-s05-d3_dw_0_20250904T144801_reco_stage0_20260121T155056_offline_reco_stage1_20260122T113653_offline.root
usertests:np02vd_raw_run039305_0016_df-s05-d3_dw_0_20250904T144801_reco_stage0_20260121T155056_offline_reco_stage1_20260122T113653_offline_larcv.root
Finished2026-01-22 11:38:40
Saved logsjustin-logs:293523.3-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

[DEBUG]  <IOManager::save_entry> IOManager.cxx::L416 Saving sparse3d_reco_chi2_tree entry 48
     [DEBUG]  <IOManager::save_entry> IOManager.cxx::L416 Saving sparse3d_reco_cryo_tree entry 48
     [DEBUG]  <IOManager::save_entry> IOManager.cxx::L416 Saving sparse3d_reco_tpc_tree entry 48
     [DEBUG]  <IOManager::save_entry> IOManager.cxx::L416 Saving sparse3d_reco_hit_charge0_tree entry 48
     [DEBUG]  <IOManager::save_entry> IOManager.cxx::L416 Saving sparse3d_reco_hit_charge1_tree entry 48
     [DEBUG]  <IOManager::save_entry> IOManager.cxx::L416 Saving sparse3d_reco_hit_charge2_tree entry 48
     [DEBUG]  <IOManager::save_entry> IOManager.cxx::L416 Saving sparse3d_reco_hit_key0_tree entry 48
     [DEBUG]  <IOManager::save_entry> IOManager.cxx::L416 Saving sparse3d_reco_hit_key1_tree entry 48
     [DEBUG]  <IOManager::save_entry> IOManager.cxx::L416 Saving sparse3d_reco_hit_key2_tree entry 48
     [DEBUG]  <IOManager::clear_entry> IOManager.cxx::L460 Set _last_event_id to externally set values: run = 39305 subrun = 1 event = 16397
22-Jan-2026 05:36:53 CST  Closed output file "np02vd_raw_run039305_0016_df-s05-d3_dw_0_20250904T144801_reco_stage0_20260121T155056_offline_reco_stage1_20260122T113653_offline.root"
22-Jan-2026 05:36:53 CST  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/b9/82/np02vd_raw_run039305_0016_df-s05-d3_dw_0_20250904T144801_reco_stage0_20260121T155056_offline.root"
     [DEBUG]  <ProcessDriver::finalize> ProcessDriver.cxx::L424 called
      [INFO]  <ProcessDriver::finalize::L427> Finalizing: SuperaBBoxInteraction
      [INFO]  <ProcessDriver::finalize::L427> Finalizing: SuperaSpacePoint
      [INFO]  <ProcessDriver::finalize::L434> Compiling time profile...
      [INFO]  <ProcessDriver::finalize::L457> Finalizing IO...
     [DEBUG]  <IOManager::finalize> IOManager.cxx::L611 start
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_tree with 49 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_chi2_tree with 49 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_cryo_tree with 49 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_tpc_tree with 49 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_charge0_tree with 49 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_charge1_tree with 49 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_charge2_tree with 49 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_key0_tree with 49 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_key1_tree with 49 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_key2_tree with 49 entries
    [NORMAL]  <IOManager::finalize> Closing output file
      [INFO]  <IOManager::finalize::L639> Deleting data pointers
     [DEBUG]  <IOManager::reset> IOManager.cxx::L647 start
      [INFO]  <ProcessDriver::finalize::L459> Resetting...
     [DEBUG]  <ProcessDriver::reset> ProcessDriver.cxx::L25 Called
     [DEBUG]  <IOManager::reset> IOManager.cxx::L647 start

===========================================================================================================================================
TimeTracker printout (sec)                                   Min           Avg           Max         Median          RMS         nEvts   
===========================================================================================================================================
Full event                                                 5.7043        16.6757       66.3654       12.6101       11.0328        49     
-------------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                   0.000412244   0.00316945     0.0253263    0.000792981   0.00568615       49     
produce:opflash:OpFlashFinderVerticalDrift                0.0142152     0.030867      0.0493084     0.0325589    0.00744905       49     
produce:pandora:StandardPandora                            4.15097       13.6189       57.4745       10.1453       9.55154        49     
produce:pandoraWriter:StandardPandora                     0.0470347     0.0893769     0.164916      0.0886109     0.0216533       49     
produce:pandoraTrack:LArPandoraTrackCreation              0.0899136      0.26008      0.806037      0.228686      0.130353        49     
produce:pandoraShower:LArPandoraModularShowerCreation      0.12244      0.269547      0.485539      0.242984      0.0926113       49     
produce:pandoraGnocalo:GnocchiCalorimetry                0.00887673     0.0224446     0.0405714     0.0214245     0.0069095       49     
produce:pandorapid:Chi2ParticleID                        0.000651174   0.00102412    0.00243795    0.000964122   0.000296808      49     
[art]:TriggerResults:TriggerResultInserter                1.107e-05    2.17297e-05   5.6346e-05    2.0969e-05    8.05792e-06      49     
end_path:out1:RootOutput                                  3.416e-06    7.48663e-06    2.622e-05     6.963e-06    3.34798e-06      49     
end_path:supera:LArSoftSuperaDriver                       0.414351       2.15919       6.94973       2.00813       1.44857        49     
end_path:out1:RootOutput(write)                           0.0877975     0.202491      0.370887      0.198683      0.0582155       49     
===========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2549.49 MB
  Peak resident set size usage (VmHWM): 1416.77 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039305_0016_df-s05-d3_dw_0_20250904T144801_reco_stage0_20260121T155056_offline_reco_stage1_20260122T113653_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run039305_0016_df-s05-d3_dw_0_20250904T144801_reco_stage0_20260121T155056_offline_reco_stage1_20260122T113653_offline.root
Ran successfully
{
  "name": "np02vd_raw_run039305_0016_df-s05-d3_dw_0_20250904T144801_reco_stage0_20260121T155056_offline_reco_stage1_20260122T113653_offline.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_17_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_beam.fcl",
    "dune.campaign": "vd-protodune-det-reco-test",
    "core.start_time": 1769080958.0,
    "core.end_time": 1769081814.0,
    "core.events": [
      15437,
      15457,
      15477,
      15497,
      15517,
      15537,
      15557,
      15577,
      15597,
      15617,
      15637,
      15657,
      15677,
      15697,
      15717,
      15737,
      15757,
      15777,
      15797,
      15817,
      15837,
      15857,
      15877,
      15897,
      15917,
      15937,
      15957,
      15977,
      15997,
      16017,
      16037,
      16057,
      16077,
      16097,
      16117,
      16137,
      16157,
      16177,
      16197,
      16217,
      16237,
      16257,
      16277,
      16297,
      16317,
      16337,
      16357,
      16377,
      16397
    ],
    "core.event_count": 49,
    "core.first_event_number": 15437,
    "core.last_event_number": 16397,
    "core.data_stream": "physics",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39305
    ],
    "core.runs_subruns": [
      3930500001
    ]
  },
  "parents": [
    {
      "did": "usertests:np02vd_raw_run039305_0016_df-s05-d3_dw_0_20250904T144801_reco_stage0_20260121T155056_offline.root"
    }
  ]
}\tLArCV: np02vd_raw_run039305_0016_df-s05-d3_dw_0_20250904T144801_reco_stage0_20260121T155056_offline_reco_stage1_20260122T113653_offline_larcv.root
Forming larcv metadata
formed
{
  "name": "np02vd_raw_run039305_0016_df-s05-d3_dw_0_20250904T144801_reco_stage0_20260121T155056_offline_reco_stage1_20260122T113653_offline_larcv.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_17_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_beam.fcl",
    "dune.campaign": "vd-protodune-det-reco-test",
    "core.start_time": 1769080958.0,
    "core.end_time": 1769081814.0,
    "core.data_stream": "physics",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39305
    ],
    "core.runs_subruns": [
      3930500001
    ]
  },
  "parents": [
    {
      "did": "usertests:np02vd_raw_run039305_0016_df-s05-d3_dw_0_20250904T144801_reco_stage0_20260121T155056_offline.root"
    }
  ]
}
justIN time: 2026-02-04 07:16:31 UTC       justIN version: 01.06.00