justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 279798.1@dunegpschedd01.fnal.gov

Jobsub ID279798.1@dunegpschedd01.fnal.gov
Workflow ID11998
Stage ID1
User nameykermaid@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit3600 (1 hours)
Submitted time2026-01-17 11:38:21
SiteUS_FNAL-T1
EntryCMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat2026-01-17 11:50:24
From worker nodeHostnamedunegli-50253-0-cmswn5016.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-17 11:39:57
Input filesusertests:np02vd_raw_run039433_0381_df-s05-d3_dw_0_20250918T070041_reco_stage0_20260117T100136_beam.root
JobscriptExit code0
Real time9m (574s)
CPU time9m (565s = 98%)
Max RSS bytes907976704 (865 MiB)
Outputting started2026-01-17 11:49:32
Output filesusertests:np02vd_raw_run039433_0381_df-s05-d3_dw_0_20250918T070041_reco_stage0_20260117T100136_beam_reco_stage1_20260117T114928_beam.root
usertests:np02vd_raw_run039433_0381_df-s05-d3_dw_0_20250918T070041_reco_stage0_20260117T100136_beam_reco_stage1_20260117T114928_beam_hists.root
Finished2026-01-17 11:50:24
Saved logsjustin-logs:279798.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

der:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  17-Jan-2026 11:49:28 UTC run: 39433 subRun: 1 event: 109689
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  17-Jan-2026 11:49:28 UTC run: 39433 subRun: 1 event: 109689
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  17-Jan-2026 11:49:28 UTC run: 39433 subRun: 1 event: 109689
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  17-Jan-2026 11:49:28 UTC run: 39433 subRun: 1 event: 109689
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  17-Jan-2026 11:49:28 UTC run: 39433 subRun: 1 event: 109689
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  17-Jan-2026 11:49:28 UTC run: 39433 subRun: 1 event: 109689
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  17-Jan-2026 11:49:28 UTC run: 39433 subRun: 1 event: 109689
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  17-Jan-2026 11:49:28 UTC run: 39433 subRun: 1 event: 109689
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  17-Jan-2026 11:49:28 UTC run: 39433 subRun: 1 event: 109689
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  17-Jan-2026 11:49:28 UTC run: 39433 subRun: 1 event: 109689
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  17-Jan-2026 11:49:28 UTC run: 39433 subRun: 1 event: 109689
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  17-Jan-2026 11:49:28 UTC run: 39433 subRun: 1 event: 109689
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  17-Jan-2026 11:49:28 UTC run: 39433 subRun: 1 event: 109689
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  17-Jan-2026 11:49:28 UTC run: 39433 subRun: 1 event: 109689
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  17-Jan-2026 11:49:28 UTC run: 39433 subRun: 1 event: 109689
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  17-Jan-2026 11:49:28 UTC run: 39433 subRun: 1 event: 109689
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  17-Jan-2026 11:49:28 UTC run: 39433 subRun: 1 event: 109689
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  17-Jan-2026 11:49:28 UTC run: 39433 subRun: 1 event: 109689
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  17-Jan-2026 11:49:28 UTC run: 39433 subRun: 1 event: 109689
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  17-Jan-2026 11:49:28 UTC run: 39433 subRun: 1 event: 109689
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
17-Jan-2026 11:49:28 UTC  Closed output file "np02vd_raw_run039433_0381_df-s05-d3_dw_0_20250918T070041_reco_stage0_20260117T100136_beam_reco_stage1_20260117T114928_beam.root"
17-Jan-2026 11:49:28 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/bc/8f/np02vd_raw_run039433_0381_df-s05-d3_dw_0_20250918T070041_reco_stage0_20260117T100136_beam.root"

===========================================================================================================================================
TimeTracker printout (sec)                                   Min           Avg           Max         Median          RMS         nEvts   
===========================================================================================================================================
Full event                                                 1.66624       11.7576       147.855       5.32731       23.2522        47     
-------------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                   0.000225947   0.000863164    0.017657     0.000334091    0.0024996       47     
produce:opflash:OpFlashFinderVerticalDrift               0.00196814    0.00890501     0.0407966    0.00734447     0.0065989       47     
produce:pandora:StandardPandora                            1.48264       11.4911       147.248       5.03402       23.1853        47     
produce:pandoraTrack:LArPandoraTrackCreation              0.0272944     0.105566      0.347643      0.0963171     0.0580932       47     
produce:pandoraShower:LArPandoraModularShowerCreation     0.037278      0.0787932     0.131677      0.0787804     0.0195192       47     
produce:pandoraGnocalo:GnocchiCalorimetry                0.00290583    0.00571072    0.00874992    0.00554499    0.00131895       47     
[art]:TriggerResults:TriggerResultInserter                9.768e-06    1.19578e-05   3.5387e-05     1.098e-05    3.70499e-06      47     
end_path:out1:RootOutput                                  2.595e-06    3.71451e-06   1.3104e-05     3.266e-06    1.7623e-06       47     
end_path:out1:RootOutput(write)                           0.0333849     0.0612173     0.108668      0.0618378     0.0149933       47     
===========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1964.38 MB
  Peak resident set size usage (VmHWM): 915.526 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
ls: cannot access *_reproc.root: No such file or directory
Output files:
\tReco: np02vd_raw_run039433_0381_df-s05-d3_dw_0_20250918T070041_reco_stage0_20260117T100136_beam_reco_stage1_20260117T114928_beam.root
Forming reco metadata
Successfully opened file np02vd_raw_run039433_0381_df-s05-d3_dw_0_20250918T070041_reco_stage0_20260117T100136_beam_reco_stage1_20260117T114928_beam.root
Ran successfully
{
  "name": "np02vd_raw_run039433_0381_df-s05-d3_dw_0_20250918T070041_reco_stage0_20260117T100136_beam_reco_stage1_20260117T114928_beam.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_16_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_beam.fcl",
    "dune.campaign": "vd-protodune-det-reco-test",
    "core.start_time": 1768650003.0,
    "core.end_time": 1768650568.0,
    "core.events": [
      109413,
      109419,
      109425,
      109431,
      109437,
      109443,
      109449,
      109455,
      109461,
      109467,
      109473,
      109479,
      109485,
      109491,
      109497,
      109503,
      109509,
      109515,
      109521,
      109527,
      109533,
      109539,
      109545,
      109551,
      109557,
      109563,
      109569,
      109575,
      109581,
      109587,
      109593,
      109599,
      109605,
      109611,
      109617,
      109623,
      109629,
      109635,
      109641,
      109647,
      109653,
      109659,
      109665,
      109671,
      109677,
      109683,
      109689
    ],
    "core.event_count": 47,
    "core.first_event_number": 109413,
    "core.last_event_number": 109689,
    "core.data_stream": "cosmics",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39433
    ],
    "core.runs_subruns": [
      3943300001
    ]
  },
  "parents": [
    {
      "did": "usertests:np02vd_raw_run039433_0381_df-s05-d3_dw_0_20250918T070041_reco_stage0_20260117T100136_beam.root"
    }
  ]
}
justIN time: 2026-02-04 13:21:06 UTC       justIN version: 01.06.00