justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 279166.1@dunegpschedd01.fnal.gov

Jobsub ID279166.1@dunegpschedd01.fnal.gov
Workflow ID11963
Stage ID1
User nameykermaid@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit3600 (1 hours)
Submitted time2026-01-15 14:21:56
SiteNL_SURFsara
EntryDUNE_SurfSARA_arc02
Last heartbeat2026-01-15 15:07:43
From worker nodeHostnamewn-da-01.gina.surf.nl
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-15 14:24:02
Input filesvd-protodune-det-reco:np02vd_raw_run039350_0735_df-s04-d2_dw_0_20250910T054753_reco_stage1_20250910T084724_keepup.root
JobscriptExit code0
Real time42m (2571s)
CPU time42m (2543s = 98%)
Max RSS bytes4215087104 (4019 MiB)
Outputting started2026-01-15 15:06:54
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/fnal/11963/1/001/np02vd_raw_run039350_0735_df-s04-d2_dw_0_20250910T054753_reco_stage1_20250910T084724_keepup_20260115T150644_reproc.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/ykermaid/fnal/11963/1/001/np02vd_raw_run039350_0735_df-s04-d2_dw_0_20250910T054753_reco_stage1_20250910T084724_keepup_reco_stage1_20260115T150644_keepup_hists.root
Finished2026-01-15 15:07:43
Saved logsjustin-logs:279166.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

CET run: 39350 subRun: 1 event: 53918
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  15-Jan-2026 16:06:43 CET run: 39350 subRun: 1 event: 53918
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  15-Jan-2026 16:06:43 CET run: 39350 subRun: 1 event: 53918
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  15-Jan-2026 16:06:43 CET run: 39350 subRun: 1 event: 53918
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  15-Jan-2026 16:06:43 CET run: 39350 subRun: 1 event: 53918
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  15-Jan-2026 16:06:43 CET run: 39350 subRun: 1 event: 53918
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  15-Jan-2026 16:06:43 CET run: 39350 subRun: 1 event: 53918
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  15-Jan-2026 16:06:43 CET run: 39350 subRun: 1 event: 53918
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  15-Jan-2026 16:06:43 CET run: 39350 subRun: 1 event: 53918
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  15-Jan-2026 16:06:43 CET run: 39350 subRun: 1 event: 53918
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  15-Jan-2026 16:06:43 CET run: 39350 subRun: 1 event: 53918
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  15-Jan-2026 16:06:43 CET run: 39350 subRun: 1 event: 53918
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  15-Jan-2026 16:06:43 CET run: 39350 subRun: 1 event: 53918
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  15-Jan-2026 16:06:43 CET run: 39350 subRun: 1 event: 53918
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  15-Jan-2026 16:06:43 CET run: 39350 subRun: 1 event: 53918
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  15-Jan-2026 16:06:43 CET run: 39350 subRun: 1 event: 53918
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  15-Jan-2026 16:06:43 CET run: 39350 subRun: 1 event: 53918
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  15-Jan-2026 16:06:43 CET run: 39350 subRun: 1 event: 53918
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  15-Jan-2026 16:06:43 CET run: 39350 subRun: 1 event: 53918
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
15-Jan-2026 16:06:44 CET  Closed output file "np02vd_raw_run039350_0735_df-s04-d2_dw_0_20250910T054753_reco_stage1_20250910T084724_keepup_20260115T150644_reproc.root"
15-Jan-2026 16:06:44 CET  Closed input file "root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/vd-protodune-det-reco/02/fe/np02vd_raw_run039350_0735_df-s04-d2_dw_0_20250910T054753_reco_stage1_20250910T084724_keepup.root"

===========================================================================================================================================
TimeTracker printout (sec)                                   Min           Avg           Max         Median          RMS         nEvts   
===========================================================================================================================================
Full event                                                 68.2652       131.26        168.941       129.301       22.0181        19     
-------------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                   0.00130432    0.00460989     0.0220101      0.00283     0.00537124       19     
produce:wclsdatavd:WireCellToolkit                         68.2481       95.1013       106.753       96.903        8.08719        19     
produce:gaushit:GausHitFinder                            0.00120871      1.11162       1.88561       1.11493      0.411829        19     
produce:nhitsfilter:NumberOfHitsFilter                   1.6742e-05    0.000303825   0.000623204   0.000272248   0.00011809       19     
produce:reco3d:SpacePointSolver                          7.6245e-05      10.638        19.4852       10.459        4.13706        19     
produce:hitpdune:DisambigFromSpacePoints                 0.000467397    0.153499       0.32051      0.140704      0.0655513       19     
produce:pandora:StandardPandora                          0.000811341     22.4449       41.7525        20.72        10.024         19     
produce:pandoraWriter:StandardPandora                    0.000115929   0.00236935    0.00567588    0.00172114    0.00158889       19     
produce:pandoraTrack:LArPandoraTrackCreation             0.000108235    0.952864       1.86377      0.798084      0.464897        19     
produce:pandoraShower:LArPandoraModularShowerCreation    0.000165584    0.344718       0.59155      0.329369      0.120771        19     
produce:pandoraGnocalo:GnocchiCalorimetry                0.000112293    0.0303391     0.0503988     0.0298517     0.0101098       19     
produce:pandorapid:Chi2ParticleID                        3.8193e-05    0.00128357    0.00281413    0.00120807    0.000492513      19     
[art]:TriggerResults:TriggerResultInserter               1.5649e-05    1.97597e-05   4.4284e-05    1.6642e-05    7.15037e-06      19     
end_path:out1:RootOutput                                  3.368e-06    4.92042e-06   1.6781e-05     4.348e-06    2.8161e-06       19     
end_path:out1:RootOutput(write)                          0.000525137    0.416315      0.682421      0.410482      0.136021        19     
===========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5334.78 MB
  Peak resident set size usage (VmHWM): 4215.09 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039350_0735_df-s04-d2_dw_0_20250910T054753_reco_stage1_20250910T084724_keepup_20260115T150644_reproc.root
Forming reco metadata
Successfully opened file np02vd_raw_run039350_0735_df-s04-d2_dw_0_20250910T054753_reco_stage1_20250910T084724_keepup_20260115T150644_reproc.root
Ran successfully
{
  "name": "np02vd_raw_run039350_0735_df-s04-d2_dw_0_20250910T054753_reco_stage1_20250910T084724_keepup_20260115T150644_reproc.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_16_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_offline_reproc.fcl",
    "dune.campaign": "vd-protodune-det-reco",
    "core.start_time": 1768487055.0,
    "core.end_time": 1768489605.0,
    "core.events": [
      53846,
      53850,
      53854,
      53858,
      53862,
      53866,
      53870,
      53874,
      53878,
      53882,
      53886,
      53890,
      53894,
      53898,
      53902,
      53906,
      53910,
      53914,
      53918
    ],
    "core.event_count": 19,
    "core.first_event_number": 53846,
    "core.last_event_number": 53918,
    "core.data_stream": "cosmics",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39350
    ],
    "core.runs_subruns": [
      3935000001
    ]
  },
  "parents": [
    {
      "did": "vd-protodune-det-reco:np02vd_raw_run039350_0735_df-s04-d2_dw_0_20250910T054753_reco_stage1_20250910T084724_keepup.root"
    }
  ]
}
justIN time: 2026-02-06 00:50:21 UTC       justIN version: 01.06.00