Code

NPUW: Unfold infer requests#27319

Code

Merged

dmatveev merged 15 commits intoopenvinotoolkit:masteropenvinotoolkit/openvino:masterfrom dmatveev:dm/npuw_unfolddmatveev/openvino:dm/npuw_unfoldCopy head branch name to clipboardNov 21, 2024

+621-352

Commits

Commits on Oct 31, 2024

• NPUW: Eliminate unnecessary kvcache tensors copy

  dmatveev

  committed
  7c97bc4

  Copy full SHA for 7c97bc4

• NPUW: Unfold infer reqests mode

  dmatveev

  committed
  e8ebefe

  Copy full SHA for e8ebefe

• NPUW Unfold: Make is async if FUNCALL_ASYNC is set

  dmatveev

  committed
  016559b

  Copy full SHA for 016559b

• NPUW: Unfold - eliminate copy in the unfold path

  dmatveev

  committed
  57ff3b4

  Copy full SHA for 57ff3b4

• NPUW Unfold: fix async submission order + mask copies

  dmatveev

  committed
  d2afadf

  Copy full SHA for d2afadf

Commits on Nov 1, 2024

• Merge branch 'master' into dm/npuw_unfold

  dmatveev

  committed
  37dea83

  Copy full SHA for 37dea83

• NPUW Unfold: Refactoring 1 - Move what's easy movable

  Show description for 48ca0f4
  dmatveev

  committed
  48ca0f4

  Copy full SHA for 48ca0f4

• NPUW Unfold - refactoring 2 - more generalization

  dmatveev

  committed
  1d18b0d

  Copy full SHA for 1d18b0d

Commits on Nov 2, 2024

• NPUW Unfold: Refactoring 3 - move bind params/results to base

  dmatveev

  committed
  7ff3536

  Copy full SHA for 7ff3536

Commits on Nov 14, 2024

• Merge branch 'master' of github.com:openvinotoolkit/openvino into dm/npuw_unfold

  dmatveev

  committed
  26fd8e4

  Copy full SHA for 26fd8e4

Commits on Nov 18, 2024

• NPUW Unfold: final clean-up

  dmatveev

  committed
  18724e0

  Copy full SHA for 18724e0

• NPUW Unfold: Fix clang-format

  dmatveev

  committed
  3e68851

  Copy full SHA for 3e68851

Commits on Nov 20, 2024

• Merge branch 'master' into dm/npuw_unfold

  dmatveev

  authored
  35b1cfe

  Copy full SHA for 35b1cfe

• NPUW Unfold - fix precommit issues

  dmatveev

  committed
  9eb350e

  Copy full SHA for 9eb350e

Commits on Nov 21, 2024

• Merge branch 'master' into dm/npuw_unfold

  dmatveev

  authored
  1bddf7e

  Copy full SHA for 1bddf7e