Skip to content

Commit

Permalink
NPUW: Unfold - eliminate copy in the unfold path
Browse files Browse the repository at this point in the history
  • Loading branch information
dmatveev committed Oct 31, 2024
1 parent 016559b commit 57ff3b4
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -150,7 +150,7 @@ void ov::npuw::UnfoldInferRequest::prepare(std::size_t idx) {
const auto& g_tnsr = m_port_to_tensor.at(g_port).tensor;
const auto& s_port = subr->get_inputs()[sub_in_idx];

if (do_copy || m_input_allocated.count(g_tnsr->data()) == 0) {
if (m_input_allocated.count(g_tnsr->data()) == 0 && do_copy) {
copy_list.emplace_back(g_tnsr, s_port);
} else {
subr->set_tensor(s_port, g_tnsr);
Expand Down

0 comments on commit 57ff3b4

Please sign in to comment.