Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[GPU] support for i16, u16, and u32 element types in remote tensors #27653

Merged
merged 1 commit into from
Nov 22, 2024
Merged

[GPU] support for i16, u16, and u32 element types in remote tensors #27653

merged 1 commit into from
Nov 22, 2024

Conversation

jade-cho
Copy link
Contributor

@jade-cho jade-cho commented Nov 21, 2024 •
edited by isanghao
Loading

Details:

  • Removed host memory data converting for user input/output tensors with data types i16, u16, or u32.
  • User tensors can now be directly used as plugin tensors without additional data conversion overhead.

Tickets:

  • 156709

@jade-cho
[GPU] Add support for i16, u16, and u32 element types in remote tenso…
85f408e 
…rs (openvinotoolkit#27573)

### Details:
- *Removed host memory data converting for user input/output tensors
with data types i16, u16, or u32.*
- *User tensors can now be directly used as plugin tensors without
additional data conversion overhead.*

### Tickets:
 - *156709*
@jade-cho jade-cho requested review from a team as code owners November 21, 2024 02:39
@github-actions github-actions bot added the category: GPU OpenVINO GPU plugin label Nov 21, 2024
@isanghao isanghao changed the title [GPU] Add support for i16, u16, and u32 element types in remote tenso… [GPU] support for i16, u16, and u32 element types in remote tensors Nov 21, 2024
@isanghao isanghao added this pull request to the merge queue Nov 22, 2024
Merged via the queue into openvinotoolkit:releases/2024/5 with commit d1e8956 Nov 22, 2024
150 checks passed
github-merge-queue bot pushed a commit that referenced this pull request Dec 4, 2024
@jade-cho
[GPU] Fix perf regression due to PR #27653 (#27899)
3085215 
### Details:
 - *Remove unecessary memory copy.*
 - *Tests already exists.*

### Tickets:
 - *158009*
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@isanghao isanghao isanghao approved these changes

@geunhwan geunhwan Awaiting requested review from geunhwan

Assignees
No one assigned
Labels
category: GPU OpenVINO GPU plugin
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@jade-cho @isanghao