Skip to content

Issues: microsoft/onnxruntime-genai

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

65 Open 203 Closed
65 Open 203 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Bitnet support
#999 opened Oct 20, 2024 by janjanusek
LLama-3.2-1B-Instruct Function Calling error platform:mobile
#994 opened Oct 18, 2024 by madroidmaq
Extra Options use_qdq flags work incorrectly
#986 opened Oct 16, 2024 by aendk
1
Benchmark script crashes when trying to run Llama 3.2 1b DML model ep:DML
#982 opened Oct 14, 2024 by natke
@PatriceVignola
OnnxRuntimeGenAIException: 'bad allocation' when option max_length is not set ep:DML
#980 opened Oct 14, 2024 by f2bo
@baijumeswani
3
Unable to run onnxruntime-genai on iOS (Xcode 15.3) platform:mobile
#979 opened Oct 14, 2024 by ShamDhi
3
Excessive RAM usage. ep:DML
#977 opened Oct 14, 2024 by elephantpanda
@PatriceVignola
onnxruntime-genai - QNN Memory Usage
#976 opened Oct 14, 2024 by dhl899
1
887A0006 The GPU will not respond to more commands, most likely because of an invalid command passed by the calling application. ep:DML
#975 opened Oct 14, 2024 by elephantpanda
@PatriceVignola
Error opening genai_config for running phi-3.5-mini-instruct-onnx (cuda-int4-awq-block-128) downloaded from hugging face ep:CUDA
#971 opened Oct 11, 2024 by Vivihung
7
Error in example chat_app execution
#968 opened Oct 10, 2024 by ramkrishna2910
1
An allocator for this device has already been registered for sharing bug Something isn't working platform:mobile
#965 opened Oct 9, 2024 by skyline75489
6
phi3.5 genai converted model output garbage results with input length around 3000 and 8000.
#954 opened Oct 3, 2024 by yufang67
@ajindal1
8
Does Microsoft.ML.OnnxRuntimeGenAI.Cuda (version 0.4.0) support Phi-3.5 Vision Onnx format? ep:CUDA waiting-for-customer
#943 opened Sep 28, 2024 by MaxAkbar
4
Genny CUDA memory exception
#939 opened Sep 27, 2024 by lilhoser
3
Mac build from source not working: onnx .dylib link [Mac M3/ARM/MACOS]
#909 opened Sep 22, 2024 by farris
1
_com_error at memory location 0x0000006A74D6D680 when calling generator.ComputeLogits() ep:DML model:transformer platform:windows
#886 opened Sep 11, 2024 by tranlm
@PatriceVignola
3
TheUnhandled exception. The parameter is incorrect. ep:DML platform:windows
#883 opened Sep 9, 2024 by sirredbeard
@PatriceVignola
[feature request] builder to expose {GQA, MHA} selection as argument
#880 opened Sep 6, 2024 by BowenBao
@kunal-vaishnavi
2
Document past present shared buffer
#878 opened Sep 5, 2024 by natke
@natke
Update README to add git lfs and Windows long string guidance platform:windows
#877 opened Sep 5, 2024 by natke
@natke
Running custom encoder-decoder models in onnxruntime-genai model:transformer
#875 opened Sep 5, 2024 by KarelZe
3
ONNX Runner: Quantized Model Execution Error api:java waiting-for-customer
#866 opened Sep 3, 2024 by Dave86ch
1
Check out TurnkeyML-LLM model:transformer
#854 opened Aug 29, 2024 by jeremyfowers
1
Memory leak in the multimodal processor of Phi-3-vision
#851 opened Aug 29, 2024 by hiro28844
@baijumeswani
5
ProTip! Follow long discussions with comments:>50.