Skip to content

Issues: microsoft/T-MAC

T-MAC 1.0.0 Release Plan
#45 opened Sep 14, 2024 by kaleid-liner
Open
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

20 Open 30 Closed
20 Open 30 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

History tune.log may bypass kernel generation configurations.
#66 opened Oct 21, 2024 by QingtaoLi1
The perplexity tool returns unexpected ppl results
#65 opened Oct 18, 2024 by fefang
Cannot get llama-2-7b-4bit quant model run normally.
#62 opened Oct 15, 2024 by Zijie-Tian
1
Why is there no difference in the E2E performance of T-MAC and llama.cpp on arm machine?
#61 opened Oct 11, 2024 by ppp-max
2
about gptq quantization tricks
#59 opened Oct 11, 2024 by sinoaidi
The log is stuck on the "running build_py" line for 2 hours， is this normal? question Further information is requested
#56 opened Oct 9, 2024 by sunj0104
4
Andorid tune kernel question question Further information is requested
#53 opened Sep 26, 2024 by qw1319
8
Does the speed performance have anything to do with the shape of the multiplication matrix? Why is the matrix multiplication of [34,2048]*[2048,5632] much faster than the matrix multiplication of [34,5632]*[5632,2048]? They have the same FLOPs. question Further information is requested
#48 opened Sep 23, 2024 by lijianxing123
1
T-MAC 1.0.0 Release Plan enhancement New feature or request
#45 opened Sep 14, 2024 by kaleid-liner
@kaleid-liner @QingtaoLi1
Whether the T-MAC supports the RISC-V CPU？ enhancement New feature or request
#41 opened Sep 8, 2024 by velonica0
1
Slow performance compared to llama.cpp origin question Further information is requested
#40 opened Sep 6, 2024 by idreamerhx
7
performance on mobile phone such as MTK D9000/D8300 or Qualcomm 8Gen3 duplicate This issue or pull request already exists
#39 opened Sep 4, 2024 by yuimo
2
[Question]Whether T-MAC supports mixed-precision LLM?
#38 opened Sep 3, 2024 by AndreaChiChengdu
2
8gen3 T-MAC cpu performance issue enhancement New feature or request good first issue Good for newcomers
#32 opened Aug 29, 2024 by AndreaChiChengdu
9
How to Fully Utilize the Optimized Performance of T-MAC ? question Further information is requested
#30 opened Aug 28, 2024 by ma-hang
2
OpenAI compatible chat completions endpoint
#28 opened Aug 24, 2024 by maxim-saplin
9
ubuntu installation problem on Google colab bug Something isn't working
#26 opened Aug 20, 2024 by amirhosein-darmani
25
Any plans to merge the latest code of llama.cpp?
#24 opened Aug 20, 2024 by peytoncai
20
How to build ollama with t-mac support？ help wanted Extra attention is needed
#23 opened Aug 20, 2024 by goukisun
2
have any plan embeded in mlc llm? enhancement New feature or request
#10 opened Aug 13, 2024 by lhwlhw90
ProTip! What’s not been updated in a month: updated:<2024-09-22.