-
Notifications
You must be signed in to change notification settings - Fork 21
Issues: pytorch-labs/applied-ai
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Do you have any plan for support of MOE training?
#20
opened Apr 27, 2024 by
flishwang
updated Apr 27, 2024
How much acceleration can Mixtral8x7b achieve using Column-Major MoE?
#24
opened Jun 12, 2024 by
Jacob0226
updated Jun 12, 2024
[fused moe kernel] bug for column major?
#25
opened Jul 24, 2024 by
sleepwalker2017
updated Nov 15, 2024
ProTip!
Follow long discussions with comments:>50.