Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issues on Mac: fp8 and fp16 don't work because dtype is not compatible and fp32 crashes memory #138

Open
haiggoh opened this issue Oct 16, 2024 · 0 comments

Comments

@haiggoh
Copy link

haiggoh commented Oct 16, 2024

fp8_unet gives me this error: Trying to convert Float8_e4m3fn to the MPS backend but it does not have support for that type.

dtype auto (I think this defaults to fp16?) gives me this error: "compute_index_ranges_weights" not implemented for 'Half'

dtype fp32 seems to work maybe? But only with PYTORCH_MPS_HIGH_WATERMARK_RATIO=0.0 because of memory issues and so far I only got noise, but I keep trying.

If anyone knows how to fix any one of these by any chance I would love to see it!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant