[Feature] Request to 8-bit Quantization of Attention with SageAttention

[Snowdar]

Checklist

• 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.
• 2. Please use English, otherwise it will be closed.

Motivation

As https://github.com/thu-ml/SageAttention mentioned, the quantized 8-bit attention will improvement the speed of inference about 2x and more with the same accuracy, so shall we give it a try or do some verification?

Related resources

github: https://github.com/thu-ml/SageAttention

[merrymercy]

contributions are welcome