0.3.0

What's Changed

• Bug Fix: Discrepancy between grouped-SDPA and SDPA by @fkodom in #6

Full Changelog: 0.2.0...0.3.0

0.2.0

Bug fix in self-attention layer

0.1.0

First full release candidate for PyPI. 🎉

• Working version of GQA
• Reproduced runtime benchmarks
• Prototype GQATransformer modules
• (Experimental) Convert T5 models to GQA

Full Changelog: 0.1.0rc1...0.1.0

0.1.0rc2

Finally (hopefully) fix bug with pyproject.toml and markdown

0.1.0rc1

First prerelease candidate for PyPI