Pinned Loading

1. om om Public

   An LLM architecture utilizing a recurrent structure and multi-layer memory

   Python 11

2. dropgrad dropgrad Public

   PyTorch Implementation of DropGrad

   Python 4 1

3. infini-transformer infini-transformer Public

   PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" (https://arxiv.org/abs/2404.07143)

   Python 279 23