[Feature Request]: Small models

[streamich]

Problem Description

Currently pre-built models start from 1B params (there is one with 0.5B). There is a lack of small models.

Solution Description

Add few small pre-built models. Would be great to have at least one 125M model, to see how it performs and to use them for simple but performance critical tasks, like keyword generation.

Alternatives Considered

No response

Additional Context

No response

[streamich]

Actually just realized there are Smol models. Would be still great to see even smaller models. But the Smol models seems to be what I am looking for.