[Feature] Support for GPT-2

[hariharan98m]

Checklist

• 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.
• 2. Please use English, otherwise it will be closed.

Motivation

I believe there is still a vast majority of our community working with GPT-2 or similar small language models for niche datasets. It would be great if these finetuned GPT-2 models can be deployed through sglang.

Related resources

No response

[Abhrajitdas02]

hi can I work on this?

[zhyncs]

hi can I work on this?

Sure, go ahead. It's not difficult. ref https://github.com/vllm-project/vllm/blob/main/vllm/model_executor/models/gpt2.py

[merrymercy]

https://github.com/sgl-project/sglang/blob/main/docs/en/model_support.md

[DanielC12321]

Hi! Is anyone currently working on this issue? If not, I’d love to take it on. I’m new to contributing, so any pointers on where to start or key files to review would be really helpful.