LLM Arena

An open-source website for creating and sharing LLM Comparisons

🔗 llmarena.ai

Development

Install dependencies and start the development environment.

1. Ensure you have Bun, Docker, and Mprocs installed
2. Fill out the environment variables in .env.example and rename it to .env.
   • Create a separate Github oauth app
   • Set the redirect URI to http://localhost:3000/api/auth/callback/github
   • You will need a sendgrid API key if you want to send emails
   • DISCORD_WEBHOOK_URL_PUBLIC is a discord webhook to log public events (LLM submitted/approved/rejected)
   • DISCORD_WEBHOOK_URL_ADMIN is a discord webhook to log admin events (contributor/vote/llm removed) and ideally logs to a private discord channel. For development purposes, both webhooks can be the same
3. Run mprocs to start the development environment. This will install dependencies, spin up a postgres docker instance, and prisma studio.
4. Run bun db:sync to apply pending migrations and create the prisma client
5. Run bun db:seed to seed the database with initial data

See the Prisma Documentation on how to apply migrations and further manipulate the database.

Deploying to Production

1. Set the environment variables in .env or in you hosting provider's environment variable settings.
2. Run bun run build to create a production build
3. Run bun run start to start the production server

Contributing

Adding LLMs

1. Apply as a contributor at https://llmarena.ai/contribute
2. Read the Contributor Guide
3. Once approved, you can Submit a new LLM and Vote on pending LLMs

Bugs

1. Open an issue on the repository
2. Describe the bug and include detailed steps on how to reproduce it
3. Include screenshots or videos if possible

Feature Requests

1. Open an issue on the repository
2. Describe the feature and how it would be useful
3. Include a quick sketch or mockup if possible (optional, excalidraw and figma are great tools for this)

Pull Requests

1. Fork the repository
2. Push a new branch to your fork with your changes
3. Open a pull request to the main branch
4. Describe the changes you've made and include a detailed step-by-step guide on how to test them
5. Include screenshots or videos if possible

Use Common Sense. Unreasonable Pull Requests will be closed.