New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Design Worker Nodes and Agent SDK #2

Open

cybertheory opened this issue Jan 12, 2025 · 0 comments

Contributor

cybertheory commented Jan 12, 2025

Worker Nodes will be used to run Agents

There one agent per node, and each agent will be bundled into a container image.

Each worked/agent image contains the following

FASTAPI-

/execute - endpoint

We don't want devs to deal with the FASTAPI and instead we want them to simply provide us each custom agent in a .py file.

The cli will bundle this with a FASTAPI server into a container image. Then this will be bundles as a worker node in a cluster.

We need to design some kind of abstraction or SDK that devs can use to define agents that can communicate with the bundled server.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment