git clone --recurse-submodules https://github.com/NCTU-SYNC/sync-server-llm.git
cd sync-server-llm
poetry install
poetry run gen-protos
Please setup the configuration file configs/config.toml
before running the server.
You can refer to the configs/example.toml
for the format.
poetry run serve --config configs/config.toml
Please refer to the protobuf files in protos/
for the features provided by the server.