OpenVINO VSCode Server

Installation

Execute the following commands from ./server directory:

python3 -m venv venv
source venv/bin/activate
pip install -U pip
pip install .

To start the server execute the following command from ./server directory and with activated venv:

python main.py --model chgk13/decicoder-1b-openvino-int8

Open localhost:8000 or localhost:8000/docs for autogenerated OpenAPI specification.