Warning
HUGS Helm Chart is subject to changes before the 0.1.0 release!
To add the chart from the current repository you need to run:
$ helm repo add hugs https://raw.githubusercontent.com/huggingface/hugs-helm-chart/main/charts/hugs
$ helm repo update hugs
Then to install the chart on e.g. AWS EKS you can run the following:
$ helm install hugs-demo hugs/hugs \
-f aws/eks-values.yaml \
--set image.registry="XXXXXXXXXXXX.dkr.ecr.us-east-1.amazonaws.com" \
--set image.repository="hugging-face" \
--set image.name="nvidia-meta-llama-meta-llama-3.1-8b-instruct" \
--set image.tag="0.1.0"
Note
Find more information about HUGS on AWS here.