Helm Chart for Hugging Face Generative AI Services (HUGS)

Warning

HUGS Helm Chart is subject to changes before the 0.1.0 release!

Installing the Chart

To add the chart from the current repository you need to run:

$ helm repo add hugs https://raw.githubusercontent.com/huggingface/hugs-helm-chart/main/charts/hugs
$ helm repo update hugs

Installing the Chart

Then to install the chart on e.g. AWS EKS you can run the following:

$ helm install hugs-demo hugs/hugs \
    -f aws/eks-values.yaml \
    --set image.registry="XXXXXXXXXXXX.dkr.ecr.us-east-1.amazonaws.com" \
    --set image.repository="hugging-face" \
    --set image.name="nvidia-meta-llama-meta-llama-3.1-8b-instruct" \
    --set image.tag="0.1.0"

Note

Find more information about HUGS on AWS here.