Skip to main content
Version: v0.2.23

AWS EKS Deployment Guide

AWS EKS Deployment​

Prerequisites​

  • Set up an EKS cluster
  • Create a GitHub OAuth app
  • Set authorization callback URL to http://<your-llama-stack-ui-url>/api/auth/callback/

Automated Deployment​

export HF_TOKEN=<your-huggingface-token>
export GITHUB_CLIENT_ID=<your-github-client-id>
export GITHUB_CLIENT_SECRET=<your-github-client-secret>
export LLAMA_STACK_UI_URL=<your-llama-stack-ui-url>

cd docs/source/distributions/eks
./apply.sh

This script will:

  • Set up default storage class for AWS EKS
  • Deploy Llama Stack server in Kubernetes pods and services