Distributions Overview

A distribution is a pre-packaged set of Llama Stack components that can be deployed together.

This section provides an overview of the distributions available in Llama Stack.

• Available Distributions
  • Quick Reference
  • Choose Your Distribution
    • 🚀 Getting Started (Recommended for Beginners)
    • 🖥️ Self-Hosted with GPU
    • 🖥️ Self-Hosted with NVIDA NeMo Microservices
    • ☁️ Managed Hosting
    • 📱 Mobile Development
    • 🔧 Custom Solutions
  • Detailed Documentation
    • Self-Hosted Distributions
    • Remote-Hosted Solutions
    • Mobile SDKs
  • Decision Flow
  • Next Steps
• Build your own Distribution
  • Setting your log level
  • Llama Stack Build
  • Running your Stack server
  • Listing Distributions
  • Removing a Distribution
  • Troubleshooting
• Customizing run.yaml Files
  • Key Points
  • What You Can Customize
  • Best Practices
• Starting a Llama Stack Server
  • As a Library:
  • Container:
  • Kubernetes:
• Using Llama Stack as a Library
  • Setup Llama Stack without a Server
• Configuring a “Stack”
  • Providers
    • Environment Variable Substitution
  • Resources
  • Server Configuration
    • CORS Configuration
    • Authentication Configuration
    • Access control
    • Quota Configuration
    • CORS Configuration
  • Extending to handle Safety