Core Concepts

Given Llama Stack's service-oriented philosophy, a few concepts and workflows arise which may not feel completely natural in the LLM landscape, especially if you are coming with a background in other frameworks.

Documentation Structure

This section covers the fundamental concepts of Llama Stack:

• Architecture - Learn about Llama Stack's architectural design and principles
• APIs - Understanding the core APIs and their stability levels
  • API Overview - Core APIs available in Llama Stack
  • API Providers - How providers implement APIs
  • External APIs - External APIs available in Llama Stack
  • API Stability Leveling - API stability and versioning
• Distributions - Pre-configured deployment packages
• Resources - Understanding Llama Stack resources and their lifecycle

Getting Started

If you're new to Llama Stack, we recommend starting with:

1. Architecture - Understand the overall system design
2. APIs - Learn about the available APIs and their purpose
3. Distributions - Choose a pre-configured setup for your use case

Each concept builds upon the previous ones to give you a comprehensive understanding of how Llama Stack works and how to use it effectively.