Skip to main content

Llama StackDocs

🟢 Stable APIs
🟡 Experimental APIs
🔴 Deprecated APIs

Next
v0.3.4
v0.3.3
v0.3.1
v0.3.2
v0.3.0
v0.2.23
Previous versions
v0.2.22
v0.2.21
v0.2.20
v0.2.19
v0.2.18
v0.2.17
v0.2.16
v0.2.15
v0.2.14
v0.2.13
v0.2.12
v0.2.11

Introduction
Agents API for creating and interacting with agentic systems.
Batch inference API for generating completions and chat completions.
Benchmarks
DatasetIO
Datasets
Llama Stack Evaluation API for running evaluations on model and agent candidates.
Files
Llama Stack Inference API for generating completions, chat completions, and embeddings.
Inspect
Models
PostTraining (Coming Soon)
Protocol for prompt management operations.
Providers API for inspecting, listing, and modifying providers and their configurations.
Safety
Scoring
ScoringFunctions
Shields
SyntheticDataGeneration (Coming Soon)
Telemetry
ToolGroups
ToolRuntime
VectorDBs
VectorIO

This is documentation for Llama Stack v0.2.23, which is no longer actively maintained.

For up-to-date documentation, see the latest version (v0.3.4).

Models
Register a model.

Version: v0.2.23

Register a model.

POST /v1/models

Register a model.

Request

Responses

200
400
429
500
default

A Model.

The request was invalid or malformed

The client has sent too many requests in a given amount of time

The server encountered an unexpected error

An unexpected error occurred

List all models.

List models using the OpenAI API.

Docs

Getting Started
Concepts
API Reference

Community

Discord
GitHub Discussions
Issues

More

GitHub
PyPI

Copyright © 2025 Meta Platforms, Inc. Built with Docusaurus.