Skip to main content

Llama StackDocs

🟢 Stable APIs
🟡 Experimental APIs
🔴 Deprecated APIs

Next
v0.2.23
Previous versions
v0.2.22
v0.2.21
v0.2.20
v0.2.19
v0.2.18
v0.2.17
v0.2.16
v0.2.15
v0.2.14
v0.2.13
v0.2.12
v0.2.11

Introduction
Agents API for creating and interacting with agentic systems.
Batch inference API for generating completions and chat completions.
Benchmarks
DatasetIO
Datasets
Llama Stack Evaluation API for running evaluations on model and agent candidates.
Files
Llama Stack Inference API for generating completions, chat completions, and embeddings.
Inspect
Models
PostTraining (Coming Soon)
Protocol for prompt management operations.
Providers API for inspecting, listing, and modifying providers and their configurations.
Safety
Scoring
- Score a list of rows.
- Score a batch of rows.
ScoringFunctions
Shields
SyntheticDataGeneration (Coming Soon)
Telemetry
ToolGroups
ToolRuntime
VectorDBs
VectorIO

Scoring

Version: v0.2.23

Scoring

📄️ Score a list of rows.

Score a list of rows.

📄️ Score a batch of rows.

Score a batch of rows.

Score a list of rows.

Docs

Getting Started
Concepts
API Reference

Community

Discord
GitHub Discussions
Issues

More

GitHub
PyPI

Copyright © 2025 Meta Platforms, Inc. Built with Docusaurus.