Remote-Hosted Distributions

Remote-Hosted distributions are available endpoints serving Llama Stack API that you can directly connect to.

Distribution

Endpoint

Inference

Agents

Memory

Safety

Telemetry

Together

https://llama-stack.together.ai

remote::together

meta-reference

remote::weaviate

meta-reference

meta-reference

Fireworks

https://llamastack-preview.fireworks.ai

remote::fireworks

meta-reference

remote::weaviate

meta-reference

meta-reference

Connecting to Remote-Hosted Distributions

You can use llama-stack-client to interact with these endpoints. For example, to list the available models served by the Fireworks endpoint:

$ pip install llama-stack-client
$ llama-stack-client configure --endpoint https://llamastack-preview.fireworks.ai
$ llama-stack-client models list

Checkout the llama-stack-client-python repo for more details on how to use the llama-stack-client CLI. Checkout llama-stack-app for examples applications built on top of Llama Stack.