Remote-Hosted Distributions
Remote-Hosted distributions are available endpoints serving Llama Stack API that you can directly connect to.
Distribution |
Endpoint |
Inference |
Agents |
Memory |
Safety |
Telemetry |
---|---|---|---|---|---|---|
Together |
remote::together |
meta-reference |
remote::weaviate |
meta-reference |
meta-reference |
|
Fireworks |
remote::fireworks |
meta-reference |
remote::weaviate |
meta-reference |
meta-reference |
Connecting to Remote-Hosted Distributions
You can use llama-stack-client
to interact with these endpoints. For example, to list the available models served by the Fireworks endpoint:
$ pip install llama-stack-client
$ llama-stack-client configure --endpoint https://llamastack-preview.fireworks.ai
$ llama-stack-client models list
Checkout the llama-stack-client-python repo for more details on how to use the llama-stack-client
CLI. Checkout llama-stack-app for examples applications built on top of Llama Stack.