Skip to main content
Version: v0.3.0

remote::together

Description​

Together AI inference provider for open-source models and collaborative AI development.

Configuration​

FieldTypeRequiredDefaultDescription
allowed_modelslist[str | NoneNoList of models that should be registered with the model registry. If None, all models are allowed.
refresh_models<class 'bool'>NoFalseWhether to refresh models periodically from the provider
api_keypydantic.types.SecretStr | NoneNoAuthentication credential for the provider
url<class 'str'>Nohttps://api.together.xyz/v1The URL for the Together AI server

Sample Configuration​

url: https://api.together.xyz/v1
api_key: ${env.TOGETHER_API_KEY:=}