remote::together

Description

Together AI inference provider for open-source models and collaborative AI development.

Configuration

Field	Type	Required	Default	Description
allowed_models	list[str] | None	No		List of models that should be registered with the model registry. If None, all models are allowed.
refresh_models	bool	No	False	Whether to refresh models periodically from the provider
api_key	SecretStr | None	No		Authentication credential for the provider
base_url	HttpUrl | None	No	https://api.together.xyz/v1	The URL for the Together AI server

Sample Configuration

base_url: https://api.together.xyz/v1
api_key: ${env.TOGETHER_API_KEY:=}