Skip to main content
Version: v0.4.0

remote::cerebras

Description​

Cerebras inference provider for running models on Cerebras Cloud platform.

Configuration​

FieldTypeRequiredDefaultDescription
allowed_modelslist[str] | NoneNoList of models that should be registered with the model registry. If None, all models are allowed.
refresh_modelsboolNoFalseWhether to refresh models periodically from the provider
api_keySecretStr | NoneNoAuthentication credential for the provider
base_urlHttpUrl | NoneNohttps://api.cerebras.ai/v1Base URL for the Cerebras API

Sample Configuration​

base_url: https://api.cerebras.ai/v1
api_key: ${env.CEREBRAS_API_KEY:=}