Skip to main content
Version: v0.3.0

remote::openai

Description​

OpenAI inference provider for accessing GPT models and other OpenAI services.

Configuration​

FieldTypeRequiredDefaultDescription
allowed_modelslist[str | NoneNoList of models that should be registered with the model registry. If None, all models are allowed.
refresh_models<class 'bool'>NoFalseWhether to refresh models periodically from the provider
api_keypydantic.types.SecretStr | NoneNoAuthentication credential for the provider
base_url<class 'str'>Nohttps://api.openai.com/v1Base URL for OpenAI API

Sample Configuration​

api_key: ${env.OPENAI_API_KEY:=}
base_url: ${env.OPENAI_BASE_URL:=https://api.openai.com/v1}