Skip to main content
Version: v0.3.2

remote::passthrough

Description​

Passthrough inference provider for connecting to any external inference service not directly supported.

Configuration​

FieldTypeRequiredDefaultDescription
allowed_modelslist[str | NoneNoList of models that should be registered with the model registry. If None, all models are allowed.
refresh_models<class 'bool'>NoFalseWhether to refresh models periodically from the provider
api_keypydantic.types.SecretStr | NoneNoAPI Key for the passthrouth endpoint
url<class 'str'>NoThe URL for the passthrough endpoint

Sample Configuration​

url: ${env.PASSTHROUGH_URL}
api_key: ${env.PASSTHROUGH_API_KEY}