remote::fireworks

Description

Fireworks AI inference provider for Llama models and other AI models on the Fireworks platform.

Configuration

Field

Type

Required

Default

Description

allowed_models

list[str | None

No

List of models that should be registered with the model registry. If None, all models are allowed.

url

<class 'str'>

No

https://api.fireworks.ai/inference/v1

The URL for the Fireworks server

api_key

pydantic.types.SecretStr | None

No

The Fireworks.ai API Key

Sample Configuration

url: https://api.fireworks.ai/inference/v1
api_key: ${env.FIREWORKS_API_KEY:=}