Inference

Overview

This section contains documentation for all available providers for the inference API.

Providers

• inline::meta-reference
• inline::sentence-transformers
• remote::anthropic
• remote::bedrock
• remote::cerebras
• remote::databricks
• remote::fireworks
• remote::gemini
• remote::groq
• remote::hf::endpoint
• remote::hf::serverless
• remote::llama-openai-compat
• remote::nvidia
• remote::ollama
• remote::openai
• remote::passthrough
• remote::runpod
• remote::sambanova
• remote::tgi
• remote::together
• remote::vllm
• remote::watsonx