Skip to main content
Version: v0.2.23

remote::groq

Description​

Groq inference provider for ultra-fast inference using Groq's LPU technology.

Configuration​

FieldTypeRequiredDefaultDescription
api_keystr | NoneNoThe Groq API key
url<class 'str'>Nohttps://api.groq.comThe URL for the Groq AI server

Sample Configuration​

url: https://api.groq.com
api_key: ${env.GROQ_API_KEY:=}