remote::groq
Description
Groq inference provider for ultra-fast inference using Groq’s LPU technology.
Configuration
Field |
Type |
Required |
Default |
Description |
---|---|---|---|---|
|
|
No |
The Groq API key |
|
|
|
No |
https://api.groq.com |
The URL for the Groq AI server |
Sample Configuration
url: https://api.groq.com
api_key: ${env.GROQ_API_KEY:=}