Known External Providers

Here’s a list of known external providers that you can use with Llama Stack:

Name

Description

API

Type

Repository

KubeFlow Training

Train models with KubeFlow

Post Training

Remote

llama-stack-provider-kft

KubeFlow Pipelines

Train models with KubeFlow Pipelines

Post Training

Inline and Remote

llama-stack-provider-kfp-trainer

RamaLama

Inference models with RamaLama

Inference

Remote

ramalama-stack

TrustyAI LM-Eval

Evaluate models with TrustyAI LM-Eval

Eval

Remote

llama-stack-provider-lmeval

MongoDB

VectorIO with MongoDB

Vector_IO

Remote

mongodb-llama-stack