Skip to main content

remote::chromadb

Description

Chroma is an inline and remote vector database provider for Llama Stack. It allows you to store and query vectors directly within a Chroma database. That means you're not limited to storing vectors in memory or in a separate service.

Features

Chroma supports:

  • Store embeddings and their metadata
  • Vector search
  • Full-text search
  • Document storage
  • Metadata filtering
  • Multi-modal retrieval

Usage

To use Chrome in your Llama Stack project, follow these steps:

  1. Install the necessary dependencies.
  2. Configure your Llama Stack project to use chroma.
  3. Start storing and querying vectors.

Installation

You can install chroma using pip:

pip install chromadb

Documentation

See Chroma's documentation for more details about Chroma in general.

Configuration

FieldTypeRequiredDefaultDescription
urlstr | NoneNo
persistenceKVStoreReferenceNoConfig for KV store backend
persistence.namespacestrNoKey prefix for KVStore backends
persistence.backendstrNoName of backend from storage.backends

Sample Configuration

url: ${env.CHROMADB_URL}
persistence:
namespace: vector_io::chroma_remote
backend: kv_default