remote::huggingface

Description

HuggingFace datasets provider for accessing and managing datasets from the HuggingFace Hub.

Configuration

Field

Type

Required

Default

Description

kvstore

utils.kvstore.config.RedisKVStoreConfig | utils.kvstore.config.SqliteKVStoreConfig | utils.kvstore.config.PostgresKVStoreConfig | utils.kvstore.config.MongoDBKVStoreConfig

No

sqlite

Sample Configuration

kvstore:
  type: sqlite
  db_path: ${env.SQLITE_STORE_DIR:=~/.llama/dummy}/huggingface_datasetio.db