remote::huggingface

Description

HuggingFace datasets provider for accessing and managing datasets from the HuggingFace Hub.

Configuration

Field	Type	Required	Default	Description
kvstore	utils.kvstore.config.RedisKVStoreConfig | utils.kvstore.config.SqliteKVStoreConfig | utils.kvstore.config.PostgresKVStoreConfig | utils.kvstore.config.MongoDBKVStoreConfig	No	sqlite

Sample Configuration

kvstore:
  type: sqlite
  db_path: ${env.SQLITE_STORE_DIR:=~/.llama/dummy}/huggingface_datasetio.db