hf_read_chunks: Read All Chunks from Directory

In huggingfaceR: Access 'Hugging Face' Models and Datasets

Read All Chunks from Directory

Description

Read and combine all parquet chunk files from a directory.

Usage

hf_read_chunks(output_dir, pattern = "*.parquet")

Arguments

output_dir	Character string. Directory containing chunk files.
pattern	Character string. Glob pattern to match files. Default: "*.parquet".

Value

A tibble combining all chunks, sorted by '.input_idx' if present.

Examples

## Not run: 
# After running hf_embed_chunks()
results <- hf_read_chunks("my_output_dir")

## End(Not run)

huggingfaceR documentation built on Aug. 30, 2026, 1:06 a.m.