callback_write_parquet: Callback function to write Parquet partition

View source: R/arrow.R

callback_write_parquetR Documentation

Callback function to write Parquet partition

Description

A function factory that creates a callback function for readr::read_delim_chunked().

Usage

callback_write_parquet(chunk_paths, chunk_size, processing_function = NULL)

Arguments

chunk_size

The number of rows to include in each chunk

processing_function

A function that takes each chunk and does arbitrary data processing on it before writing the resulting data frame into its Parquet partition.

Value

A function to be used in read_delim_chunked_to_dataset().

See Also

https://stackoverflow.com/a/49241426


svraka/asmisc documentation built on June 12, 2025, 12:04 p.m.