read_cache: read_cache

In skysyzygy/tessilake: Data lake for Tessitura

read_cache

Description

Function to read cached arrow files. Reads from the most recently updated cache across all storage depths. Optionally returns the partition information as a dataset column.

Usage

read_cache(table_name, type, depth = deprecated(), ...)

cache_read(
  table_name,
  depth,
  type,
  include_partition = FALSE,
  select = NULL,
  num_tries = 60,
  ...
)

Arguments

table_name	string
type	string, e.g. "tessi" or "stream"
depth	string, e.g. "deep" or "shallow", deprecated in read_cache
...	extra arguments to pass on to cache_read and then arrow::open_dataset, arrow::read_parquet, or arrow::read_feather
include_partition	boolean, whether or not to return the partition information as a column
select	vector of strings indicating columns to select from database
num_tries	integer number of times to try reading before failing

Value

arrow::Dataset

Functions

• cache_read(): Underlying cache reader that invokes arrow::open_dataset, arrow::read_parquet, or arrow::read_feather and handles partitioning information

Examples

## Not run: 
write_cache(data.table(a=letters), "test", "stream")
read_cache("test", "stream")

## End(Not run)

skysyzygy/tessilake documentation built on June 14, 2025, 6:50 p.m.