tbl_cache: Cache a Spark Table

View source: R/tables_spark.R

tbl_cacheR Documentation

Cache a Spark Table

Description

Force a Spark table with name name to be loaded into memory. Operations on cached tables should normally (although not always) be more performant than the same operation performed on an uncached table.

Usage

tbl_cache(sc, name, force = TRUE)

Arguments

sc

A spark_connection.

name

The table name.

force

Force the data to be loaded into memory? This is accomplished by calling the count API on the associated Spark DataFrame.


sparklyr documentation built on May 29, 2024, 2:58 a.m.