ts_rdd_builder: TimeSeriesRDD builder object

In sparklyr.flint: Sparklyr Extension for 'Flint'

Description

Builder object containing all required info (i.e., isSorted, timeUnit, and timeColumn) for importing a Spark data frame into a TimeSeriesRDD

Usage

ts_rdd_builder(
  sc,
  is_sorted = FALSE,
  time_unit = .sparklyr.flint.globals$kValidTimeUnits,
  time_column = .sparklyr.flint.globals$kDefaultTimeColumn
)

Arguments

sc	Spark connection
is_sorted	Whether the rows being imported are already sorted by time
time_unit	Time unit of the time column (must be one of the following values: "NANOSECONDS", "MICROSECONDS", "MILLISECONDS", "SECONDS", "MINUTES", "HOURS", "DAYS"
time_column	Name of the time column

Value

A reusable TimeSeriesRDD builder object

See Also

Other Spark dataframe utility functions: collect.ts_rdd(), from_rdd(), from_sdf(), spark_connection.ts_rdd(), spark_dataframe.ts_rdd(), spark_jobj.ts_rdd(), to_sdf()

sparklyr.flint documentation built on Jan. 11, 2022, 9:06 a.m.