DeltaOptimizeBuilder-class: S4 class that represents pending optimize operation

In zero323/dlt: SparkR Delta Lake Interface

S4 class that represents pending optimize operation

Description

S4 class that represents pending optimize operation

Slots

job

A Java object reference to the backing DeltaOptimizeBuilder

Note

DeltaOptimizeBuilder, since 2.0.0

Examples

## Not run: 
set.seed(323)
target_path <- tempfile()

data.frame(
  id = 1:12,
  key = rep(c("a", "b", "c"), each = 4),
  value = rnorm(12)
) %>%
  createDataFrame() %>%
  dlt_write(target_path, partitionBy = "key")

dlt_for_path(target_path) %>%
  dlt_optimize() %>%
  dlt_where("key = 'a'") %>%
  dlt_execute_compaction() %>%
  showDF()

dlt_for_path(target_path) %>%
  dlt_optimize() %>%
  dlt_where("key = 'b'") %>%
  dlt_execute_z_order_by("id") %>%
  showDF()

## End(Not run)

zero323/dlt documentation built on Dec. 1, 2022, 11:25 p.m.