sdf_partition_sizes: Compute the number of records within each partition of a...

View source: R/sdf_interface.R

sdf_partition_sizesR Documentation

Compute the number of records within each partition of a Spark DataFrame

Description

Compute the number of records within each partition of a Spark DataFrame

Usage

sdf_partition_sizes(x)

Arguments

x

A spark_connection, ml_pipeline, or a tbl_spark.

Examples


## Not run: 
library(sparklyr)
sc <- spark_connect(master = "spark://HOST:PORT")
example_sdf <- sdf_len(sc, 100L, repartition = 10L)
example_sdf %>%
  sdf_partition_sizes() %>%
  print()

## End(Not run)


sparklyr documentation built on May 29, 2024, 2:58 a.m.