sdf_partition_sizes: Compute the number of records within each partition of a...
In rstudio/sparklyr: R Interface to Apache Spark
View source: R/sdf_interface.R
sdf_partition_sizes R Documentation
Compute the number of records within each partition of a Spark DataFrame
Description
Compute the number of records within each partition of a Spark DataFrame
Usage
sdf_partition_sizes(x)
Arguments
x
A spark_connection, ml_pipeline, or a tbl_spark.
Examples
## Not run:
library(sparklyr)
sc <- spark_connect(master = "spark://HOST:PORT")
example_sdf <- sdf_len(sc, 100L, repartition = 10L)
example_sdf %>%
sdf_partition_sizes() %>%
print()
## End(Not run)
rstudio/sparklyr documentation built on Sept. 18, 2024, 6:10 a.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
View source: R/sdf_interface.R
| sdf_partition_sizes | R Documentation |
Compute the number of records within each partition of a Spark DataFrame
Description
Compute the number of records within each partition of a Spark DataFrame
Usage
sdf_partition_sizes(x)
Arguments
x |
A |
Examples
## Not run:
library(sparklyr)
sc <- spark_connect(master = "spark://HOST:PORT")
example_sdf <- sdf_len(sc, 100L, repartition = 10L)
example_sdf %>%
sdf_partition_sizes() %>%
print()
## End(Not run)
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.