sdf_last_index: Returns the last index of a Spark DataFrame
In rstudio/sparklyr: R Interface to Apache Spark
View source: R/sdf_interface.R
sdf_last_index R Documentation
Returns the last index of a Spark DataFrame
Description
Returns the last index of a Spark DataFrame. The Spark
mapPartitionsWithIndex function is used to iterate
through the last nonempty partition of the RDD to find the last record.
Usage
sdf_last_index(x, id = "id")
Arguments
x
A spark_connection, ml_pipeline, or a tbl_spark.
id
The name of the index column.
rstudio/sparklyr documentation built on Sept. 18, 2024, 6:10 a.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
View source: R/sdf_interface.R
| sdf_last_index | R Documentation |
Returns the last index of a Spark DataFrame
Description
Returns the last index of a Spark DataFrame. The Spark
mapPartitionsWithIndex function is used to iterate
through the last nonempty partition of the RDD to find the last record.
Usage
sdf_last_index(x, id = "id")
Arguments
x |
A |
id |
The name of the index column. |
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.