README.md

pysparklyr

R-CMD-check Spark-Connect codecov CRAN
status

Integrates sparklyr with PySpark and Databricks. The main reason of this package is because the new Spark and Databricks Connect connection method does not work with standard sparklyr integration.

Installing

To install the version in CRAN use:

install.packages("pysparklyr")

To get the development version from GitHub use:

remotes::install_github("mlverse/pysparklyr")

Using

To learn how to use, please visit the Spark / Databricks Connect article, available in the official sparklyr website: Spark Connect, and Databricks Connect v2



Try the pysparklyr package in your browser

Any scripts or data that you put into this service are public.

pysparklyr documentation built on April 3, 2025, 10:30 p.m.