S3SparkResourceConnector | R Documentation |
Apache Spark DBI resource connector for S3
Apache Spark DBI resource connector for S3
A R6 object of class SparkResourceConnector
Makes a Apache Spark connection object, that is also a DBI connection object, from a S3 resource description.
resourcer::DBIResourceConnector
-> resourcer::SparkResourceConnector
-> S3SparkResourceConnector
new()
Create a SparkResourceConnector instance.
S3SparkResourceConnector$new()
A SparkResourceConnector object.
isFor()
Check if the provided resource applies to a Apache Spark server. The resource URL scheme must be one of "s3+spark", "s3+spark+http" or "s3+spark+https".
S3SparkResourceConnector$isFor(resource)
resource
The resource object to validate.
A logical.
createDBIConnection()
Creates a DBI connection object from a Apache Spark resource.
S3SparkResourceConnector$createDBIConnection(resource)
resource
A valid resource object.
A DBI connection object.
getTableName()
Get the SQL table name from the resource URL.
S3SparkResourceConnector$getTableName(resource)
resource
A valid resource object.
The SQL table name.
readDBTable()
Read a table as a vanilla tibble using DBI connection object.
S3SparkResourceConnector$readDBTable(conn, resource)
conn
A DBI connection object.
resource
A valid resource object.
readDBTibble()
Read a table as a SQL tibble using DBI connection object.
S3SparkResourceConnector$readDBTibble(conn, resource)
conn
A DBI connection object.
resource
A valid resource object.
closeDBIConnection()
Close the DBI connection to Apache Spark.
S3SparkResourceConnector$closeDBIConnection(conn)
conn
A DBI connection object.
clone()
The objects of this class are cloneable with this method.
S3SparkResourceConnector$clone(deep = FALSE)
deep
Whether to make a deep clone.
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.