spark_write_text: Write a 'spark_tbl' to text file

In danzafar/tidyspark: A Tidy Interface to Spark

Description

Write a spark_tbl to a text file.

Usage

spark_write_text(.data, path, mode = "error", partition_by = NULL, ...)

Arguments

.data	a spark_tbl
path	string, the path where the file is to be saved.
mode	string, usually "error" (default), "overwrite", "append", or "ignore"
partition_by	string, column names to partition by on disk
...	any other named options. See details below.

Details

For text, two additional options can be specified using ...: #'

compression

(default null), compression codec to use when saving to file. This can be one of the known case-insensitive shorten names (none, bzip2, gzip, lz4, snappy and deflate).

lineSep

(default \n), defines the line separator that should be used for writing.

https://spark.apache.org/docs/latest/api/java/org/apache/spark/sql/DataFrameWriter.html#text-java.lang.String-

danzafar/tidyspark documentation built on Sept. 30, 2020, 12:19 p.m.