bqImportData: Imports data from gs to BigQuery table

In madedotcom/retl: Support for common ETL operations and connections

Imports data from gs to BigQuery table

Description

Imports data from gs to BigQuery table

Usage

bqImportData(
  table,
  dataset = bqDefaultDataset(),
  path = "",
  append = TRUE,
  format = "CSV",
  compression = "GZIP",
  nskip = 1,
  bucket = Sys.getenv("GCS_BUCKET")
)

Arguments

table	name of the table to extract
dataset	name of the dataset
path	path to the file in gs, defaults to default-bucket/default-dataset/table-name.csv.gz.
append	defines whether data can be appended to the table with data
format	The exported file format. Possible values include "CSV", "NEWLINE_DELIMITED_JSON" and "AVRO". Tables with nested or repeated fields cannot be exported as CSV.
compression	The compression type to use for exported files. Possible values include "GZIP", "DEFLATE", "SNAPPY", and "NONE". "DEFLATE" and "SNAPPY" are only supported for Avro.
nskip	number of rows to skip on importing the file
bucket	name of the GCS bucket from where data will be loaded

Value

object of 'bq_job'

See Also

?bigrquery::bq_table_save

madedotcom/retl documentation built on Sept. 19, 2022, 3:28 a.m.