bqInsertLargeData: Inserts LARGE data into BigQuery table

In madedotcom/retl: Support for common ETL operations and connections

Inserts LARGE data into BigQuery table

Description

Truncates the target table and appends data broken in chunks

Usage

bqInsertLargeData(
  table,
  data,
  dataset = bqDefaultDataset(),
  chunks = NA_integer_,
  append = TRUE,
  schema.file = NULL,
  bucket = Sys.getenv("GCS_BUCKET")
)

Arguments

table	name of the target table
data	data to be inserted
dataset	name of the destination dataset
chunks	deprecated
append	specifies if data should be appended or truncated
schema.file	sets path to schema file for initialisation
bucket	name of the GCS bucket where data will be saved in temp file. Defaults to value of environment variable 'GCS_BUCKET'

Value

results of execution

madedotcom/retl documentation built on Sept. 19, 2022, 3:28 a.m.