bq_query_gcs: Download view results to memory through BQ gs:// and local fs...

In Bizovi/gcphelper: Utility functions for Google Cloud Processes

Description

Download view results to memory through BQ gs:// and local fs Use case: Big view results to be fully downloaded and bq API will be too slow for that Note that it cleans up all temporary stuff after itself

Usage

bq_query_gcs(sql, project, use_legacy_sql = FALSE, quiet = FALSE,
  target_dataset, target_bucket, target_directory = getwd(),
  job_name = NULL, multi_file = FALSE, read_csv_col_types = NULL,
  read_csv_guess_max = 10000)

Arguments

sql	string the query you want to execute and store
project	string
use_legacy_sql	boolean
quiet	boolean
target_dataset	string
target_bucket	string
target_directory	string or function indicating where to store temp files
job_name	string optional
multi_file	Whether to load to memory multiple tables
read_csv_col_types	vector optional for parsing csv
read_csv_guess_max	numeric guess the type by nr rows

Value

data.frame with the full table in memory

Bizovi/gcphelper documentation built on May 7, 2019, 8:19 a.m.