download_table: Download table to memory through gs:// and local fs Use case:...

In Bizovi/gcphelper: Utility functions for Google Cloud Processes

Description

Download table to memory through gs:// and local fs Use case: Big table to be fully downloaded and bq API will be too slow for that

Usage

download_table(project_id, dataset, table, bucket, job_name = NULL,
  read_csv_col_types = NULL, read_csv_guess_max = 10000,
  target_directory = getwd(), multi_file = FALSE)

Arguments

project_id	string
dataset	string
table	string
bucket	string gs:// Bucket for backups
job_name	string optional
read_csv_col_types	vector optional for parsing csv
read_csv_guess_max	numeric guess the type by nr rows
target_directory	string or function indicating where to store temp files
multi_file	Whether to load to memory multiple tables

Value

data.frame with the full table in memory

Bizovi/gcphelper documentation built on May 7, 2019, 8:19 a.m.