bqTransformPartition: Functions to transforms partitioned data form one table to...

In madedotcom/retl: Support for common ETL operations and connections

Functions to transforms partitioned data form one table to another

Description

'bqTransformPartition' creates new partitions for the missing dates

Usage

bqTransformPartition(
  table,
  file,
  ...,
  missing.dates = NULL,
  priority = "INTERACTIVE",
  use.legacy.sql = bqUseLegacySql()
)

Arguments

table	destination partition table where results of the query will be saved
file	path to the sql file that will be used for the transformation
...	parameters that will be passed via 'sprintf' to build dynamic SQL. partition date will be always passed first in format 'yyyymmdd' followed by arguments in '...'
missing.dates	dates for which to run this function for
priority	Default to INTERACTIVE
use.legacy.sql	Defaults to env variable if specified

madedotcom/retl documentation built on Sept. 19, 2022, 3:28 a.m.