Man pages for madedotcom/retl
Support for common ETL operations and connections

bqAlterTableExecutes ALTER TABLE DML command to set table option value
bqAssertUniqueChecks for duplicates found on primary key
bqAuthWrapper for the set_service_token that uses...
bqCopyDatasetSchemaCopies all tables from one dataset to another through schema...
bqCopyTableCopies table in BigQuery
bqCopyTableSchemaCopies table through schema defintion
bqCountDuplicatesCounts any duplicate rows in a table when grouped by key(s)
bqCreatePartitionTableCreates partition table for a given sql
bqCreateTableCreates table using given sql
bqDatasetDataset manipulation functions
bqDatasetLocationGets meta of given dataset
bqDeletePartitionDeletes a specific partition of a partition table.
bqExistingPartitionDatesGets existing dates for date partitioned table in BigQuery
bqExtractTableExports BigQuery table into Google Cloud Storage file
bqImportDataImports data from gs to BigQuery table
bqInsertDataInserts data into BigQuery table
bqInsertLargeDataInserts LARGE data into BigQuery table
bqInsertPartitionInserts data table into a specific partition of a partition...
bqPartitionNameCreates partition name by combining table and partition date.
bqProjectFunctions to work with BigQuery projects
bqQueryFunctions that execute query against BigQuery database
bqRefreshPartitionDataFunctions to update existing partitions in the target table
bqSchemaExtract schema as JSON from data.table
bqSetdiffSchemasFinds asymmetric difference between two sets of bq_fields...
bqTableFunctions to work with BigQuery tables
bqTransformPartitionFunctions to transforms partitioned data form one table to...
bqUpdateTableDescriptionSets description of the table
bqUseLegacySqlGets the value from the corresponding environment variable as...
bqVectorToCaseReturns a case clause based on binning the input vector to...
conformHeaderReplace " ", "-" and "_" with a given separator in the...
dbExecuteQueryExecutes SQL query against the database
dbExecuteQueryFileExecutes statement in the SQL file
dbGetConnectionCreates db connection based on the environment variables
dcPredictionBodyCreates list for the DoubleClick API call from prediction...
dcWriteCustomMetricsWrites custom metrics to DoubleClick Floodlight requires...
disaggregateSplits table rows into multiple by the integer "by". All...
extensionFromFormatConverts possible BigQuery extract formats to file extensions
getMissingDatesGets dates that are missing from the date range for a give...
gsAuthAuthentication for google sheets. Requires access_token.json...
gsLoadAllLoads all sheets from a google spreadsheet into a list with...
gsLoadSheetLoads google spreadsheet via key
gsPathUrimakes full path to the gs file from relative part
gsTablePathmakes relative path to a file to mirror table path
gsUriGets gs uri to mirror table by name
logModelPerformanceLogs model performance data.frame to BigQuery table
metricsToListConverts named vector of metrics to a list
readSqlCreates SQL statement from the source file
readSqlGlueGlues variables passed in ellipsis into a text of the file
s3GetDataLoads data from several files in S3 based on the path prefix
s3GetFileLoads data from AWS S3 into data.table object
s3GetObjectPathGets the path to the object based on the root path setup via...
s3ListFilesLists files that match given path
s3PutFileSaves data to a file in AWS S3
safeLookupFunction to safely append values to a data.table from another...
sqlRangeFunctions that allow to convert numeric vector in to SQL case...
with_mock_bigqueryExecutes given query against stub data from a given query...
madedotcom/retl documentation built on Sept. 19, 2022, 3:28 a.m.