Man pages for vimc/dettl
Data Extract, Transform, Test and Load
| add_fk_data | Add tables with foreign key constraints for testing |
| add_missing_function_fields | Add any missing required fields to the config using defaults... |
| convert_bit64_columns | Convert any bit64 type columns to integers. |
| db_connect | Connect to the database configured via yaml. |
| db_get_log_table | Get the log table name from configuration for a particular db |
| dettl | Create an import object using functions defined at specified... |
| dettl_auto_load | Automatic load function for append mode imports. |
| dettl_auto_load_create | Automatic load function for create mode imports. |
| dettl_config | Get db config from path. |
| dettl_config_read_yaml | Read yaml file representing a db config. |
| dettl_create_log_table | Initialise the database by creating log table if it doesn't... |
| dettl_db_args | Get the DB args from config. |
| dettl_locate_config | Locate the directory containing the config file. |
| dettl_new | Create new directory and templated code for new dettl... |
| dettl_run | Run specified stages of an import |
| dettl_save | Save data |
| expand_wildcards | Expand any wildcards in source file paths. |
| get_fk_constraints | Get FK constraints |
| get_network_dependencies | Construct list of network dependencies for use in building... |
| get_non_empty_columns | Get non-empty columns |
| get_postgres_fk | Get FK constraints for postgres connection |
| get_sqlite_fk | Get FK constraints for SQLite connection |
| git_branch | Get the current git branch from path. |
| git_email | Get the git user.email from git dir |
| git_hash | Get the full hash of the current git HEAD |
| git_repo_is_clean | Check if git repo is clean |
| git_root_directory | Locate the git project root directory |
| git_user | Get the git user.name from git dir |
| Import | Generic import object. |
| ImportLog | Generate log data and manage recording timings for an import |
| insert_into_returning | Insert values into table returning the primary key |
| load_sources | Read file fields of the dettl config yaml file. |
| parse_constraints | Parse foreign key constraint data frame into list... |
| parse_sql_date | Parse date into POSIXct UTC from SQL db. |
| postgres_insert_empty_row | Insert an empty row and returned desired columns. |
| prepare_example_db | Prepare example db |
| prepare_test_import | Prepare example import inside a git repo |
| read_function_fields | Read function fields of the dettl config yaml file. |
| read_r_config | Get dettl config from path for an R import. |
| read_sql_config | Get dettl config from path for a SQL only import. |
| RImport | Manage R based data import. |
| run_extract | Run extract step. |
| run_transform | Run transform step. |
| setup_dettl | Setup dettl import in a tempdir. |
| sql_dialect | Get the SQL dialect used for a connection. |
| SqlImport | Manage SQL based data import. |
| sqlite_enable_fk | Enable foreign key constraints for SQLite connections |
| sqlite_execute_query | Execute sql insert query returning added columns desired... |
| sqlite_insert_empty_row | Insert an empty row and returned desired columns. |
| test_extract | Run tests for the extract step. |
| test_transform | Run tests for transform step. |
| update_child_tables | Update child tables using inserted foreign keys |
| verify_data | Verify the transformed data adhered to the DB schema. |
| verify_table | Verify the data adheres to the DB schema. |
