SqlImport: Manage SQL based data import.

In vimc/dettl: Data Extract, Transform, Test and Load

Manage SQL based data import.

Description

Manage SQL based data import.

Manage SQL based data import.

Details

This object should not be initialised directly. Use dettl to create the object.

Import can be run by working with import object returned by dettl or by running top-level functions. Run the import by working with this object if you want to step through the import process stage by stage and inspect the data after each stage.

Super class

dettl::Import -> SqlImport

Methods

Public methods

• SqlImport$reload()

• SqlImport$read_config()

Inherited methods

• dettl::Import$begin_transaction()
• dettl::Import$commit_transaction()
• dettl::Import$extract()
• dettl::Import$format()
• dettl::Import$get_connection()
• dettl::Import$get_log_table()
• dettl::Import$help()
• dettl::Import$initialize()
• dettl::Import$load()
• dettl::Import$pre_modify_checks()
• dettl::Import$rollback_transaction()
• dettl::Import$run_import()
• dettl::Import$transform()

---

Method reload()

Reload the objects sources to refresh source code or repair a broken Postgres connection.

Usage

SqlImport$reload()

---

Method read_config()

Read and parse config from path.

Usage

SqlImport$read_config()

Examples

path <- dettl:::prepare_test_import(
  system.file("examples", "sql_example", package = "dettl"),
  system.file("examples", "dettl_config.yml", package = "dettl"))
import_path <- file.path(path, "sql_example")

import <- dettl::dettl(import_path, db_name = "test")
import$run_import(stage = c("extract", "transform", "load"))

vimc/dettl documentation built on Oct. 6, 2022, 2:13 p.m.