bt_sa_record_new_source: Checks state acts for URLs and adds them to the tables for...

In global-trade-alert/gtabastiat:

Checks state acts for URLs and adds them to the tables for scraping later on. Step 1 in source collection process.

Description

Checks state acts for URLs and adds them to the tables for scraping later on. Step 1 in source collection process.

Usage

bt_sa_record_new_source(
  establish.connection = T,
  timeframe = NA,
  recheck.existing.sources = F,
  ignore.manually.added = T,
  exclude.data.dump.measures = T,
  specific.sa.ids = NA
)

Arguments

establish.connection	If T, opens the DB connection.
timeframe	Search for sources in the last timeframe days.
recheck.existing.sources	If T, try to scrape sources for entries which have already been added to gta_url_log.
ignore.manually.added	If T, do not search for sources for measures that have an associated file in gta_files. Note that there is no way to distinguish if a file is present for a particular SOURCE.

global-trade-alert/gtabastiat documentation built on June 4, 2023, 6:40 a.m.