bt_scraper_checkpoint_2: checks scraped data is ready for upload

In global-trade-alert/gtabastiat:

checks scraped data is ready for upload

Description

Ensures: update.table exists the 17 required vars are there the date is correctly formatted as a date the BIDs are unique the titles are unique the URLs are unique

Usage

bt_scraper_checkpoint_2(ignore.url = F, ignore.titles = F)

Arguments

ignore.url

set this as T if you know your source only has one URL shared for all leads.

Details

17 required vars are: "act.date", "act.title.en", "act.description.en","act.title.ll", "act.description.ll", "act.url", "act.id", "country", "country.lead","email.language","act.values", "background.url", "acting.agency", "relevant", "classify","collection.date", "bid"

Value

'OK!' if all is well, error if not.

global-trade-alert/gtabastiat documentation built on June 4, 2023, 6:40 a.m.