get_links_to_resources: Scrape the "Links to Resources" Section at a Registry Number...

In meerapatelmd/skyscraper: Scrape Clinical Drug Data

Description

All ChemiDPlus Scraping Functions operate on a Registry Number URL (rn_url). The initial search is logged to a "REGISTRY_NUMBER_LOG" Table. If the RN URL is then tested for 404 Status and logged to the "RN_URL_VALIDITY" Table. The major sections found at the ChemiDPlus site are: "Names and Synonyms", "Classification", "Registry Numbers", "Links to Resources" with these sections are written to their respective tables "NAMES_AND_SYNONYMS", "CLASSIFICATION", "REGISTRY_NUMBERS", and "LINKS_TO_RESOURCES".

Usage

get_links_to_resources(
  conn,
  rn_url,
  response,
  schema = "chemidplus",
  sleep_time = 3,
  verbose = verbose
)

Arguments

conn	Postgres connection object
rn_url	Registry number URL to read that also serves as an Identifier
response	(optional) "xml_document" "xml_node" class object returned by xml2::read_html for the rn_url argument. Providing a response from a single HTML read reduces the chance of encountering a HTTP 503 error when parsing multiple sections from a single URL. If a response argument is missing, a response is read. Followed by the sleep_time in seconds.
schema	Schema that the returned data is written to, Default: 'chemidplus'
sleep_time	If the response argument is missing, the number seconds to pause after reading the URL, Default: 3

Value

Each section is parsed by a respective skyscraper function that stores the scraped results in a table of the same name in a schema. If a connection argument is not provided, the results are returned as a dataframe in the R console.

Links to Resources

The "Links to Resources" Section derives all the HTML links to other data and web sources for the drug. The results include a Timestamp, RN URL, and the Resource Agency and its HTML link.

See Also

read_xml lsSchema,createSchema,lsTables,query,buildQuery,appendTable,writeTable html_nodes,html_text map as_tibble bind,mutate,filter_all

Other chemidplus scraping: get_classification(), get_names_and_synonyms(), get_registry_numbers(), get_rn_url_validity(), log_registry_number()

meerapatelmd/skyscraper documentation built on Dec. 27, 2020, 7:46 a.m.