R/get_html_for_url.R

Defines functions get_html_for_url

get_html_for_url <- function(url, sleep=0){

  remDr <- get_selenium_session()

  remDr$navigate(url)

  if(sleep > 0){
    Sys.sleep(sleep)
  }

  remDr$getPageSource() |> dplyr::first() |> xml2::read_html()
}
stupidpupil/senedd_scraper documentation built on Feb. 18, 2025, 10:14 p.m.