scrape_article_urls: Find new article urls on index pages and insert into db

View source: R/scrape-blog.R

scrape_article_urlsR Documentation

Find new article urls on index pages and insert into db

Description

scrape_article_urls(blog_config, db_config) searches index pages of specified blog for article urls that are not yet present in the db, and inserts those article urls into the db.

Usage

scrape_article_urls(blog_config, db_config, run_test = F)

Arguments

blog_config

list specifying with blog parameters

db_config

list database connection parameters

run_test

process only one index page and do not committ changes to db


digital-geopolitics/dgblogs documentation built on March 22, 2022, 6:40 p.m.