updateR: Update crawlDB

In barob1n/crawlR: Async Web crawler for R.

Update crawlDB

Description

Updates the crawlDB with links discovered during crawl. The crawlDB must already exist.

Usage

updateR(
  work_dir = NULL,
  out_dir = NULL,
  log_file = NULL,
  overwrite = F,
  score_func = NULL
)

Arguments

work_dir	(Required) Working directory for this crawl.
out_dir	(Required) Working directory for this crawl.
log_file	Name of log file. If null, writes to stdout().
overwrite	If true, all crawled links will be entered into DB as fresh unseen links.
score_func	Function to score urls

Value

Returns character vector of links, or error message.

barob1n/crawlR documentation built on May 23, 2023, 10:53 a.m.