rt_get_rtxt: load robots.txt files saved along with the package

Description Usage Arguments

View source: R/tools.R

Description

load robots.txt files saved along with the package: these functions are very handy for testing (not used otherwise)

Usage

1

Arguments

name

name of the robots.txt files, defaults to a random drawn file ;-)


robotstxt documentation built on Sept. 4, 2020, 1:08 a.m.