rt_get_useragent: extracting HTTP useragents from robots.txt

Description Usage Arguments

View source: R/rt_get_useragent.R

Description

extracting HTTP useragents from robots.txt

Usage

1

Arguments

txt

content of the robots.txt file


petermeissner/robotstxt documentation built on Jan. 14, 2019, 9:51 p.m.