rt_get_comments: extrcting comments from robots.txt

Description Usage Arguments

View source: R/parse_robotstxt.R

Description

extrcting comments from robots.txt

Usage

1

Arguments

txt

content of the robots.txt file


robotstxt documentation built on July 17, 2017, 1:03 a.m.