rt_get_comments: extracting comments from robots.txt

Description Usage Arguments

View source: R/rt_get_comments.R

Description

extracting comments from robots.txt

Usage

1

Arguments

txt

content of the robots.txt file


robotstxt documentation built on Sept. 2, 2017, 1:13 a.m.