sitemaps: Retrieve a character vector of sitemaps from a parsed...
In spiderbar: Parse and Test Robots Exclusion Protocol Files and Rules
sitemaps R Documentation
Retrieve a character vector of sitemaps from a parsed robots.txt object
Description
Retrieve a character vector of sitemaps from a parsed robots.txt object
Usage
sitemaps(xp)
Arguments
xp
A robxp object
Value
charcter vector of all sitemaps found in the parsed robots.txt file
Examples
imdb <- paste0(readLines(system.file("extdata", "imdb-robots.txt",
package="rep")), collapse="\n")
rt <- robxp(imdb)
sitemaps(rt)
spiderbar documentation built on Feb. 16, 2023, 7:39 p.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
| sitemaps | R Documentation |
Retrieve a character vector of sitemaps from a parsed robots.txt object
Description
Retrieve a character vector of sitemaps from a parsed robots.txt object
Usage
sitemaps(xp)
Arguments
xp |
A |
Value
charcter vector of all sitemaps found in the parsed robots.txt file
Examples
imdb <- paste0(readLines(system.file("extdata", "imdb-robots.txt",
package="rep")), collapse="\n")
rt <- robxp(imdb)
sitemaps(rt)
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.