is_spider: check whether a request is from a spider
In wikimedia-research/pageviews: Wikimedia Pageview definition-related utilities
Description
Usage
Arguments
Value
See Also
Description
consumes a vector of user agents and checks whether each one
matches the ua-parser spider definitions. In addition, it looks for Wikimedia-specific
spiders that aren't included in the (generalised) spider list.
Usage
1
is_spider(user_agents)
Arguments
user_agents
a vector of user agents, which can be retrieved with
read_sampled_log.
Value
a boolean vector identifying whether the user agent at the equivalent indices
in the input vector matched that of a spider/web crawler or not.
See Also
read_sampled_log for retrieving user agents, and
is_automata for identifying non-crawler automata.
wikimedia-research/pageviews documentation built on May 4, 2019, 5:24 a.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Description Usage Arguments Value See Also
Description
consumes a vector of user agents and checks whether each one matches the ua-parser spider definitions. In addition, it looks for Wikimedia-specific spiders that aren't included in the (generalised) spider list.
Usage
1 | is_spider(user_agents)
|
Arguments
user_agents |
a vector of user agents, which can be retrieved with
|
Value
a boolean vector identifying whether the user agent at the equivalent indices in the input vector matched that of a spider/web crawler or not.
See Also
read_sampled_log for retrieving user agents, and
is_automata for identifying non-crawler automata.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.