parse_url: parse_url

In petermeissner/robotstxt: A 'robots.txt' Parser and 'Webbot'/'Spider'/'Crawler' Permissions Checker

parse_url

Description

parse_url

Usage

parse_url(url)

Arguments

url	url to parse into its components

Value

data.frame with columns protocol, domain, path

Examples

## Not run: 
url <-
c(
  "google.com",
  "google.com/",
  "www.google.com",
  "http://google.com",
  "https://google.com",
  "sub.domain.whatever.de"
  "s-u-b.dom-ain.what-ever.de"
)

parse_url(url)

## End(Not run)

petermeissner/robotstxt documentation built on Jan. 13, 2023, 2:07 a.m.