In hrbrmstr/publicwww: Query the 'PublicWWW' Source Code Search Engine

publicwww

Query the 'PublicWWW' Source Code Search Engine

Description

The 'PublicWWW' https://publicwww.com/ source code search engine indexes the content of over 200 million web sites and provides a query interface that lets the caller find any alphanumeric snippet, signature or keyword in the web pages 'HTML', 'JavaScript' and 'CSS' style sheet code.

NOTE

The site requires an API key and has limited functionality under the free plan.

What's Inside The Tin

The following functions are implemented:

• source_code_search: Find any alphanumeric snippet, signature or keyword in the web pages HTML, JS and CSS code in the PublicWWW database

Installation

devtools::install_github("hrbrmstr/publicwww")

options(width=120)

Usage

library(publicwww)
library(tidyverse)

# current verison
packageVersion("publicwww")

Sites using the WordPress theme "Twenty Sixteen":

source_code_search('"/wp-content/themes/twentysixteen/"')

Sites running the coinhive JS miner

source_code_search('"coin-hive.com/lib/coinhive.min.js"')

Sites (theoretically) running Drupal

source_code_search('"/sites/all/themes/"', snippets = TRUE)

hrbrmstr/publicwww documentation built on May 28, 2019, 2:31 a.m.