sparkwarc: Load WARC Files into Apache Spark

Load WARC (Web ARChive) files into Apache Spark using 'sparklyr'. This allows to read files from the Common Crawl project <>.

Getting started

Package details

AuthorJavier Luraschi [aut, cre]
MaintainerJavier Luraschi <>
LicenseApache License 2.0
Package repositoryView on CRAN
Installation Install the latest version of this package by entering the following in R:

Try the sparkwarc package in your browser

Any scripts or data that you put into this service are public.

sparkwarc documentation built on May 2, 2019, 2:49 p.m.