spark_rcpp_read_warc: Reads a WARC File into using Rcpp
In javierluraschi/sparkwarc: Load WARC Files into Apache Spark
Description
Reads a WARC (Web ARChive) file using Rcpp.
Usage
1
spark_rcpp_read_warc(path, match_warc, match_line)
Arguments
path
The path to the file. Needs to be accessible from the cluster.
Supports the "hdfs://", "s3n://" and "file://" protocols.
match_warc
include only warc files mathcing this character string.
match_line
include only lines mathcing this character string.
javierluraschi/sparkwarc documentation built on Jan. 17, 2022, 5:51 a.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Description
Reads a WARC (Web ARChive) file using Rcpp.
Usage
1 | spark_rcpp_read_warc(path, match_warc, match_line)
|
Arguments
path |
The path to the file. Needs to be accessible from the cluster. Supports the "hdfs://", "s3n://" and "file://" protocols. |
match_warc |
include only warc files mathcing this character string. |
match_line |
include only lines mathcing this character string. |
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.