lsh_subset: List of all candidates in a corpus

In ropensci/textreuse: Detect Text Reuse and Document Similarity

List of all candidates in a corpus

Description

List of all candidates in a corpus

Usage

lsh_subset(candidates)

Arguments

candidates

A data frame of candidate pairs from lsh_candidates.

Value

A character vector of document IDs from the candidate pairs, to be used to subset the TextReuseCorpus.

Examples

dir <- system.file("extdata/legal", package = "textreuse")
minhash <- minhash_generator(200, seed = 234)
corpus <- TextReuseCorpus(dir = dir,
                          tokenizer = tokenize_ngrams, n = 5,
                          minhash_func = minhash)
buckets <- lsh(corpus, bands = 50)
candidates <- lsh_candidates(buckets)
lsh_subset(candidates)
corpus[lsh_subset(candidates)]

ropensci/textreuse documentation built on Aug. 8, 2024, 9:17 a.m.