rehash: Recompute the hashes for a document or corpus

In ropensci/textreuse: Detect Text Reuse and Document Similarity

Recompute the hashes for a document or corpus

Description

Given a TextReuseTextDocument or a TextReuseCorpus, this function recomputes either the hashes or the minhashes with the function specified. This implies that you have retained the tokens with the keep_tokens = TRUE parameter.

Usage

rehash(x, func, type = c("hashes", "minhashes"))

Arguments

x	A TextReuseTextDocument or TextReuseCorpus.
func	A function to either hash the tokens or to generate the minhash signature. See hash_string, minhash_generator.
type	Recompute the hashes or minhashes?

Value

The modified TextReuseTextDocument or TextReuseCorpus.

Examples

dir <- system.file("extdata/legal", package = "textreuse")
minhash1 <- minhash_generator(seed = 1)
corpus <- TextReuseCorpus(dir = dir, minhash_func = minhash1, keep_tokens = TRUE)
head(minhashes(corpus[[1]]))
minhash2 <- minhash_generator(seed = 2)
corpus <- rehash(corpus, minhash2, type = "minhashes")
head(minhashes(corpus[[2]]))

ropensci/textreuse documentation built on Feb. 17, 2025, 4:36 a.m.