tokens-class: Base method extensions for tokens objects

In quanteda: Quantitative Analysis of Textual Data

Base method extensions for tokens objects

Description

Extensions of base R functions for tokens objects.

Usage

## S3 method for class 'tokens'
unlist(x, recursive = FALSE, use.names = TRUE)

## S3 method for class 'tokens'
x[i, drop_docid = TRUE]

## S3 method for class 'tokens'
t1 + t2

## S3 method for class 'tokens_xptr'
c(...)

## S3 method for class 'tokens'
c(...)

Arguments

x	a tokens object
recursive	a required argument for unlist but inapplicable to tokens objects.
i	document names or indices for documents to extract.
drop_docid	if TRUE, docid for documents are removed as the result of extraction.
t1	tokens one to be added
t2	tokens two to be added

Value

unlist returns a simple vector of characters from a tokens object.

c(...) and + return a tokens object whose documents have been added as a single sequence of documents.

Examples

toks <- tokens(c(d1 = "one two three", d2 = "four five six", d3 = "seven eight"))
str(toks)
toks[c(1,3)]
# combining tokens
toks1 <- tokens(c(doc1 = "a b c d e", doc2 = "f g h"))
toks2 <- tokens(c(doc3 = "1 2 3"))
toks1 + toks2
c(toks1, toks2)

quanteda documentation built on Sept. 11, 2024, 6:08 p.m.