get_tokens: Extract Tokens

In news-r/textanalysis: Text analysis

Description

Access tokens of documents as a vector.

Usage

get_tokens(document)

## S3 method for class 'document'
get_tokens(document)

## S3 method for class 'documents'
get_tokens(document)

## S3 method for class 'corpus'
get_tokens(document)

Arguments

document

A document as returned by the *_document family of functions, i.e.: string_document.

Examples

## Not run: 
init_textanalysis()

# build document
doc <- string_document("This is a document.")

# extract tokens
get_tokens(doc)

## End(Not run)

news-r/textanalysis documentation built on Nov. 4, 2019, 9:40 p.m.