tests/testthat/test.Tokenizer.R

In LazerLambda/RolliNLP: Natural Language Processing and String Editing Utilities

context("partitionText: Expecting correct behavior")

test_that("partitionText: Simple test I", {
  expect_equal(
    partitionText("Hello World."),
    list("Hello", "World", "."))
})

test_that("partitionText: Simple test I", {
  expect_error(partitionText(2))
})

# TODO: tests for getNGram