tests/testthat/_snaps/tokenizer-tokenizersbpe.md

In tidymodels/textrecipes: Extra 'Recipes' for Text Processing

tokenizer works

Code
  vctrs::field(out, "lemma")
Condition
  Error:
  ! Invalid index: field name 'lemma' not found

Code
  vctrs::field(out, "pos")
Condition
  Error:
  ! Invalid index: field name 'pos' not found

tidymodels/textrecipes documentation built on June 12, 2025, 7:24 p.m.