tests/testthat/_snaps/tokenizer-tokenizersbpe.md

In EmilHvitfeldt/textrecipes: Extra 'Recipes' for Text Processing

tokenizer works

Code
  vctrs::field(out, "lemma")
Condition
  Error:
  ! Invalid index: field name 'lemma' not found

Code
  vctrs::field(out, "pos")
Condition
  Error:
  ! Invalid index: field name 'pos' not found

EmilHvitfeldt/textrecipes documentation built on April 7, 2024, 5:02 a.m.