tok_decoder: Generic class for decoders

In tok: Fast Text Tokenization

Generic class for decoders

Description

Generic class for decoders

Generic class for decoders

Public fields

.decoder

The raw pointer to the decoder

Methods

Public methods

• tok_decoder$new()

• tok_decoder$clone()

---

Method new()

Initializes a decoder

Usage

tok_decoder$new(decoder)

Arguments

decoder

a raw decoder pointer

---

Method clone()

The objects of this class are cloneable with this method.

Usage

tok_decoder$clone(deep = FALSE)

Arguments

deep

Whether to make a deep clone.

See Also

Other decoders: decoder_byte_level

tok documentation built on Sept. 11, 2024, 5:21 p.m.