llama_detokenize: Detokenize token IDs back to text
In llamaR: Interface for Large Language Models via 'llama.cpp'

llama_detokenize

R Documentation

Detokenize token IDs back to text

Description

Detokenize token IDs back to text

Usage

llama_detokenize(ctx, tokens)

Arguments

`ctx`	Context handle returned by [llama_new_context]
`tokens`	Integer vector of token IDs (as returned by [llama_tokenize])

Value

A character scalar containing the decoded text.

Examples

## Not run: 
model <- llama_load_model("model.gguf")
ctx <- llama_new_context(model)

# Round-trip: text -> tokens -> text
original <- "Hello, world!"
tokens <- llama_tokenize(ctx, original, add_special = FALSE)
restored <- llama_detokenize(ctx, tokens)
identical(original, restored)  # TRUE

## End(Not run)

llamaR documentation built on May 28, 2026, 1:06 a.m.