| DocumentChunker | R Documentation |
Splits documents into text units
chunk_sizeTarget chunk size
chunk_overlapOverlap size
by_sentencePreserve sentences
new()Create a new DocumentChunker
DocumentChunker$new(chunk_size = 1200, chunk_overlap = 100, by_sentence = TRUE)
chunk_sizeTarget size
chunk_overlapOverlap
by_sentencePreserve sentences
chunk()Chunk a document
DocumentChunker$chunk(text, document_id = NULL)
textDocument text
document_idDocument ID
List of TextUnit objects
clone()The objects of this class are cloneable with this method.
DocumentChunker$clone(deep = FALSE)
deepWhether to make a deep clone.
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.