TextDataLoaders_from_folder: TextDataLoaders_from_folder

View source: R/text_data.R

TextDataLoaders_from_folderR Documentation

TextDataLoaders_from_folder

Description

Create from imagenet style dataset in 'path' with 'train' and 'valid' subfolders (or provide 'valid_pct')

Usage

TextDataLoaders_from_folder(
  path,
  train = "train",
  valid = "valid",
  valid_pct = NULL,
  seed = NULL,
  vocab = NULL,
  text_vocab = NULL,
  is_lm = FALSE,
  tok_tfm = NULL,
  seq_len = 72,
  backwards = FALSE,
  bs = 64,
  val_bs = NULL,
  shuffle_train = TRUE,
  device = NULL
)

Arguments

path

path

train

train data

valid

validation data

valid_pct

validation percentage

seed

random seed

vocab

vocabulary

text_vocab

text_vocab

is_lm

is_lm

tok_tfm

tok_tfm

seq_len

seq_len

backwards

backwards

bs

batch size

val_bs

validation batch size

shuffle_train

shuffle train data

device

device

Value

text loader


fastai documentation built on March 31, 2023, 11:41 p.m.