rcpp_split: Rcpp Split

In avkoehl/textprocessingDSI: Clean an arbitrarily large corpus for topic modelling over many cores

Description

This function reads in a file and splits it into smaller segments either by byte size or by line count dependent on user input. When finished, it deletes the original file.

Usage

rcpp_split(fpath, odir, splitter, count)

Arguments

fpath	A string specifying the path to the input file.
odir	A string specifying the path to the output.
splitter	Either l or c, 'l' for lines, 'c' for kilobytes.
count	Number of lines or kilobytes to split the file on based on splitter. Returns number of output files.

avkoehl/textprocessingDSI documentation built on June 5, 2019, 7:41 p.m.