filesampler: File Sampler
In wrathematics/lineSampler: File Sampler
Description
Details
Author(s)
References
Description
File Sampler
Details
A simple package for reading subsamples of flat text files by line in a
reasonably efficient manner. We do so by sampling as the input file is
scanned and randomly choosing whether or not to dump the current line to an
external temporary file. This temporary file is then read back into R. For
(aggressive) downsampling, this is a very effective strategy; for resampling,
you are much better off reading the full dataset into memory.
The basic function performs the sampling/reading in a single pass. There is
an alternative version which allows for an exact amout to be subsampled via
reservoir sampling, but this version requires 2 passes through the data. The
heavy lifting is done entirely in C.
This package, including the underlying C library, is licensed under the
permissive 2-clause BSD license.
Author(s)
Drew Schmidt wrathematics@gmail.com
References
Project URL: https://github.com/wrathematics/filesampler
wrathematics/lineSampler documentation built on Feb. 27, 2020, 8:01 p.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Description Details Author(s) References
Description
File Sampler
Details
A simple package for reading subsamples of flat text files by line in a reasonably efficient manner. We do so by sampling as the input file is scanned and randomly choosing whether or not to dump the current line to an external temporary file. This temporary file is then read back into R. For (aggressive) downsampling, this is a very effective strategy; for resampling, you are much better off reading the full dataset into memory.
The basic function performs the sampling/reading in a single pass. There is an alternative version which allows for an exact amout to be subsampled via reservoir sampling, but this version requires 2 passes through the data. The heavy lifting is done entirely in C.
This package, including the underlying C library, is licensed under the permissive 2-clause BSD license.
Author(s)
Drew Schmidt wrathematics@gmail.com
References
Project URL: https://github.com/wrathematics/filesampler
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.