Streamer: Enabling stream processing of large files

Large data files can be difficult to work with in R, where data generally resides in memory. This package encourages a style of programming where data is 'streamed' from disk into R via a `producer' and through a series of `consumers' that, typically reduce the original data to a manageable size. The package provides useful Producer and Consumer stream components for operations such as data input, sampling, indexing, and transformation; see package?Streamer for details.

Package details

AuthorMartin Morgan, Nishant Gopalakrishnan
Bioconductor views DataImport Infrastructure
MaintainerMartin Morgan <>
Package repositoryView on Bioconductor
Installation Install the latest version of this package by entering the following in R:

Try the Streamer package in your browser

Any scripts or data that you put into this service are public.

Streamer documentation built on April 29, 2020, 5:40 a.m.