DSL: Distributed Storage and List
Version 0.1-6

An abstract DList class helps storing large list-type objects in a distributed manner. Corresponding high-level functions and methods for handling distributed storage (DStorage) and lists allows for processing such DLists on distributed systems efficiently. In doing so it uses a well defined storage backend implemented based on the DStorage class.

Browse man pages Browse package API and functions Browse package files

AuthorIngo Feinerer [aut], Stefan Theussl [aut, cre], Christian Buchta [ctb]
Date of publication2015-07-02 19:39:19
MaintainerStefan Theussl <Stefan.Theussl@R-project.org>
LicenseGPL-3
Version0.1-6
Package repositoryView on R-Forge
InstallationInstall the latest version of this package by entering the following in R:
install.packages("DSL", repos="http://R-Forge.R-project.org")

Man pages

gather: Gather Distributed Data
keyvalue: Key/Value Pairs
list: Distributed List Class
map: MapReduce for '"DList"' Objects
storage: Virtual Distributed Storage Class

Functions

DGather Man page Source code
DKeys Man page Source code
DL_storage Man page Source code
DL_storage.DList Source code
DL_storage<- Man page
DLapply Man page Source code
DList Man page Source code Source code
DList_add_revision Source code
DMap Man page Source code Source code
DMap.HDFS Source code
DMap.LFS Source code
DPair Source code
DReduce Man page Source code Source code
DReduce.HDFS Source code
DReduce.LFS Source code
DSL_get_text_mapping_from_revision Source code
DSL_hash Source code
DSL_serialize_object Source code
DSL_split_line Source code
DSL_unserialize_object Source code
DS_base_dir Source code
DS_chunksize Source code
DS_default Source code
DS_dir_create Source code
DS_empty Source code
DS_fetch_last_line Source code
DS_get Source code
DS_init Source code
DS_list_directory Source code
DS_put Source code
DS_read_lines Source code
DS_unlink Source code
DS_write_lines Source code
DStorage Man page Source code Source code
FS_mapper Source code
FS_reducer Source code
HDFS_identity_mapper Source code
HDFS_mapper Source code
HDFS_reducer Source code
Keys Source code
LFS_remove Source code
MapReduce Source code
as.DList Man page Source code
as.DList.DList Source code
as.DList.character Source code
as.DList.list Source code
as.DStorage Source code
as.list.DList Source code
check_contents_of_storage Source code
check_storage_for_sanity Source code
collector2 Source code
fix_chunknames Source code
get_chunks Source code
get_chunks_after_MapReduce Source code
get_chunks_from_current_revision Source code
get_keys_from_current_revision Source code
is.DList Man page Source code
is.DStorage Man page Source code
length.DList Source code
make_DSL_revision Source code
make_HDFS_storage Source code
make_LFS_storage Source code
make_chunk_filename Source code
make_chunk_handler Source code
make_chunk_signature Source code
names.DList Source code
print.DList Source code
print.DStorage Source code
read_chunk_signature Source code
revisions Source code
stamp Source code
summary.DStorage Source code

Files

DESCRIPTION
NAMESPACE
R
R/HDFS.R
R/LFS.R
R/gather.R
R/list.R
R/map.R
R/reduce.R
R/storage.R
R/utils.R
build
build/vignette.rds
inst
inst/doc
inst/doc/DSL.R
inst/doc/DSL.Rnw
inst/doc/DSL.pdf
inst/examples
inst/examples/file01
inst/examples/file02
man
man/gather.Rd
man/keyvalue.Rd
man/list.Rd
man/map.Rd
man/storage.Rd
src
src/collector.c
vignettes
vignettes/DSL.Rnw
vignettes/DSL.bib
DSL documentation built on May 21, 2017, 4:06 a.m.