knitr::opts_chunk$set(echo = TRUE)
r Biocpkg("rhdf5") provides limited support for read-only access to HDF5 files stored in Amazon S3 buckets. This is implemented via the (HDF5 S3 Virtual File Driver)[https://portal.hdfgroup.org/display/HDF5/Virtual+File+Drivers+-+S3+and+HDFS] and allows access to HDF5 files hosted in both public and private S3 buckets.
Currently only the functions
h5read() are supported.
To access a file in a public Amazon S3 bucket you provide the file's URL to the
file argument. You also need to set the argument
s3 = TRUE, otherwise
h5ls() will treat the URL as a path on the local disk fail.
public_S3_url <- "https://rhdf5-public.s3.eu-central-1.amazonaws.com/h5ex_t_array.h5" h5ls(file = public_S3_url, s3 = TRUE)
The same arguments are also valid for using
h5dump() to retrieve the contents of a file.
public_S3_url <- "https://rhdf5-public.s3.eu-central-1.amazonaws.com/h5ex_t_cmpd.h5" h5dump(file = public_S3_url, s3 = TRUE)
In addition to examining and reading whole files, we can also extract just a subset, without needed to read or download the entire file. In the example below we use
h5ls() to examine a file in an S3 bucket and identify the name of a dataset within it (
a1) and the number of dimensions for that dataset (3). We can then use
h5read() along with the
index arguments to read only a subset of the dataset into our R session.
public_S3_url <- 'https://rhdf5-public.s3.eu-central-1.amazonaws.com/rhdf5ex_t_float_3d.h5' h5ls(file = public_S3_url, s3 = TRUE) h5read(public_S3_url, name = "a1", index = list(1:2, 3, NULL), s3 = TRUE)
To access files in a private Amazon S3 bucket you will need to provide three additional details: The AWS region where the files are hosted, your AWS access key ID, and your AWS secret access key. More information on how to obtain AWS access keys can be found under AWS Security Credentials.
These three values need to be stored in a list like below. Important note: for now they must be in this specific order.
## these are example credentials and will not work s3_cred <- list( aws_region = "eu-central-1", access_key_id = "AKIAIOSFODNN7EXAMPLE", secret_access_key = "wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY" )
Finally we pass this list to
h5ls() via the
public_S3_url <- "https://rhdf5-private.s3.eu-central-1.amazonaws.com/h5ex_t_array.h5" h5ls(file = public_S3_url, s3 = TRUE, s3credentials = s3_cred)
s3credentials arguments is used in exactly the same way for
Any scripts or data that you put into this service are public.
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.