emr_presto_launch_instance: Launches an EMR Presto instanct (5 x m4.4xlarge). Synchronous...

In alesaccoia/alexr: Common routines and datasets for GIS and Big Data Research

Description

Launches an EMR Presto instanct (5 x m4.4xlarge). Synchronous and can take a while!

Usage

emr_presto_launch_instance(
  cluster_name = "R Cluster",
  instance_type = "c5.4xlarge",
  instance_count = 4,
  query_max_memory = "150GB",
  query_max_memory_per_node = "64GB",
  max_connections = 100,
  verbose = F,
  request_as_spot_instance = F
)

Arguments

cluster_name	Cluster name defaults to R Cluster
instance_type	Type defaults to c5.4xlarge
instance_count	Number of slaves defaults to 4
query_max_memory	Max memory (default '150GB')
query_max_memory_per_node	Max memory per node (default 64GB)
max_connections	Max connections (default 100)
verbose	Continuously logs the cluster status while starting it
request_as_spot_instance	Tries to reserve as spot instance

Value

the cluster_id

Examples

cluster_id <- emr_presto_launch_instance("Test Cluster", instance_type = "c5.4xlarge", instance_count = 4)
instance_dns <- emr_presto_get_instance_dns_name(cluster_id)
con <- emr_presto_get_db_connection(instance_dns)
res <- dbSendQuery(con, 'SELECT 1')
all_rows <- dbFetch(res, -1)
emr_presto_stop_instance(cluster_id)

alesaccoia/alexr documentation built on Dec. 19, 2021, 12:26 a.m.