In edgararuiz/bigdataclass: Setup of the Big Data with R class

eval_viz <- FALSE
if(Sys.getenv("GLOBAL_EVAL") != "") eval_viz <- Sys.getenv("GLOBAL_EVAL")

library(connections)
library(RSQLite)
library(dplyr)
library(dbplyr)
library(dbplot)
library(ggplot2)
library(leaflet)

Data Visualizations

Simple plot

Practice pushing the calculations to the database

1. Load the connections and dplyr libraries r library(connections) library(dplyr)

2. Use connection_open() to open a Database connection r {{db_connection}}

3. Use tbl() to create a pointer to the v_transactions table r orders <- tbl(con, "v_orders")

4. Use collect() bring back the aggregated results into a "pass-through" variable called by_year r by_year <- orders %>% count(date_year) %>% collect()

5. Preview the by_year variable r by_year

6. Load the ggplot2 library r library(ggplot2)

7. Plot results using ggplot2 r ggplot(by_year) + geom_col(aes(date_year, n))

8. Using the code in this section, create a single piped code set which also creates the plot r orders %>% count(date_year) %>% collect() %>% ggplot() + # < Don't forget to switch to `+` geom_col(aes(date_year, n))

Plot in one code segment

Practice going from dplyr to ggplot2 without using pass-through variable, great for EDA

1. Summarize the order totals in a new variable called: sales r orders %>% summarise(sales = sum(order_total))

2. Summarize the order totals in a new variable called: sales r orders %>% group_by(date_year) %>% summarise(sales = sum(order_total))

3. Summarize the order totals in a new variable called: sales r orders %>% group_by(date_year) %>% summarise(sales = sum(order_total)) %>% ggplot() + geom_col(aes(date_year, sales))

4. Switch the calculation to reflect the average of the order sale total r orders %>% group_by(date_year) %>% summarise(sales = mean(order_total)) %>% ggplot() + geom_col(aes(date_year, sales))

Create a histogram

Use the package's function to easily create a histogram

1. Load the dbplot package r library(dbplot)

2. Use the dbplot_histogram() to build the histogram r orders %>% dbplot_histogram(order_total)

3. Adjust the binwidth to 300 r orders %>% dbplot_histogram(order_total, binwidth = 10)

Raster plot

Use dbplot's raster graph

1. Use a dbplot_raster() to visualize order_qty versus order_total r orders %>% dbplot_raster(order_qty, order_total)

2. Change the plot's resolution to 10 r orders %>% dbplot_raster(order_qty, order_total, resolution = 10)

Using the calculate functions

1. Use the db_compute_raster() function to get the underlying results that feed the plot r locations <- orders %>% db_compute_raster2(customer_lon, customer_lat, resolution = 10)

2. Preview the locations variable r locations

3. Load the leaflet library r library(leaflet)

4. Pipe location into the leaflet() function, and then pipe that into the addTiles() function r locations %>% leaflet() %>% addTiles()

5. Add the addRectangles() function using the longitude and latitude variables

locations %>%
  leaflet() %>% 
    addTiles() %>%
    addRectangles(
      ~customer_lon, 
      ~customer_lat, 
      ~customer_lon_2,
      ~customer_lat_2
    )

1. Add the fillOpacity argument to the addRectangles() step, use n() as the value for it

locations %>%
  leaflet() %>% 
    addTiles() %>%
    addRectangles(
      ~customer_lon, 
      ~customer_lat, 
      ~customer_lon_2,
      ~customer_lat_2,
      fillOpacity = ~`n()`
    )

1. Modify fillOpacity to be calculated as a percentage against the maximum number of oders

locations %>%
  leaflet() %>% 
    addTiles() %>%
    addRectangles(
      ~customer_lon, 
      ~customer_lat, 
      ~customer_lon_2,
      ~customer_lat_2,
      fillOpacity = ~(`n()` / max(`n()`))
    )

1. Add the popup argument with the following instruction as its value: ~paste0("<p>No of orders: ",n(),"</p>")

locations %>%
  leaflet() %>% 
    addTiles() %>%
    addRectangles(
      ~customer_lon, 
      ~customer_lat, 
      ~customer_lon_2,
      ~customer_lat_2,
      fillOpacity = ~(`n()` / max(`n()`)),
      popup = ~paste0("<p>No of orders: ",  `n()`,"</p>")
    )

edgararuiz/bigdataclass documentation built on Jan. 3, 2020, 6:46 p.m.