R/qubole_connection.R

Defines functions initialize_method.qubole

initialize_method.qubole <- function(method, scon) {
  scon$config$sparklyr.web.spark <- invoke(
    scon$state$spark_context,
    "getSparkUIURL"
  )
  yarn_url <- Sys.getenv("QUBOLE_YARN_WEB")
  scon$config$sparklyr.web.yarn <- if (nchar(yarn_url) > 0) {
    yarn_url
  } else {
    system("/usr/lib/rstudio-utils/bin/get-yarn-url.sh",
      intern = TRUE
    )
  }
  scon
}

Try the sparklyr package in your browser

Any scripts or data that you put into this service are public.

sparklyr documentation built on Jan. 8, 2022, 5:06 p.m.