mutate issue while using sparklyr, Spark2, and the dev version of dplyr (‘0.5.0.9000’, https://github.com/hadley/dplyr commit f39db50921110c3d23612cc81a7b3e027c0b3d1c ).

knitr::opts_chunk$set(
  collapse = TRUE,
  comment = " # "
)
options(width =100)
library(sparklyr)
library(dplyr)
library(nycflights13)
sc <- spark_connect(version='2.0.0', master = "local")
flts <- replyr::replyr_copy_to(sc, flights)

Ok:

flights %>% mutate(zzz=1)

Throws:

flts %>% mutate(zzz=1)
R.Version()$version.string
packageVersion('dplyr')
packageVersion('lazyeval')
packageVersion('sparklyr')
class(sc)
sc$spark_home
print(sc)
version

Submitted as dplyr issue 2495.



WinVector/replyr documentation built on Oct. 22, 2020, 8:07 p.m.