NA
issue while using sparklyr
, Spark2
, and dplyr
. It also looks like several places
NA
and ""
are confused and reversed, confuses, or suppressed.
Submitted as sparklyr
issue 528 and sparklyr
issue 680.
knitr::opts_chunk$set( collapse = TRUE, comment = " # " ) options(width =100)
suppressPackageStartupMessages(library('dplyr')) packageVersion("dplyr") library('sparklyr') packageVersion("sparklyr") sc <- sparklyr::spark_connect(version='2.0.2', master = "local") d1 <- data.frame(x= c('a',NA), stringsAsFactors= FALSE) # Notice d1s appears truncated to 1 row ds1 <- dplyr::copy_to(sc,d1) print(ds1) nrow(ds1)
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.