hof_exists: Determine Whether Some Element Exists in an Array Column

In rstudio/sparklyr: R Interface to Apache Spark

Determine Whether Some Element Exists in an Array Column

Description

Determines whether an element satisfying the given predicate exists in each array from an array column (this is essentially a dplyr wrapper for the exists(array<T>, function<T, Boolean>): Boolean built-in Spark SQL function)

Usage

hof_exists(x, pred, expr = NULL, dest_col = NULL, ...)

Arguments

x	The Spark data frame to search
pred	A boolean predicate
expr	The array being searched (could be any SQL expression evaluating to an array)
dest_col	Column to store the search result
...	Additional params to dplyr::mutate

rstudio/sparklyr documentation built on Sept. 18, 2024, 6:10 a.m.