hof_exists {sparklyr}

Determine Whether Some Element Exists in an Array Column

Description

Determines whether an element satisfying the given predicate exists in each array from an array column (this is essentially a dplyr wrapper for the exists(array<T>, function<T, Boolean>): Boolean built-in Spark SQL function)

Usage

hof_exists(x, pred, expr = NULL, dest_col = NULL, ...)

Arguments

x

The Spark data frame to search

pred

A boolean predicate

expr

The array being searched (could be any SQL expression evaluating to an array)

dest_col

Column to store the search result

...

Additional params to dplyr::mutate