transform_sdf {sparklyr}

transform a subset of column(s) in a Spark Dataframe

Description

transform a subset of column(s) in a Spark Dataframe

Usage

transform_sdf(x, cols, fn)

Arguments

x

An object coercible to a Spark DataFrame

cols

Subset of columns to apply transformation to

fn

Transformation function taking column name as the 1st parameter, the corresponding org.apache.spark.sql.Column object as the 2nd parameter, and returning a transformed org.apache.spark.sql.Column object