castKafkaStreamAsString {analysisPipelines}R Documentation

Connect to a Spark session

Description

Connect to a Spark session

Usage

castKafkaStreamAsString(streamObj)

Arguments

streamObj

Spark Structured Streaming DataFrame returned by read.stream function with source = 'kafka'

Details

Takes in a Structured Stream from Kafka created from read.stream(source = 'kafka', ...) and returns a Structured Streaming DataFrame where the key and value from the Kafka stream are cast to string

Value

Updated Spark Structured Streaming DataFrame with key, value, topic and timestamp from the Kafka stream

See Also

Other Spark utilities: convertKafkaValueFromJson, sparkRSessionCreateIfNotPresent


[Package analysisPipelines version 1.0.2 Index]