castKafkaStreamAsString: Connect to a Spark session

Description Usage Arguments Details Value See Also

View source: R/spark-structured-streaming-utilities.R

Description

Connect to a Spark session

Usage

1

Arguments

streamObj

Spark Structured Streaming DataFrame returned by read.stream function with source = 'kafka'

Details

Takes in a Structured Stream from Kafka created from read.stream(source = 'kafka', ...) and returns a Structured Streaming DataFrame where the key and value from the Kafka stream are cast to string

Value

Updated Spark Structured Streaming DataFrame with key, value, topic and timestamp from the Kafka stream

See Also

Other Spark utilities: convertKafkaValueFromJson, sparkRSessionCreateIfNotPresent


analysisPipelines documentation built on July 1, 2020, 7:09 p.m.