stream_write_kafka_avro: write kafka avro topic

In HikaGenji/sparkavroudf: sparklyr.confluent.avro: support for Confluent Schema Registry

Description

encode avro

Usage

stream_write_kafka_avro(kafka.bootstrap.servers=kafkaUrl, schema.registry.topic="output", schema.registry.url=schemaRegistryUrl) 

Arguments

x	spark stream
kafka.bootstrap.servers	kafka brokers url
schema.registry.topic,	A character, topic name
schemaRegistryUrl	confluent schema registry url
mode	Specifies how data is written to a streaming sink. Valid values are "append", "complete" or "update".
trigger	The trigger for the stream query, defaults to micro-batches runnnig every 5 seconds. See stream_trigger_interval and stream_trigger_continuous.
checkpoint	The location where the system will write all the checkpoint information to guarantee end-to-end fault-tolerance.
key.schema.naming.strategy	key schema naming strategy
value.schema.naming.strategy	value schema naming strategy
schema.namespace	schema namespace
key cols	columns part of the key
options	options for stream_read_kafka

Value

nothing

HikaGenji/sparkavroudf documentation built on May 24, 2020, 6:43 a.m.