stream_read_kafka_avro: read kafka avro topic

In HikaGenji/sparkavroudf: sparklyr.confluent.avro: support for Confluent Schema Registry

Description

decode avro encoded kafka topic stream

Usage

stream_read_kafka_avro(sc, kafka.bootstrap.servers=kafkaUrl, schema.registry.topic="parameter", startingOffsets="earliest", schema.registry.url=schemaRegistryUrl)

Arguments

sc	spark context
kafka.bootstrap.servers	kafka brokers url
schema.registry.topic,	A character, topic name
schemaRegistryUrl	confluent schema registry url
startingOffsets	"earliest" or "latest"
key.schema.naming.strategy	key schema naming strategy
value.schema.naming.strategy	value schema naming strategy
key.schema.id	key schema id
value.schema.id	value schema id
name	view name if any

Value

returns a spark stream

HikaGenji/sparkavroudf documentation built on May 24, 2020, 6:43 a.m.