stream_watermark: Watermark Stream
In sparklyr: R Interface to Apache Spark
View source: R/stream_operations.R
stream_watermark R Documentation
Watermark Stream
Description
Ensures a stream has a watermark defined, which is required for some
operations over streams.
Usage
stream_watermark(x, column = "timestamp", threshold = "10 minutes")
Arguments
x
An object coercable to a Spark Streaming DataFrame.
column
The name of the column that contains the event time of the row,
if the column is missing, a column with the current time will be added.
threshold
The minimum delay to wait to data to arrive late, defaults
to ten minutes.
sparklyr documentation built on May 29, 2024, 2:58 a.m.
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
View source: R/stream_operations.R
| stream_watermark | R Documentation |
Watermark Stream
Description
Ensures a stream has a watermark defined, which is required for some operations over streams.
Usage
stream_watermark(x, column = "timestamp", threshold = "10 minutes")
Arguments
x |
An object coercable to a Spark Streaming DataFrame. |
column |
The name of the column that contains the event time of the row, if the column is missing, a column with the current time will be added. |
threshold |
The minimum delay to wait to data to arrive late, defaults to ten minutes. |
R Package Documentation
Browse R Packages
We want your feedback!
Note that we can't provide technical support on individual packages. You should contact the package authors for that.
Embedding an R snippet on your website
Add the following code to your website.
For more information on customizing the embed code, read Embedding Snippets.