late: Late runner

In henfiber/later: A Periodic Batch Processing Framework

Description

Run an analytical pipeline in scheduled batches

Usage

late(schedules, retriever, batch_process, forward_process, ...)

Arguments

retriever	The function which is going to retrieve new data
batch_process	The function responsible for processing this batch
forward_process	The function which will handle post-processing tasks
...	Extra arguments to be passed to the handler

Examples

# Call crond with late() as the main handler and 
# passing extra arguments (late handlers)
crond(c("5m:10s"), my_tasks, "callback", "late", 
      "retrieve_dt", "batch_process", "forward")

henfiber/later documentation built on May 20, 2019, 6:46 p.m.