README.md

RzmqJobQueue

RzmqJobQueue is a JobQueue system for R based on redis and rzmq

Structure

Features

Installing

I only use it under Ubuntu.

Quick Start

Push Jobs to Job Queue

library(RzmqJobQueue)
init_server(redis.flush=TRUE) # WARNING: it will FLUSH the redis server with index 1
set_init_job( new("job", fun=function() { # some init scripts here
}))
push_job_queue( new("job", fun=base:::mean, argv=list(x = rnorm(100))) )

Start a Listener

#! /usr/bin/Rscript
library(RzmqJobQueue)
init_server(redis.flush=FALSE)
wait_worker(path="tcp://*:12345")

Spawn Several Workers

#! /usr/bin/Rscript
library(Rbridgewell)
init_worker("tcp://localhost:12345")
while(TRUE) {
  do_job("tcp://localhost:12345")
  system(sprintf("rm %s/*", tempdir()))
}

Monitor

library(shiny)
runApp(system.file("shiny", package="RzmqJobQueue"))


wush978/RzmqJobQueue documentation built on May 4, 2019, 12:02 p.m.