crew.cluster: Crew Launcher Plugins for Traditional High-Performance Computing Clusters

In computationally demanding analysis projects, statisticians and data scientists asynchronously deploy long-running tasks to distributed systems, ranging from traditional clusters to cloud services. The 'crew.cluster' package extends the 'mirai'-powered 'crew' package with worker launcher plugins for traditional high-performance computing systems. Inspiration also comes from packages 'mirai' by Gao (2023) <https://github.com/r-lib/mirai>, 'future' by Bengtsson (2021) <doi:10.32614/RJ-2021-048>, 'rrq' by FitzJohn and Ashton (2023) <https://github.com/mrc-ide/rrq>, 'clustermq' by Schubert (2019) <doi:10.1093/bioinformatics/btz284>), and 'batchtools' by Lang, Bischl, and Surmann (2017). <doi:10.21105/joss.00135>.

Package details

AuthorWilliam Michael Landau [aut, cre] (<https://orcid.org/0000-0003-1878-3253>), Michael Gilbert Levin [aut] (<https://orcid.org/0000-0002-9937-9932>), Brendan Furneaux [aut] (<https://orcid.org/0000-0003-3522-7363>), Eli Lilly and Company [cph, fnd]
MaintainerWilliam Michael Landau <will.landau.oss@gmail.com>
LicenseMIT + file LICENSE
Version0.3.7
URL https://wlandau.github.io/crew.cluster/ https://github.com/wlandau/crew.cluster
Package repositoryView on CRAN
Installation Install the latest version of this package by entering the following in R:
install.packages("crew.cluster")

Try the crew.cluster package in your browser

Any scripts or data that you put into this service are public.

crew.cluster documentation built on April 15, 2025, 1:34 a.m.