starburst_map: Map Function Over Data Using AWS Fargate

View source: R/starburst-map.R

starburst_mapR Documentation

Map Function Over Data Using AWS Fargate

Description

Parallel map function that executes on AWS Fargate using the Future backend

Usage

starburst_map(
  .x,
  .f,
  workers = 10,
  cpu = 4,
  memory = "8GB",
  platform = "X86_64",
  region = NULL,
  timeout = 3600,
  .progress = TRUE,
  ...
)

Arguments

.x

A vector or list to iterate over

.f

A function to apply to each element

workers

Number of parallel workers (default: 10)

cpu

CPU units per worker (1, 2, 4, 8, or 16)

memory

Memory per worker (e.g., 8GB)

platform

CPU architecture (X86_64 or ARM64)

region

AWS region

timeout

Maximum runtime in seconds per task

.progress

Show progress bar (default: TRUE)

...

Additional arguments passed to .f

Value

A list of results, one per element of .x

Examples


if (starburst_is_configured()) {
  # Simple parallel computation
  results <- starburst_map(1:100, function(x) x^2, workers = 10)

  # With custom configuration
  results <- starburst_map(
    data_list,
    expensive_function,
    workers = 50,
    cpu = 4,
    memory = "8GB"
  )
}


starburst documentation built on March 19, 2026, 5:08 p.m.