cmap2: 'cmap2' a function to two disk.frames

In disk.frame: Larger-than-RAM Disk-Based Data Manipulation Framework

'cmap2' a function to two disk.frames

Description

Perform a function on both disk.frames .x and .y, each chunk of .x and .y gets run by .f(x.chunk, y.chunk)

Usage

cmap2(.x, .y, .f, ...)

map_by_chunk_id(.x, .y, .f, ..., outdir)

Arguments

.x	a disk.frame
.y	a disk.frame
.f	a function to be called on each chunk of x and y matched by chunk_id
...	not used
outdir	output directory

Examples

cars.df = as.disk.frame(cars)

cars2.df = cmap2(cars.df, cars.df, ~data.table::rbindlist(list(.x, .y)))
collect(cars2.df)

# clean up cars.df
delete(cars.df)
delete(cars2.df)

disk.frame documentation built on Aug. 24, 2023, 5:09 p.m.