write_disk.frame: Write disk.frame to disk

In disk.frame: Larger-than-RAM Disk-Based Data Manipulation Framework

Write disk.frame to disk

Description

Write a data.frame/disk.frame to a disk.frame location. If df is a data.frame then using the as.disk.frame function is recommended for most cases

Usage

write_disk.frame(
  diskf,
  outdir = tempfile(fileext = ".df"),
  nchunks = ifelse("disk.frame" %in% class(diskf), nchunks.disk.frame(diskf),
    recommend_nchunks(diskf)),
  overwrite = FALSE,
  shardby = NULL,
  partitionby = NULL,
  compress = 50,
  ...
)

output_disk.frame(...)

Arguments

diskf	a disk.frame
outdir	output directory for the disk.frame
nchunks	number of chunks
overwrite	overwrite output directory
shardby	the columns to shard by
partitionby	the columns to (folder) partition by
compress	compression ratio for fst files
...	passed to cmap.disk.frame

Examples

cars.df = as.disk.frame(cars)

# write out a lazy disk.frame to disk
cars2.df = write_disk.frame(cmap(cars.df, ~.x[1,]), overwrite = TRUE)
collect(cars2.df)

# clean up cars.df
delete(cars.df)
delete(cars2.df)

disk.frame documentation built on Aug. 24, 2023, 5:09 p.m.