hive_partition: Construct Hive partitioning

In arrow: Integration to 'Apache' 'Arrow'

Construct Hive partitioning

Description

Hive partitioning embeds field names and values in path segments, such as "/year=2019/month=2/data.parquet".

Usage

hive_partition(..., null_fallback = NULL, segment_encoding = "uri")

Arguments

...	named list of data types, passed to schema()
null_fallback	character to be used in place of missing values (NA or NULL) in partition columns. Default is "__HIVE_DEFAULT_PARTITION__", which is what Hive uses.
segment_encoding	Decode partition segments after splitting paths. Default is "uri" (URI-decode segments). May also be "none" (leave as-is).

Details

Because fields are named in the path segments, order of fields passed to hive_partition() does not matter.

Value

A HivePartitioning, or a HivePartitioningFactory if calling hive_partition() with no arguments.

Examples

hive_partition(year = int16(), month = int8())

arrow documentation built on Nov. 25, 2023, 1:09 a.m.