spark_coalesce_initial_num_partitions: Retrieves or sets initial number of shuffle partitions before...

View source: R/spark_context_config.R

spark_coalesce_initial_num_partitionsR Documentation

Retrieves or sets initial number of shuffle partitions before coalescing

Description

Retrieves or sets initial number of shuffle partitions before coalescing

Usage

spark_coalesce_initial_num_partitions(sc, num_partitions = NULL)

Arguments

sc

A spark_connection.

num_partitions

Initial number of shuffle partitions before coalescing. Defaults to NULL to retrieve configuration entries.

See Also

Other Spark runtime configuration: spark_adaptive_query_execution(), spark_advisory_shuffle_partition_size(), spark_auto_broadcast_join_threshold(), spark_coalesce_min_num_partitions(), spark_coalesce_shuffle_partitions(), spark_session_config()


sparklyr documentation built on May 29, 2024, 2:58 a.m.