spark_advisory_shuffle_partition_size {sparklyr} | R Documentation |
Retrieves or sets advisory size of the shuffle partition
Description
Retrieves or sets advisory size in bytes of the shuffle partition during adaptive optimization
Usage
spark_advisory_shuffle_partition_size(sc, size = NULL)
Arguments
sc |
A |
size |
Advisory size in bytes of the shuffle partition.
Defaults to |
See Also
Other Spark runtime configuration:
spark_adaptive_query_execution()
,
spark_auto_broadcast_join_threshold()
,
spark_coalesce_initial_num_partitions()
,
spark_coalesce_min_num_partitions()
,
spark_coalesce_shuffle_partitions()
,
spark_session_config()
[Package sparklyr version 1.8.6 Index]