spark_connect_service_start {pysparklyr}

Starts and stops Spark Connect locally

Description

Starts and stops Spark Connect locally

Usage

spark_connect_service_start(
  version = "3.5",
  scala_version = "2.12",
  include_args = TRUE,
  ...
)

spark_connect_service_stop(version = "3.5", ...)

Arguments

version

Spark version to use (3.4 or above)

scala_version

Acceptable Scala version of packages to be loaded

include_args

Flag that indicates whether to add the additional arguments to the command that starts the service. At this time, only the 'packages' argument is submitted.

...

Optional arguments; currently unused

Value

It returns messages to the console with the status of starting, and stopping the local Spark Connect service.