Provides a 'PySpark' Back-End for the 'sparklyr' Package


[Up] [Top]

Documentation for package ‘pysparklyr’ version 0.1.5

Help Pages

deploy_databricks Deploys Databricks backed content to publishing server
installed_components Lists installed Python libraries
install_databricks Installs PySpark and Python dependencies
install_pyspark Installs PySpark and Python dependencies
ml_prepare_dataset Creates the 'label' and 'features' columns
requirements_write Writes the 'requirements.txt' file, containing the needed Python libraries
spark_connect_service_start Starts and stops Spark Connect locally
spark_connect_service_stop Starts and stops Spark Connect locally