Installing Databricks Connect - pathfinder-analytics-uk/dab_project GitHub Wiki

Links and Resources

• Installing Databricks Connect for Python

---

Commands

Creating a Virtual Environment

The below commands create a virtual environment.

MacOS/Linux

python3.11 -m venv .venv_dbc

Windows

py -3.11 -m venv .venv_dbc

Activating a Virtual Environment

The below commands activates a virtual environment.

MacOS/Linux

source .venv_dbc/bin/activate

Windows

.venv_dbc\Scripts\activate

Installing Databricks Connect

The below commands activates a virtual environment.

Install the same version as your remote Databricks Runtime.

pip install databricks-connect==15.4

Deactivating a Virtual Environment

deactivate

Project Code

notebooks/notebook_2.ipynb

spark.sql("SELECT 1")

scripts/temp.py

spark.sql("SELECT 1").show()