SQL Server big data clusters
The new built-in notebooks in Azure Data Studio enables data scientists and data engineers to run Python, R, or Scala code against the cluster.
Instructions to open a notebook from Azure Data Studio
-
Connect to the SQL Server Master instance in a big data cluster
-
Right-click on the server name, select Manage, switch to SQL Server Big Data Cluster tab, and use open Notebook
dataloading
This folder contains samples that show how to load data using Spark.
dataloading/transform-csv-files.ipynb
Instructions
-
Download and save the notebook file dataloading/transnform-csv-files.ipynb locally.
-
Open the notebook in Azure Data Studio, wait for the “Kernel” and the target context (“Attach to”) to be populated. Set the “Kernel” to PySpark3 and Attach to needs to be the IP address of your big data cluster endpoint.
-
Run each cell in the Notebook sequentially.