1.2 KiB
SQL Server big data clusters
The new built-in notebooks in Azure Data Studio enables data scientists and data engineers to run Python, R, Scala, or Spark SQL code against the cluster.
Instructions to open a notebook from Azure Data Studio and execute the commands
-
Connect to the SQL Server Master instance in a big data cluster
-
Right-click on the server name, select Manage, switch to SQL Server Big Data Cluster tab, and use open Notebook.
-
Open the notebook in Azure Data Studio, wait for the “Kernel” and the target context (“Attach to”) to be populated.
-
Run each cell in the Notebook sequentially.
data-loading
This folder contains samples that show how to load data using Spark and query them using SQL statements.
data-loading/transform-csv-files.ipynb
This samnple notebook shows how to transform CSV files in HDFS to parquet files.
This samnple notebook shows how to query hive tables created from Spark.
data-virtualization
This folder contains samples that show how to integrate Spark with other data sources.