Umachandar Jayachandran
24f88ddc11
Merge pull request #972 from warrenzhu25/patch-1
...
Fix sparkml example
2022-03-02 22:07:34 -08:00
Umachandar Jayachandran
8b83cc07bb
Merge pull request #980 from Bekbolatov/spark_sample_update
...
Update Spark sample code
2022-01-12 22:16:23 -08:00
Shanyu Zhao
ea4e894087
Fix connector sample keytab path
...
Signed-off-by: Shanyu Zhao <shzhao@microsoft.com >
2022-01-12 16:48:26 -08:00
Renat Bekbolatov
b9fc66c425
update OneHotEncoder class name
2022-01-11 16:43:13 -08:00
Warren Zhu
541bef23a8
Fix train example
...
1. Use `OneHotEncoder` as `OneHotEncoderEstimator` is removed in 3.0
2. Skip invalid record in StringIndexer to avoid NULL exception
2021-11-11 10:27:38 -08:00
Daniel Coelho
8d3b651177
Pkg mgmt changes
2021-10-06 09:53:03 -07:00
Daniel Coelho
2a523877ce
CU13 preparedness
2021-09-27 13:52:34 -07:00
Daniel Coelho
f67c3ada30
Spark to S3 examples
2021-08-06 11:52:58 -07:00
Rahul Ajmera
03d150420b
Update installpackage_Spark.ipynb
2020-09-01 09:00:59 -07:00
Shanyu Zhao
e7268cb972
Fix mssql-spark-connector AD cluster sample notebook
...
The previous sample doesn't work.
Modified "...user_creation.ipynb" to create database and user for both AD and non-AD cluster.
Tested with SQL 2019 BDC CU7.
Signed-off-by: Shanyu Zhao <shzhao@microsoft.com >
2020-08-20 22:48:14 -07:00
Ben Weissman
4dbb29857c
Update to pyspark package requirements ( #798 )
...
* separate SP creation
separated Service Principal creation of aks due to issues on some machines with integrated SP creation
fixed typo in README
* Update deploy-sql-big-data-aks.py
removed JSON output
* adjusted for CU5
* change back
* update to CU5
* Updated requirements for pyspark installation in CU5
2020-08-12 12:13:32 -07:00
Rahul Ajmera
b06bc0032a
Update installpackage_Spark.ipynb
...
Update PySpark instructions
2020-07-30 11:04:54 -07:00
ShivSood
33449eedd9
fix to provide user permissions to view data pool configuration
2020-04-27 11:56:52 -07:00
Umachandar Jayachandran
6a4a2792ff
Merge pull request #746 from shivsood/sample_fix
...
fixed hadoop path used when saving the local model to hdfs
2020-04-23 10:01:31 -07:00
ShivSood
5d60ac8622
connector sample updates for integrated auth with datapools
2020-03-02 22:26:52 -08:00
ShivSood
ec9196cb84
fixed hadoop path used when saving the local model to hdfs
2020-02-26 13:12:36 -08:00
ShivSood
9fcc047982
fix
2020-02-21 13:46:47 -08:00
ShivSood
274577212b
first draft : connector with AD mode
2020-02-21 13:29:50 -08:00
Rahul Ajmera
9fab09951e
Merge pull request #724 from rajmera3/master
...
Update Spark Package Management Documentation
2020-01-27 11:11:51 -08:00
Rahul Ajmera
a359f1e8a9
Update Spark Package Management Documentation
2020-01-27 11:07:36 -08:00
Mihaela Blendea
6039a85e4a
Fix link
2019-11-13 08:12:09 -08:00
ShivSood
45759b4ffd
Added pointer to sample notebook on how to create the user/password that's user in Ms-SQL Spark connector
2019-11-06 20:27:31 -08:00
shivsood
40ac807841
Merge pull request #676 from shivsood/connector_GDR1
...
MSSQL Spark connector sample updated
2019-11-05 17:29:16 -08:00
ShivSood
3d72aa0ce0
MSSQL Spark connector sample updated with creating a user and sample for sparkr
2019-11-05 17:24:23 -08:00
Rahul Ajmera
80599d7c24
Update Twitter sample to include steps to create Data Source and External Table
2019-10-21 12:23:02 -07:00
Rahul Ajmera
dc0b9e186f
Fixing bug where step in twitter streaming example would not show
2019-10-01 09:59:15 -07:00
Rahul Ajmera
9310550312
Merge branch 'master' of https://github.com/microsoft/sql-server-samples
2019-10-01 09:48:47 -07:00
Rahul Ajmera
fb08d7d7d6
Updating twitter streaming sample to include default values for hostname and port
2019-10-01 09:48:04 -07:00
Rahul Ajmera
b2e774c6af
Updating twitter streaming sample to include default values for hostname and port
2019-10-01 09:45:37 -07:00
shivsood
49a2dd5645
Merge pull request #645 from shivsood/streaming_sample
...
Added Sample to stream to external tables using MsSQLSpark connector
2019-09-26 18:31:02 -07:00
ShivSood
6609e65e48
stream to external tables using MsSQLSpark connector
2019-09-26 18:28:08 -07:00
Rahul Ajmera
44a253277f
Spark sample that details how to stream data from Twitter API and move it into SQL Server
2019-09-24 17:15:42 -07:00
Mihaela Blendea
d21697f39e
Update README.md
2019-08-05 11:21:19 -07:00
Mihaela Blendea
c6585d32af
Update links
2019-08-05 11:00:16 -07:00
shivsood
3fb772a025
Merge pull request #573 from lgongmsft/master
...
update sample code for train-in-spark and score-in-sql use case
2019-07-22 10:25:41 -07:00
ShivSood
c3cd0349d3
Updated to MSSQL Spark connector sample, new samples for accessing spark via restful livy, configuring a spark session and installing 3rd party pacakgee
2019-06-25 23:44:19 -07:00
Lixin Gong
d39f7bf1ef
remove jars due to policy.
2019-06-06 11:50:46 -07:00
Lixin Gong
995d4ab8b3
fix some typos
2019-06-05 12:54:35 -07:00
Lixin Gong
168bcb3c2e
update notebook with the correct link to the image.
2019-06-05 12:11:06 -07:00
Lixin Gong
56f5e11679
update image and md file.
2019-06-05 11:55:17 -07:00
Lixin Gong
3d5009b5e4
update the jupyter notebook
2019-06-05 10:46:16 -07:00
Lixin Gong
fefe1c54e2
move the content of mleap_sql to the old sparkml folder.
2019-06-04 15:28:28 -07:00
Lixin Gong
69cf5e405f
initial check-in of the mleap_sql sample code.
2019-06-04 14:48:33 -07:00
Lixin Gong
b77887b7ec
train in pyspark, export to mleap, and score in sql.
2019-06-04 12:07:40 -07:00
shivsood
6d5bdc9b8e
cleaup of results, remove pass
2019-04-23 12:46:23 -07:00
shivsood
720268a5d8
Read me fixes
2019-04-23 12:42:41 -07:00
shivsood
babf4bc4c5
mssql spark connector sample
2019-04-23 12:37:31 -07:00
Umachandar Jayachandran
5ee198fb5c
Updated notebook samples
2019-04-18 14:41:44 -07:00
Umachandar Jayachandran
92ae53e05b
Re-organized spark samples
2019-04-18 14:26:45 -07:00
shivsood
e67a4c87fd
fixed the readme doc
2019-04-17 18:06:11 -07:00