Last week, Microsoft revealed plans to launch a revamped application for the initial release of SQL Server 2019, focusing primarily on Big Data Clusters. This application allows deploying scalable clusters of SQL Server, Apache Spark, and HDFS running on Kubernetes.
Visual Studio Code now enables PySpark utilization with Big Data Clusters on SQL Server 2019.
Today, the tech giant has introduced new support for utilizing PySpark with Big Data Clusters on SQL Server 2019 and executing queries within Visual Studio Code. For those unaware, PySpark is a Python API of Spark, providing an interface for cluster programming or computation.
With Apache Spark and Hive extensions, users can access the Python editor and manipulate it. Moreover, integrating Jupyter Notebooks will enable users to import and export files in .ipynb format. Alongside advanced editing features, users can also run selected command lines and experience results in interactive visual form. A prime example is plotting 2D graphs via matplotlib - a Python library, tasks in PySpark can also be sent to Big Data Clusters on SQL Server 2019 or curated by data experts through Azure Data Studio. Download Visual Studio 2019 tool here.
Below is a summary list of the aforementioned features:
- Link to SQL Server: The toolset allows you to connect and send PySpark jobs to Big Data Clusters on SQL Server 2019. Refer to fixing SQL Server login failure
- Python editing: Develop PySpark applications using the Python programming language with editing features like IntelliSense, auto-formatting, error detection...
- Integrated Jupyter Notebook: Import and export files in .ipynb format.
- PySpark interactive: Run selected command lines and interact visually.
- PySpark batch: Send PySpark applications to Big Data Clusters on SQL Server 2019.
- PySpark monitoring: Integrated with Apache Spark server to view work history, fine-tune errors, and analyze tasks.
To explore these new features, you can download Visual Studio Code for Windows, Mac, and Linux here. For Mac and Linux, you'll need to install Mono 4.2.x additionally. Then, you can get the latest Apache Spark and Hive tools from the VS Code Marketplace or extension repository.
- Download Mono for Mac here.
The next noteworthy information is that users can now block images in Gmail on iPhone. To do this, users simply need to update to the latest version of Gmail and follow some simple setup steps to block the automatic display of images on iPhone. For detailed information, readers can check the Mobile News section on the website https://9mobi.vn
Don't forget to visit Mytour daily to update the latest Technology News.
