Developer tools enhancements for Apache Spark on Azure HDInsight

Azure Updates

Discussionpowered by zap.ms

Published

Sep 24, 2018

Status

Launched

Timeline

  • September 2018
    General Availability

Product

HDInsight
HDInsight Apache Spark

Tag

Services

Category

Analytics

Description

We're bringing several exciting new enhancements to developer tools for Apache Spark on Azure HDInsight.

For the HDInsight Spark debugging toolset, we're adding new capabilities to visualize Spark job executions—access and manage data input, output, and table operations, and visualize execution utilization, among others. The HDInsight development toolkit features a cross-platform lightweight editor, Azure integration, support for PySpark, Apache Hive integration, built-in templates for native authoring support for Scala and Java Spark apps, support for Apache Maven and Simple Build Tool projects, in addition to others.

To learn more, please visit the Azure HDInsight webpage.