Dynamic allocation for Apache Spark in Azure Synapse now generally available

Azure Updates

Discussionpowered by zap.ms

Published

Nov 19, 2021

Status

Launched

Timeline

  • November 2021
    General Availability

Product

Azure Synapse Analytics

Tag

Features

Category

Analytics

Description

You can now further customize autoscale Apache Spark in Azure Synapse by enabling the ability to scale within a minimum and maximum number of executors required at the pool, Spark job, or notebook session level. This enhances the autoscale capabilities within Apache Spark on Synapse by allowing you to customize how your clusters scale based on specific workload requirements.

Learn more.