Public preview: Native delta lake output connector

Azure Updates

Discussionpowered by zap.ms

Published

Oct 12, 2022

Status

In preview

Timeline

  • October 2022
    Preview

Product

Azure Stream Analytics

Tag

Features
Microsoft Ignite

Category

Analytics
Internet of Things

Description

Delta lake is a popular format that enterprises use to build their lakehouse as it adds reliability, quality, and performance to data lakes. A native delta lake output connector in Stream Analytics allows you to directly write streaming data to your delta lake tables without writing a single line of code. Your job can be configured to write to either a new or a pre-created delta table in an Azure Data Lake Storage Gen 2 account. This connector is optimized for high-speed ingestion to delta tables in append mode and also provides exactly-once semantics which guarantees that no data is lost or duplicated. Ingesting real-time data streams from Azure Event Hubs into delta tables allows you to perform ad-hoc interactive or batch analytics.

Learn more.