Azure Container Apps now support
Serverless GPUs in public preview. Serverless GPUs enable you to seamlessly run
your AI workloads on-demand with automatic scaling, optimized cold start,
per-second billing with scale down to zero when not in use, and reduced
operational overhead to support easy real-time custom model inferencing and
other machine learning tasks.
Serverless GPUs accelerate the speed of your AI
development team by allowing you to focus on your core AI code and Azure
Container Apps now supports Serverless GPUs in public preview. Serverless GPUs
enable you to seamlessly run your AI workloads with automatic scaling,
optimized cold start, per-second billing with scale down to zero when not in
use, and reduced operational overhead to support easy, real-time custom model inferencing
and other machine learning tasks.
Serverless GPUs less on managing infrastructure when
using GPUs. They provide an excellent middle layer option between Azure AI Model
Catalog's serverless APIs and hosting models on managed compute. It provides
full data governance as your data never leaves the boundaries of your container
while still providing a managed, serverless platform from which to build your
applications.
At
public preview launch, serverless GPUs powered by NVIDIA A100 and NVIDIA T4
GPUs, will be supported in limited regions. For the most up-to-date pricing and region availability for
Serverless GPUs in Azure Container Apps, checkout the pricing
page.
Learn more.