Cold Starts in Azure Functions

thumbnail for this post

This article describes Azure Functions running on Consumption Plan—the dynamically scaled and billed-per-execution compute service. Consumption Plan adds and removes instances dynamically. When a new instance handles its first request, the response time increases, which is called a cold start.

Learn more: Cold Starts in Serverless Functions.

When Does Cold Start Happen?

The very first cold start happens when the first request comes in after deployment.

After that request is processed, the instance stays alive mostly from 20 to 30 minutes to be reused for subsequent requests:

Probability of a cold start happening before minute X

As you can see, some cold starts happen earlier than 10 minutes, some instances last for more than 50 minutes, so the behavior seems less deterministic than it used to be in the past. It’s likely related to the new algorithm to predict the next invocation.

Read more: When Does Cold Start Happen on Azure Functions?

How Slow Are Cold Starts?

The following chart shows the typical range of cold starts in Azure Functions V2, broken down per language. The darker ranges are the most common 67% of durations, and lighter ranges include 95%.

Typical cold start durations per language

A typical cold start latency spans from 1 to 10 seconds. However, less lucky executions may take up to 30 seconds occasionally. PowerShell functions are especially slow to start with values from 4 to 27 seconds.

View detailed distributions: Cold Start Duration per Language.

Windows vs. Linux

Azure Functions can be deployed either on Windows or Linux environments, depending on the plan settings. Which operating system provides faster cold starts?

Comparison of cold start durations between two operating systems

The median response time is comparable, but Linux has tighter distribution.

The Node.js runtime is consistently slower than the .NET Core one.

Does Package Size Matter?

The above charts show the statistics for tiny “Hello World”-style functions. Adding dependencies and thus increasing the deployed package size will further increase the cold start durations.

The following chart compares three JavaScript functions with the various number of referenced NPM packages:

Comparison of cold start durations per deployment size (zipped)

Indeed, the functions with many dependencies can be several times slower to start.

Does Deployment Method Matter?

There are multiple ways to deploy Azure Functions. The charts below compare three of them:

  • No Zip—traditional AppService-style deployment based on Kudu (--nozip option in func CLI)
  • Local Zip—uploading a zip package to the local file system of the Function App and setting RUN_FROM_PACKAGE=1 in application settings
  • External Zip—uploading a zip package to blob storage and setting RUN_FROM_PACKAGE=<blob sas token> in application settings

Cold start durations per deployment method for C# functions

Cold start durations per deployment method for JavaScript functions

The differences between deployment methods are hardly visible.


Cloud developer and researcher.
Software engineer at Pulumi. Microsoft Azure MVP.

Responses
Visit the Github Issue to comment on this page