APM KPIs: Mobile App Performance Monitoring Metrics and Targets

More than ever, performance plays a key role in the monetary success of a mobile app. Here, we'll take a closer look at the key mobile app performance monitoring metrics and benchmarks that you need to be tracking in order to optimize your app’s performance and ultimately improve app quality (related: What is Application Performance Monitoring?). These metrics have the biggest impact on the end-user experience, so it's important to measure them and understand what benchmarks to hit in order to meet and exceed users' expectations.

‍

Contents

• Measuring KPIs
• Throughput
• Mobile app stability
• Mobile wait times
• Monitoring metrics isn’t enough

‍

Measuring KPIs

Before we start, it’s important to note that certain benchmarks may be variable—there are general recommendations for certain mobile app performance metrics, but your actual results may vary based on the type of app and content you’re loading. So, we’ll be noting empirical benchmarks as well as considering other ways to measure results.

‍

Apdex

Apdex (Application Performance Index) is an open standard for measuring the performance of software applications. The idea behind it is to have a universal score between 0 and 1 that represents the overall user experience with an app. Some APM tools will calculate your Apdex score for individual traces and events based on targets you set, which allows you to see at a glance how your performance is doing. This allows you to judge performance based on targets that are specific to your app and industry. More information about Apdex

‍

‍

95th percentile (P95)

When measuring app performance, there will always be some instances that are exceptions to normal conditions, or outliers. That’s why sometimes it’s better to look at results for your 95th percentile rather than overall averages. If you’re using Instabug, your P95 values will be displayed in a column next to the attribute you’re exploring.

‍

‍

Throughput

Throughput is a basic and crucial metric to measure. How many people are using your app and how has that changed over time? Usage spikes can impact wait times and app performance in general. If you’re experiencing performance issues, throughput should be one of the first metrics you check to see if traffic is impacting performance.

‍

Mobile app stability

One of the biggest indicators of an unusable app is how often it crashes. Users who encounter crashes are much more likely to uninstall an app than any other reason. Using a crash reporting tool will alert you to any uptick in errors and also help you catch issues early after a release before they become widespread and catastrophic. App stability is measured in crashes per session or user. The industry standards for crash-free rates to target are:

• Crash-free users > 99 %
• Crash-free sessions > 99.9 %

‍

Mobile wait times

An app doesn’t have to be completely unusable for it to be considered of poor quality and worthy of being uninstalled. A huge part of an app’s performance is assessing how long a user has to wait at launch, between screen transitions, and after performing any requests. Let's look at the different kinds of wait times:

‍

App launch times: Speed is an essential part of app performance monitoring. Users don't like to wait and they especially don't like slow apps. How fast your app launches can set very important first impressions with your users and goes a long way to retain them. App launch speed is very indicative of the overall quality of your app and tracking it will help assess the responsiveness of your app. Based on an analysis of the top 100 apps, 39 apps start in under or around 2 seconds, and 73 in under 3 seconds. Ideally, you should be targeting an app launch time of 1.5 to 2 seconds. How to reduce your mobile app launch time

‍

‍

Network response times: Network calls play a huge role in the speed and responsiveness of your app. A study shows that to be competitive, your app should respond to user requests within 1 second. It also indicates that many apps fail to meet that due to unreliable or slow services. Usually, network performance is tracked on the server-side. And while that is important, it only tells half of the story. Tracking client-side network calls and their response times is also key when trying to fully assess network performance. View the full network performance debugging guide

‍

‍

App trace completion times: Every app is built differently. To best understand your end users' experience, you need to be able to assess your client-side logic and see how long specific traces in your app take to execute (2 seconds average). This will give you a deeper and more granular picture of where your app is failing to meet users' expectations and ultimately help you to pinpoint and resolve issues faster.

‍

UI response times: No app performance monitoring metrics are complete without an assessment of UI hangs. You need to constantly monitor the responsiveness of your app's user interface for issues. Users can experience UI hangs for various reasons and if there's a longer than usual delay (250ms on average) or a failure to respond to a user's input, you need to be aware of it in order to fix it as soon as possible before the negative reports and comments come flooding in.

‍

‍

Screen loading times: One of the factors that impact the user experience is how long it takes content to load. You should be monitoring how long your page transitions are taking and how long it’s taking to load your content. Loading times can be variable depending on the content, but you can use an app performance monitoring tool to find delays in content loading stages, set loading thresholds, and calculate Apdex scores.

‍

Monitoring metrics isn’t enough

For superior app performance, you need a proactive app performance management strategy (for more on managing your app performance, check out App Performance Monitoring, Management, or Both?). After years in the business of app quality development, we’ve discovered something: that monitoring metrics is not enough.

Monitoring is incredibly useful for gathering data and finding trouble spots. But it’s also a passive activity. Your app performance management strategy should include proactive quality control measures as well. Using Instabug, you can set quality thresholds for specific app dimensions and assign Alerts, so you’ll be notified as soon as issues arise. More information on setting Alerts

‍

‍

Using an APM tool for your mobile app

Instrumenting your app with an Application Performance Monitoring tool will help you stay on top of how your app is doing in the wild and act proactively to find problem areas in your app's performance. Instabug's APM tool helps you track key app performance monitoring metrics to improve your app's performance, including Apdex scores, UI hangs, network timeouts and issues, slow launches, tracking custom traces, and more.

For the best results, use Instabug’s APM, Crash Reporting, and Bug Reporting together to have a complete picture of your app’s quality, performance, and stability. Each tool is essential on its own, and when combined, the sum is even greater than its parts and you’ll have all the data and information you need at your fingertips to deliver the fastest and most reliable experience for your users, and outperform your competition.