When it's time to choose the tools to help you carry out your internal and external app testing, a mobile app distribution tool is one of the first things you need to consider. Mobile app distribution platforms allow you to distribute testing versions of your app to your team and beta testers over-the-air (OTA) and keep track of them and their performance.
Whether you're looking for a way to keep track of your alpha builds or you're trying to distribute your beta version to testers, this post will take a look at some of the top app distribution platforms and their key features.
β
β
Apple acquired TestFlight in 2014, integrating it into iTunes Connect and adopting it as their solution for app distribution. Naturally, TestFlight exclusively supports the iOS, watchOS, and tvOS platforms.
TestFlight allows you to add up to 25 internal testers from your iTunes Connect users as long as they have either the Admin, App Manager, Developer, Marketer, or Technical role. As for external testers, you can add up to 10,000 testers using their emails or a public opt-in link. Due to Apple's restrictions on sideloading apps, TestFlight is the only way to test your iOS app on more than 100 devices.
Testers receive an email with a link that prompts them to download the TestFlight app. Testers can then use the TestFlight app to download your beta app, and they receive in-app notifications when it's time to update. Additionally, TestFlight supports open beta testing by generating a public opt-in link to distribute your app to testers. You can also set a maximum number of allowed testers for your open beta test to avoid exceeding your team's capacity.
TestFlight supports testing of up to 100 apps simultaneously. Builds are available for 90 days after upload, and internal testers have access to all the builds of your apps. You can choose which apps and builds to make available to external testers and organize these testers into different groups. This allows you to test different builds of the same app with different groups simultaneously.
The main issue most people have with TestFlight is that before builds can be sent to external testers, they must first go through Apple's approval process. The first build's approval takes longer than subsequent builds and the turnaround times depend on the development platform, but it takes an average of one day.
β
API and Integrations
TestFlight doesn't offer a documented and supported API. Fastlane seems to be the only solution to automate the upload of your app to TestFlight.
β
Pricing
Free.
β
Pros
- Up to 10,000 external testers without an enterprise developer account.
- No need to manage UDIDs and provisioning profiles for external testers.
- Simultaneously test different builds of the same app.
- The TestFlight app notifies testers about beta updates.
- Testers can submit feedback through the TestFlight app.
β
Cons
- Builds have to go through an approval process before being available to beta testers.
- Only 25 internal testers allowed.
- Basic session and crash reporting.
β
Bottom Line
TestFlight is a great option for indie developers and small to medium teams developing for the Apple environment. It's also the only option if you want to include more than 100 testers in your beta program without an enterprise developer account. Tester groups and the ability to test builds simultaneously makes it a good choice for beta tests that aren't overly complicated. However, if you require more detailed analytics about your testers or your app performance, you will need to rely on third-party tools.
Learn More: TestFlight Beta Testing: Setting Up Effective Beta Tests
β
β
The Google Play Developer Console has abandoned the alpha/beta convention in favor of internal, closed, and open test tracks. Apps that opt for an open test are discoverable on the Google Play store and can be downloaded by anyone.
You can invite testers to your app through email, provided it is a Gmail or G Suite account. You can also invite an unlimited number of testers through Google Groups to your closed or open beta tests. Internal tests are limited to 100 testers per app while closed betas don't restrict the number of testers you can recruit. When adding testers by email, you are allowed to upload up to 50 lists per test and a total of 200 email lists, each with a maximum of 2000 testers. Once your testers receive the link, they can download the app from the Google Play Store.
Google does not set a limit on the number of apps you can test at the same time, and you can group your users through Google Groups or email lists. However, Google Play does not allow you to test different builds of the same app at the same time in the open test track.
The main issue with Google Play is its lack of features when it comes to tester management and team management. Builds submitted to Google Play also must undergo a review process, but that is usually done in a couple of hours.
β
API and integrations
Google Play Developer API.
β
Pricing
Free.
β
Pros
- Testers don't need to download a standalone app.
- Testers don't need to enable download from unknown sources in Android settings.
- Open beta tests are discoverable in the Play Store.
- Can set a maximum number of users for open tests.
β
Cons
- Can't test more than one build at the same time in open tests.
- For closed and open tests, paid apps have to be purchased to gain access to the test.
- Apps must undergo a beta review process.
β
Bottom Line
Google Play is a handy tool for indie Android developers and small to medium teams that don't have many requirements for their beta test. The ability to list open betas on the Play Store can also be useful to get a head start on user acquisition. However, its lack of tester management outside of Google Groups and the inability to test several builds simultaneously limit its scope without the use of third-party tools.
Learn More: Google Play Beta Testing: Setting Up Effective Beta Tests
β
While Visual Studio App Center offers many popular features for CI/CD, including React Native CodePush (which will continue to be supported as a standalone product), we will focus on its app distribution features.
App Center can be integrated with your Android, iOS, macOS, tvOS, Β or Windows app. You can choose between sending your testers a link to register an App Center account for private groups or a link to the app's public download page. In addition to distribution, it offers crash reports, segmented in-app notifications, user feedback, and analytics.
App Center also provides great tester and team management features, allowing you to control exactly who has access to each build. Testers can be organized into groups and multiple builds can be sent to multiple groups simultaneously. You can grant or revoke access to individual builds for a group and for individual testers.
β
API and integrations
App Center offers extensive integrations with most of the popular tools used by developers. Additionally, it offers a public API so you can integrate the tools of your choice.
β
Pricing
App Center offers a free tier that you can scale as you go through add-ons, but there are restrictions on concurrent builds.
β
Pros
- Manage Android, iOS, and Windows betas from the same tool.
- Unlimited users and testers on non-Apple platforms.
- Tester groups and group permissions.
- Powerful crash reporter, analytics, and targeted push notifications.
β
Cons
- Can't distribute beta apps to more than 100 devices without an Apple enterprise developer account.
β
Bottom Line
App Center is a great platform for beta app distribution whose features cover a lot of the needs for beta testing. The tool also scales well and can support indie developers through to big companies.
β
β
TestFairy is a beta app distribution platform with a focus on enterprise users. It is available for Android and iOS and supports cross-platform like Xamarin, Cordova, and React Native.
TestFairy allows you to invite beta testers through email, SMS, or through a landing page that it creates for each of your apps. This landing page can be open for anyone to join, or closed where testers can request access. Once the testers start testing your app, TestFairy records video sessions so you can see exactly what happened in your app before an issue occurs. TestFairy's SDK also provides an in-app bug reporting and crash reporting tool to facilitate the process for you and your testers.
TestFairy provides you with tester management features that let you organize testers into groups and manage their permissions. However, you can't test two different builds of the same app simultaneously.
With its focus on enterprise customers, TestFairy also offers Single Sign-On with the most popular platforms. Additionally, it can be hosted in the cloud or on-premise when added security is needed.
β
API and integrations
TestFairy integrates with a lot of popular tools for bug tracking, communication, and continuous integration. As for security, they integrate with Google, Okta, Onelogin, and other popular tools. Moreover, they have a REST API, upload API, and Webhooks.
β
Pricing
TestFairy's pricing is not available on their website and you will need to contact them for a quote.
β
Pros
- Video recording of sessions.
- In the cloud or on-premise.
- Tester groups and group permissions.
- Support for SAML and LDAP, and compatible with SSO services.
β
Cons
- No free tier or startup pricing.
- No access to crowdtesters.
- Can't distribute beta apps to more than 100 devices without an Apple enterprise developer account.
β
Bottom Line
TestFairy is not a good match for indie developers and small companies that will not need some of its features. For medium to large companies focused on security, TestFairy can be a suitable solution provided they don't need access to crowdtesters.
β
β
Appaloosa is an enterprise app store that can also be used for mobile app distribution on Android and iOS. Using their service, you can upload your beta build and distribute it to your testers through your own private app store.
Testers are directed to your private app store through a link that you can send by email. Appaloosa does not offer any in-app feedback, bug reporting, or crash reporting tools, but testers can submit feedback to your app store page.
With their enterprise focus, Appaloosa supports SAML, OAuth, and SAML SSO solutions to enhance security. Appaloosa also offers push notifications and self-updating apps, which can be useful to make sure that all your testers are on the latest build. The push notifications also allow you to engage your testers throughout your beta test in order to maximize feedback.
Tester management and the ability to organize them into groups with different authorizations and permissions is also supported to enable you to control who has access to your app.
β
API and integrations
Appaloosa integrates with most of the popular tools for bug tracking, communication, continuous integration, and SSO. In addition, they provide a RESTful API but the integrations and APIs are available starting with the enterprise plan.
β
Pricing
Appaloosa's free tier is limited to one app with five versions and only group-based deployment.
Their Plus tier costs β¬1.49/user/month (minimum 20 users and maximum 100) for 5 apps with 10 versions each and doesn't add features.
The Enterprise plan costs β¬2.49/user/month (minimum of 100 users) for unlimited apps, versions, and users. This plan also unlocks all of Appaloosa's features except for SSO and a custom domain URL.
The Custom plan unlocks the full potential of Appaloosa but you will have to contact them for a quotation.
β
Pros
- Auto-updating apps.
- SSO authentication.
- Tester groups and group permissions.
β
Cons
- No crash or bug reporting capabilities.
- Most useful features are restricted to the Enterprise plan.
- Can't distribute beta apps to more than 100 devices without an Apple enterprise developer account.
β
Bottom Line
Appaloosa is another enterprise-focused app distribution tool that is not suitable for smaller teams. Some medium-sized companies might find their offering suitable if their test has specific needs like a private app store or added security. Big companies might find this tool valuable especially if they also want to use a private app store for their company's applications.
β
β
DeployGate is an app distribution tool that was spun off from the Japanese social media platform Mixi. It is an interesting tool that offers pretty extensive features for beta testing, especially for a new arrival.
DeployGate provides you with fully customizable landing pages that you can share with your testers to download the app. The landing pages can be password protected or open depending on your needs. Moreover, the tool creates tester accounts when they access the app for the first time without the use of emails. Every tester is assigned a unique ID related to his device with which the account will be created.
Testers can be organized into groups that can be granted different permissions according to their roles. You can use these groups to selectively push different builds and apps to different groups. DeployGate even supports testing of more than one build at once.
When it comes to feedback and reporting, DeployGate has a slightly different approach than the other tools we have looked at. While they do offer an SDK that enables crash reporting and basic analytics, they don't provide a way for in-app bug reports and user feedback. Instead, they give each of your apps a private forum page that includes the respective testers and allows you to communicate with your testers there.
A neat feature that they offer is their command-line interface tool that automates adding UDIDs, updating provisioning profiles, building, and deploying your app.
β
API and integrations
DeployGate fully integrates with Slack, HipChat, and ChatWork. They also offer a RESTful API so you can integrate the tools of your choice.
β
Pricing
DeployGate offers a very limited "Personal Free" tier that although offers unlimited apps and testers, is restricted to two distributions/app and one week of log retention.
The "Personal Pro" tier costs $15/month and introduces unlimited apps and testers, 5 private apps, 10 distributions/app, and 3 months log retention.
Business tiers start at $99 for the startup tier and go up to $999 for the "large business tier".
β
Pros
- Auto tester account creation
- Tester groups and group permissions
- Test more than one build of the same app simultaneously
- CLI tool for auto UDID acquiry, provisioning profile management, and deployment
β
Cons
- No in-app feedback or bug reporting.
- Limited third-party integrations.
- Can't distribute beta apps to more than 100 devices without an Apple enterprise developer account.
β
Bottom Line
DeployGate is an interesting tool that could be capable to help small to medium teams accelerate their beta test and deployment. DeployGate can handle beta testing on a large scale too, but with the absence of analytics, in-app feedback, bug-reporting, and push notifications, it will need to be assisted by other tools that can handle this.
Learn more:
- The Beginner's Guide to Beta Testing Your Mobile App
- Checklist for Launching Your App in Beta
- How Much Your Mobile App Performance Costs Your Business
- Performance Monitoring and User Experience for Mobile App Growth
β
Instabug empowers mobile teams to maintain industry-leading apps with mobile-focused, user-centric stability and performance monitoring.
Visit our sandbox or book a demo to see how Instabug can help your app