Firebase Test Lab for Android
Test your app on devices hosted in a Google datacenter.
Key capabilities
Test on real devices | Use Test Lab to exercise your app on devices installed and running in a Google data center. Test Lab helps you to find issues that only occur on specific device configurations (for example, a Nexus 5 running a specific Android API level and specific locale settings). |
Run app tests, even if you haven't written any | You can use Robo test to find issues with your app so you can test your app even if you haven't written app tests. Robo test analyzes the structure of your app's user interface and then explores it, automatically simulating user activities. If you have written instrumentation tests for your app, Test Lab can also run those tests. |
Workflow integration | Test Lab is integrated with Android Studio, the Firebase console, and the gcloud command line. You can also use Test Lab with Continuous Integration (CI) systems. |
How does it work?
Test Lab uses devices running in a Google data center to test your app. The devices used for testing are real production devices that are flashed with updated Android API levels or locale settings that you specify so that you can road-test your app against a real-world collection of real devices and device configurations.
Devices in a data center
Test Lab lets you run Espresso, Robotium, or UI Automator 2.0 instrumentation tests written to exercise your app from the Firebase console, Android Studio, or the gcloud command line interface. You can also use Robo test to automatically exercise your app from the Firebase console or the gcloud command line.
Robo test captures logs, creates an "activity map" that shows a related set of annotated screenshots, and creates a video from a sequence of screenshots to show you the simulated user operations that it performed. Learn more about Robo test.
Implementation path
If you are running instrumentation tests, write your app-specific test. | When developing instrumentation tests for your app, remember to add the Test Lab screenshot library to your app test project so that you can more easily interpret test results. | |
Choose a test environment and a test matrix. | Using a test environment of your choice (the Firebase console, Android Studio, or the gcloud command line interface), define a test matrix by selecting a set of devices, API levels, locales, and screen orientations. | |
Run your tests and review test results. | Depending on the size of your test matrix, it may take several minutes for Test Lab to complete your test run. After your test run is complete, you can review test results in the Firebase console. |
Next steps
- Start by testing your app with Robo Test, a test you can run in minutes with no coding required.
- Test your app in the Firebase console. See Use Firebase Test Lab for Android from the Firebase console.
- Test your app from the gcloud command line environment. See Using Test Lab from the Command Line.
- Test your app with Android Studio 2.0. See the Test Lab instructions in the Firebase Android Codelab.
- Use the Test Lab screenshot library in your instrumentation tests.