Questions tagged [firebase-test-lab]

Firebase Test Lab provides cloud-based infrastructure for testing Android and iOS apps. This includes test experience integrated into Android Studio, gcloud command-line tool, and Firebase Console. For comprehensive testing before releasing your app, Firebase Test Lab gives you access to physical & virtual devices installed and running in a Google data center.

Firebase Test Lab is a component of the Firebase suite and provides cloud-based infrastructure for testing Android and iOS apps. With one operation you can initiate testing of your app across a wide variety of devices and device configurations. Test results — including logs, videos, and screenshots — are made available in your project in the Firebase Console. Even if you haven't written any test code for your app, Test Lab can exercise your app automatically, looking for crashes.

Related tags:

348 questions
37
votes
1 answer

Who owns this email? ... @cloudtestlabaccounts.com

I'm developing an Android app that uses Firebase login, still using the old Firebase console. After published the apk into the alpha channel of Google Player Developer Console, I found the following strange account in my Firebase: name = Nuage…
32
votes
2 answers

How to provide login credentials to an automated android test?

I'm looking for a way to "provide a login" to my app so an automated test "is logged in" and can test the entire app. Currently it's of course blocked by the login-screen. Because I'm using SmartLock for Passwords, this might be a chance to provide…
20
votes
8 answers

The uploaded APK does not have valid signature Firebase TestLab instrument test type

I'm trying to testing with my demo app with firebase test lab with instrument test type but i'm not able to test that due to following error regarding to apk. I uploaded the debug-keystore signed apk there. Even in my other project i also uploaded…
Zohaib Akram
  • 617
  • 1
  • 5
  • 16
20
votes
3 answers

Android espresso test pass locally but fails on Firebase Test Lab

I have issue with android espresso test. Test pass locally but fail on FTL. It's simple test onView(allOf(withId(R.id.text_supercategory_name), withText("Air conditioners"))). check(matches(withText("Air conditioners"))); this test pass locally. On…
16
votes
4 answers

'FIRESTORE INTERNAL ASSERTION FAILED: Unexpected state' when unit testing with Jest

I'ḿ setting up a jest test suite for a Node.js and Express REST API i'm building, i'm using @firebase/testing module to initialize a testing app, however when i try to perform any sort of operation to the database this error comes out: FIRESTORE…
16
votes
2 answers

Pre-launch-report failures due to missing methods (in com.google.android.apps.mtaas.crawler-1/base.apk)

Since recently my app started to contain strange error messages in the pre-launch reports (automatically generated after upload to the Play store). These reports contain exceptions such as the following: Exception java.lang.NoSuchMethodError: No…
15
votes
1 answer

How to integrate firebase test lab with circleci

Hi I want to test my app on firebase test lab. I want to integrate it with circleci. I have read this document https://circleci.com/docs/1.0/firebase-test-lab/ and created config.yml I have created GCLOUD_SERVICE_KEY in the environment variable of…
N Sharma
  • 33,489
  • 95
  • 256
  • 444
15
votes
3 answers

How to add resource-id to android in react-native

I was trying to use firebase TestLab but it seems that it can only target resource-id. I had my elements like this: But it seems that the testID is not mapped to the resource-id. If this is not the way to…
Tianhao Zhou
  • 784
  • 1
  • 9
  • 28
13
votes
2 answers

How to detect running in Firebase Test Lab

I've discovered a problem recently with my app's setup in Firebase. We have the pre-launch report configured, which means that the test lab devices are contributing a large number of anonymous sessions to our analytics. Is there any way to detect…
tmtrademark
  • 944
  • 6
  • 21
12
votes
4 answers

Flutter integration tests for iOS on Firebase?

Is it possible to run Flutter integration tests on Firebase? There seems to be conflicting info on this - some sources say its possible, but on the documentation, the iOS section seems to only be for testing on your own device. Firebase asks for an…
Ali
  • 261,656
  • 265
  • 575
  • 769
12
votes
6 answers

Can't run Firebase Test Lab tests using gcloud and service account: 403, does not have storage.objects.create

I am trying to run instrumented tests using the glcoud CLI as a service account in CircleCi. When I run: gcloud config set project project-name-12345 gcloud auth activate-service-account…
etherton
  • 924
  • 2
  • 10
  • 21
12
votes
2 answers

How to use firebase TestLab with react native

I was trying to run a robo test for my react native app on firebase TestLab, but I couldn't get the robo test pass login. The first problem is that it doesn't type in email and password. In my js file I had:
Tianhao Zhou
  • 784
  • 1
  • 9
  • 28
12
votes
8 answers

Firebase Device Test lab: Failed to create a test matrix

I want tot try out firebase device testing - but i get a really generic error message doing so: Failed to create a test matrix. Anyone knows how to get around this? Quota should not be the problem - the button I press says "Start 2 tests" I already…
ligi
  • 39,001
  • 44
  • 144
  • 244
11
votes
1 answer

Android - "firebase.test.lab" setting fails to exclude play store testing activity from firebase analytics

Each time upon uploading a new release to the google play store, I get about 8 new users logged in my Firebase analytics console within around 10 minutes. I have not released my app publicly yet, it's on a closed test track with nobody else opted…
F Chopin
  • 574
  • 7
  • 23
10
votes
2 answers

UI Espresso Test on Dynamic feature modules

The firebase test lab accept an App Bundle / APK and an android test APK and with dynamic feature module UI tests fail on Firebase test lab. The error is about some multi dex problem indicating that the feature module is not found in the base apk…
1
2 3
23 24