Firebase A/B Testing version targeting

user_5821000 0
Viewed 437

I was trying to run an A/B test using Firebase A/B testing, but just for specific versions of the app. There were no results and no users exposed to the experiment after 5 days of running it.

After that, I tried to run the same A/B test but without a version restrictions and the first results were available the next day.

So I thought that the way I was defining version restrictions was wrong. I tested it in Remote Config, but the Remote Config was returning the correct values when I applied the same version restriction. Here is how I defined the version restriction in both cases:

enter image description here

The app's version names are in the following format X.Y.Z (e.g. 6.51.0, 6.51.1)

Is there something that I am missing? Is the test significantly slower to start if specific versions are being targeted?

firebase-ab-testing firebase android
1 Answers

This should work. I have tried this many times. Make sure that you're targeting the correct value based on your app configuration. The Version targeting criterion...

  • For Android app, you should target the "versionName", not the "versionCode".
  • For iOS app, you should target the "CFBundleShortVersionString", not the "CFBundleVersion".

In addition, you should put the exact number on the console. For example, if the versionName or CFBundleShortVersionString is 1.0.0, then you should put 1.0.0 and not just 1.0.

user_65231730
Related