Search Unity

Turning off A/B experiment can affect others experiments?

Discussion in 'Unity Analytics' started by elhispano, Mar 13, 2019.

  1. elhispano

    elhispano

    Joined:
    Jan 23, 2012
    Posts:
    52
    Hi! Today we were testing the A/B testing in our release version. We observed in our test devices that after turning off a single experiment, we stopped receiving in the rest of experiments and we were getting default values of the remote settings.

    It is this behaviour expected?

    Thanks you very much, it is very important to know how this works because our game is currently getting 10k downloads per day and some errors in A/B testing can have a big impact in our monetization.
     
  2. elhispano

    elhispano

    Joined:
    Jan 23, 2012
    Posts:
    52
    We just checked it again and we think there is a bug.
    After manually stopping a single experiment, the rest of experiments are stopped despite they are showed in the dashboard as "Running".
     
  3. dw_apps

    dw_apps

    Joined:
    Nov 9, 2017
    Posts:
    7
    Hi elhispano. We also see this behaviour. We had 2 A/B running, not overlapping each other of course, we stopped one of them and saw that other one wasn't actually running. This is a major bug!!
    We're considering moving to Firebase Remote Settings instead..
     
  4. elhispano

    elhispano

    Joined:
    Jan 23, 2012
    Posts:
    52
    Same here, We are testing the system because we were having problems with DeltaDNA A/B testing system.