Quote:
Originally Posted by Roald
We just split the traffic to an A and a B version in the same time frame.
|
Seems like at the end you still have to make a critical judgement yourself though. What if an inordinate amount of traffic comprised of adults with credit cards who will actually buy a membership went to "A" just coincidentally?
And at the same time...also coincidentally, a big percentage of guys without credit cards or who won't buy porn went to "B".
In that scenario, you could potentially have a much better "B" join page that would perform better than "A", but you wouldn't know it.
Of course I'm assuming that you run the test for a while and not just one day.
But even then...if one of the pages performs better than the other one...you might be losing members who went to the underperforming one.
I guess you have no choice but to do it though.
