Originally Posted by Robbie

Seems like at the end you still have to make a critical judgement yourself though. What if an inordinate amount of traffic comprised of adults with credit cards who will actually buy a membership went to "A" just coincidentally?
And at the same time...also coincidentally, a big percentage of guys without credit cards or who won't buy porn went to "B".

In that scenario, you could potentially have a much better "B" join page that would perform better than "A", but you wouldn't know it.

Of course I'm assuming that you run the test for a while and not just one day.

But even then...if one of the pages performs better than the other one...you might be losing members who went to the underperforming one.

I guess you have no choice but to do it though.