Quote:
Originally Posted by Robbie
Problem I would see would be this: How do I know if "A" or "B" may or may not have gotten more "good" traffic and/or surfers more likely to join?
I wouldn't really. It's a 50/50 chance no matter what in that scenario. Maybe today 75% of the 50% that went to "A" were 16 year olds surfing porn. Maybe tomorrow that percentage just happens to be middle aged guys who love big tits and have credit cards.
I wouldn't really have any way to know that both "A" and "B" are getting exactly the same quality of traffic. Even if they came from only one source.
So I'm thinking the only real test is to just change it. Give it enough days to make sure it has a shot at real convert-able traffic and see what happens.
Any other way of "testing" is still susceptible to chance.
|
Well, yes and no, to be honest (I sound like a Lawyer).
YES if you're getting traffic from a myriad of sources. You'd have to 'narrow down' some of the traffic to get a better idea. However, even under that less-than-optimal scenario, if you have
consistent sources of traffic over many months/years - in other words, you KNOW how many sales you "typically" get, within a range - then it can be done.
NO in that if you have one "good" source (and by "good" I mean more than a thousand hits, or a big enough number to test) you can send that single traffic source to a seperate tour from your usual one. Then test THAT tour source A/B.
I know what you're saying tho - no matter the source it all comes down to the individual surfer. But if that were the prevailing wisdom then there would be NO testing. I don't know much but I do understand that some of the most successful BROgrams A/B test in this way every single fucking element on a page: font, colors, pics, text, hot spots, click spots, on and on and on...
(Since I've been doing A/B testing I've been able to 'narrow down' some things and not do so much 'hit or miss' changes, for whatever that's worth.)