Flickr
See real example results of website optimization A/B tests
One of the big advantages of creating Web products is that effectiveness can be immediately measured. One lucrative example of this is click-through web advertising.
Another example is A/B testing where you can put up two different versions of a web page, each visitor randomly seeing one version or the other. You can then measure the comparative effectiveness of each version of the web page, measured in terms that you care about, such as the percentage of visitors that buy your product.
Here is one example from the Firefox download page
The only difference between these two versions is that the download button in the first has the text “Try Firefox 3″ while in the second it has “Download Now – Free”. Over almost 300,000 trials the first one resulted in 9.7% of the visitors downloading Firefox, while the second one resulted in 10.1% downloads. By repeatedly doing A/B tests, changing one thing at a time, you can incrementally increase your conversion rate — using actual evidence rather than guesses or conventional wisdom.
This and many other examples are on the abtests.com web site, which provides a fascinating insight into this technique. Here people share the results of their A/B tests, rarely available because most companies regard them as proprietary.
What is particularly interesting is that these are not all good A/B tests. Some are badly designed, and some have such small sample size that the results are not statistically significant. By reading through the comments that people make you can learn best practices to follow and also bad practices to avoid.
All in all abtests.com is an interesting site, and I hope people keep on sharing tests there.
Comments (10 comments)
To the previous commentator remember that Jesus loves you!
Thank you for your great post! It has long been extremely helpful. I hope which you will proceed sharing your wisdom with us.
I know this if off topic but I’m looking into starting my own weblog and was wondering what all is needed to get setup? I’m assuming having a blog like yours would cost a pretty penny? I’m not very internet savvy so I’m not 100% positive. Any suggestions or advice would be greatly appreciated. Many thanks
Precisely what I was searching for Uusi Firefox – Kaleidoskopia thanks for putting up. “There are many victories worse than a defeat.” by George Eliot.
Do you have a spam problem on this website; I also am a blogger, and I was wondering your situation; many of us have created some nice methods and we are looking to swap techniques with others, be sure to shoot me an email if interested.
Good day! I know this is somewhat off topic but I was wondering which blog platform are you using for this website? I’m getting tired of WordPress because I’ve had problems with hackers and I’m looking at alternatives for another platform. I would be great if you could point me in the direction of a good platform.
Superb website you have here but I was curious about if you knew of any forums that cover the same topics discussed here? I’d really love to be a part of group where I can get feed-back from other knowledgeable individuals that share the same interest. If you have any recommendations, please let me know. Cheers!
I used to be very pleased to search out this web-site.I wanted to thanks on your time for this excellent learn!! I definitely having fun with every little bit of it and I have you bookmarked to take a look at new stuff you blog post.
I am really impressed with your writing skills and also with the layout on your weblog. Is this a paid theme or did you modify it yourself? Anyway keep up the excellent quality writing, it’s rare to see a great blog like this one nowadays..
I was more than happy to search out this net-site.I needed to thanks for your time for this excellent learn!! I definitely enjoying each little bit of it and I have you bookmarked to check out new stuff you blog post.