I have been reading Anne Holland (note: that is not Anne’s picture on the right) for a long time — she founded one of my favorite sites Marketing Sherpa. I only rarely post Marketing Sherpa articles here because most links are only open for a week. If you are interested in online marketing efforts, I encourage you to check out Marketing Sherpa and perhaps subscribe to the pay site, or one of its RSS feeds or e-mail newsletters.
I digress. I just found Anne Holland’s new site — Which Test Won?. The site claims to have “the goal of evangelizing the best practices in marketing optimization — in particular through A/B and multivariate testing.” Those sound like some of the same goals many of us have in our classes. The site posts A/B tests and the results. For example, in this particular test you can predict which of two websites will have the higher level of sales. As it turns out, one of these two very similar pages generated 34% more “add-to-cart” clicks.
It is nice to have some real marketing research that you can show and discuss in class. I am going to show my class both pages and ask them which one would sell more — or if they think they would perform similarly. A show of hands (or clicker votes) — perhaps with a follow-up discussion about why they favor one or the other. Then, if there is some way to figure out which will perform better. You could then describe the experiment that SlideShop.com ran over a two week period (with 50,000 – 60,000 visitors) — you will see the results after you submit your vote. You can find other examples in its extensive archives.
Fun site. I will be back.