Strong opinions, weakly held

That’s not analytics

OK, so a guy made a Web site called Tab Closed Didn’t Read to post screen shots of site that hide their content behind various kinds of overlays that demand that users take some action before proceeding. He’s written a followup blaming the problem on over-reliance on analytics, mainly because some people justify the use of these intrusive calls to action by citing analytics. Anyone who justifies this sort of thing based on analytics should be sued for malpractice.

You can measure almost anything you like. It’s up to the practitioner to determine which metrics really matter to them. In e-commerce the formula relatively simple. If you’re Amazon.com, you want people to buy more stuff. Cart adds are good, but not as good as purchases. Adding items to your wish list is good, but not as good as putting them in your cart. If Amazon.com added an overlay to the home page urging people to sign up for a newsletter, it may add newsletter subscribers, but it’s quite likely that it would lead to less buying of stuff, less adding of stuff to the shopping cart, and less adding of items to wish lists. That’s why you don’t see annoying overlays on Amazon.com.

Perhaps in publishing, companies are less clear on which metrics really matter, so they optimize for the wrong things. Let’s not blame analytics for that.


  1. Or perhaps the overlays reflect the site owners’ clear priorities, and they’re willing to tolerate other negative side-effects to pursue those priorities, such as some visitors who who will just leave rather than deal with the overlay.

    If a web site owner is watching their analytics closely, then they’ll see the drop-off in other measurable activity when they implement an overlay, and then decide based on that data whether the overlay is having the intended effect and whether the changes in other activity are tolerable per pursuing their goals. (e.g. maybe one newsletter sign-up is worth 5 people who leave completely to the person who runs the site).

    Lots of untested assumptions in that original post.

  2. Mind you, I’m not defending the use of overlays–I hate them just as much as any other alpha geek–just questioning some of the assumptions behind this post.

Leave a Reply

Your email address will not be published.


© 2024 rc3.org

Theme by Anders NorenUp ↑