Your Blog’s Traffic Stats May Be Wrong

Last month after having seen a few articles describing errors in traffic sources by analytics solutions that fail to correctly identify referring sites, I wrote about some informal tests I had been doing with my blog. Since then, I’ve had the time to perform a few controlled experiments with some unexpected and very surprising results.

To test the hypothesis that WordPress traffic reports fail to identify clicks coming from sites like Twitter and Facebook, I set up a separate test blog where I could do a few experiments inconspicuously without being misled by incoming traffic from other sources. I populated the blog with a few posts designed to test some specific features of WordPress stats and began sharing links to the posts on various sites sometimes via special accounts and pages set up for just this purpose.

In all, I made tests with Twitter, Bit.ly, Facebook, Google+, Google Reader, email and webdoc.com. In each case, for every visit resulting from a click from a referring site, I verified that the view was correctly recorded by WordPress and noted the resulting referrer information, if any. Mike Cane agreed to be my lab partner for this exercise. He helped me by performing clicks for a few tests I could not easily make myself, as well as serving as an independent control to make sure my own observations were repeatable under independent circumstances. We used several browsers to test the repeatability of the results: FireFox 5.0.1, Safari 5.1 and Opera 11.50, and performed tests with email, Echofon 2.2.2 FireFox plug-in and with the following iPhone apps: Twitter version 3.3.5, Facebook version 3430, and MobileRSS Free version 3.4.

All tests were performed on Wednesday/Thusday August 3rd/4th WEST. I’ve made the results available in a Google Spreadsheet. They represent the state of wordpress.com stats and referrer information at the time they were executed.

In all, 32 click tests were made. Of these, 29 resulted in views being logged at wordpress.com. Only 11 out of these 29 listed any referrer information, so that 62% of traffic was listed as direct even though virtually all the clicks came from shares on one of the tested social network sites or a share via email.

Closer examination of the data reveals the following:

  • WordPress lists referral information for views only when the link is clicked to open the page in a new browser window. Clicking on a link from any of the sites to open a post in-place or in a new browser tab results in a view without any referral information, i.e. it shows up as direct traffic. Google Reader is the only exception to this rule.
  • Views in Google Reader don’t show up in wordpress.com stats! I subscribed to the blog with Google Reader and opened two posts in the reader using my browser and one in the Free Mobile RSS app on my iPhone. Surprisingly NONE of these views showed up in my WordPress stats at all! However, opening the link from Google Reader by right-click or control-click to open the link in a new tab or window both showed up as referred views from Google Reader.
  • 75% of views from Twitter show up as direct traffic. I made a variety of tests using bit.ly links as well as long links shortened by Twitter’s built-in shortener, both on Twitter.com, in the Echofon FireFox plugin and the Twitter iPhone app. Only 1 out of 4 clicks from Twitter were recorded with referral information, meaning that 75% of views resulting from Twitter clicks showed up as direct traffic.
  • All the clicks I made on bit.ly links were correctly counted on the bit.ly dashboard.
  • Clicks on search results from Google are correctly identified. I tested the search referral information by searching on google.com for a meaningless phrase in one of the posts: “Militant vegetables earn macaroons joyously still now.” Each of the three click tests performed on the search results was correctly identified by wordpress.com as coming from a search for this phrase.

The most serious problem I identified is the lack of view information coming from clicks on posts within Google Reader on the website and in the MobileRSS iPhone app. It is important to keep in mind that if my data are correct, none of the views performed within the reader by these subscribers will show up as blog traffic AT ALL, leading to an underestimation of traffic for posts viewed this way. For blogs with large numbers of subscribers, this means that total number of views could be underestimated significantly.

It is not clear to me why wordpress.com lists referrer information only when links are opened in a new browser window. I had expected to find exactly the opposite result. In other words, I expected that WordPress would show the referrer if the link were clicked to open in-place, i.e. in the current browser tab, and that the referrer data would be lost of it were opened in a new tab or a new window. If WordPress is able to identify the referrer when the link is opened in a new window, surely it should be able to do so if the link is opened on the same page or in a new tab. Clearly something is wrong here, because FireFox, Safari and Opera all demonstrate the same behavior. This does not seem logical to me, but I have not had time to look into a plausible explanation.

I am not able to explain my previous observations that traffic from bit.ly is between 6-8 times higher than accounted for on bit.ly’s click history for shortened links. The most plausible explanation I can think of to explain this is that links I’ve shared on Twitter using bit.ly are being reshared in a way that is not visible to me by people copying the link or shortening it with other tools.

Overall, the results of these tests provide a very clear explanation for the high percentage of direct traffic in the stats for the blogs I manage, all of which are hosted on wordpress.com. It would be interesting to see the same detailed click tests performed on a self-hosted site using other analytics packages, such as Google Analytics, to see in which cases the referrer information is recovered. Such tests might shed light on the question of the origin of the problem, whether it is a failure of conventional browser behavior to transmit this information to wordpress.com or a failure of WordPress to correctly record the data.

This entry was posted in Blogging, Internet, Social Media, Twitter, Uncategorized. Bookmark the permalink.

10 Responses to Your Blog’s Traffic Stats May Be Wrong

  1. Nate says:

    Thanks for doing this testing. I’m not on WordPress.com but I did want to find out the quirks.

    The Google Reader issue is no surprise at all; it’s always been that way. Reading a post through a RSS feed is not the same as visiting the site. It never has been.

    If you’d like to track those following your RSS feed then you’ll need to used a service like feedburner. I use it on my self hosted blogs but I don’t know how to enable it on a WordPress.com blog.

  2. I bumped into your article because I was just thinking about how rss-readers would end up in stats. It seems logical though that nothing is recorded because the content is pushed to google reader, so people subscribing this way never have to come to your site to view what’s going on. A possible solution seems easy enough. In the settings menu, under ‘reading’ you can specify weather your rss-feed should contain entire posts, or a summary. That way people would have to click I suppose. I didn’t test this though.

  3. Marcie Brock says:

    Great info on blog traffic stats. I was actually looking for info for Networked Blogs as a referrer, but this is still very interesting. Thanks for being the voluntary Guinea pig! I will definitely reference this in my own blog soon when I do another post on traffic and stats. Thanks.

  4. Renato says:

    Reblogged this on Renato Vasconcellos David and commented:
    Very Interesting blog and in this case,experiment.

  5. Luis Carlos says:

    I also noticed something of the sort the other day and decided to enter my blog with my mobile phone. I checked a lot of posts and pages on purpose but still got absolutely no record on my Stats. At least it looks like I’m not particularly cursed xD

    • laura says:

      Aside from views via RSS, I have never noticed any issue with views not being reported in WordPress stats. The main point of the post was that the referrer information is often missing even when the views come from known social networks or other sites. Over 1 year later, I still find this to be true.

  6. I’m glad I came across your blog post, to better understand why I can see many more view reported than referrers. Happens on my johngeorgecampbell.com website all the time. For example, this morning I really didn’t expect many views or visits at all, since it’s a few days since my last blog post. But there are 9 views, but NO referrer shown. Another post about this says that views show up immediately, while referrer information can take hours to show up. Another post suggests that it’s googlebots visiting viewing pages. Each answer seems reasonable, but it’s still very strange when you have more views than referrers, or no referrers, at all.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s