NZblogsphere is a commendable attempt to catalogue New Zealand’s political blogs. However, and no insult is meant to Tumeke! by this, the ranking system is a mess. For no apparent reason, the blogs are scored on:
the number of unique visitors they get each day from people with the Alexa Toolbar installed, or unique visitors according to the site’s meter if available.
+ the number of posts a week (not a day?, not a month? Not a fortnight?)
+ the incoming links (number of blogs linking to your blog in the last 6 months) by Technorati
+incoming links as scored by Truth Laid Bear (many blogs, like us, are not signed up with them, so score = 0)
I can’t for the life of me figure out why an incoming link every 6 months should be worth 2 posts a week or two unique visitors a day. I don’t know what an appropriate conversion rate would be, indeed it’s impossible to determine an objective one, but this rate is just arbitrary.
Furthermore, what is a unique visitor? An IP address, yet many organistions share one IP address between many internet users, while many individuals go through several IP addresses a day (at work, at home, Bluetooth, and more if they have dial-up). Simply counting up the number of IP addresses a day does not tell you how many people are visiting a site.
The major problem I think, however, is relying on Alexa’s ranking of sites for the bulk of the points in each blog’s ‘score’.
The Alexa system works by recording the sites visited and page-views from everybody who has an Alexa toolbar running and tabulating them to make a rough guide to who’s going where on the internet. But there’s something weird when you look at the stats Alexa produces. The numbers jag about hugely between days – look at this graph of kiwiblog’s ‘rank’ over the last month:

Note that the numbers jag between only a few levels and they supposedly represent huge changes in readership (at a ranking 0f 72,195, Kiwiblog is credited with 7000 unique viewers, but when it dips below 100,000 the readership is supposedly half that or less). But what it’s actually measuring is how many people with Alexa toolbar visit and how many pages they view on any given day. So how many people have it?
Bugger all. According to Wikipedia: “By early 2005 there had been over 10 million downloads of the toolbar, according to Alexa. But the company does not provide info on how many of them are actually used. According to one estimate made in March 2003, Alexa had a sample size of 180,000.”
10 million is nothing worldwide, 180,000 is significantly less than nothing, and there is nothing to suggest they’ve got much bigger since 2005. Assuming proportionality, there could be as few as 120 Alexa toolbar users in New Zealand, and most of them are unlikely to read political blogs regularly (according to an Alexa comment site most users are “webmasters and marketing junkies”). What this means is that very, very few readers of political blogs in New Zealand will have Alexa and it just depends what sites those few people happen to visit on any given day. That’s going to produce the huge daily variations we saw in kiwiblog’s graph and advantage sites that happen to be favoured by one of these few Alexa users.
Alexa may be useful for major international sites but it says nothing about readership for sites as small as New Zealand political blogs (except giving a very rough indication of change over time). Nzblogosphere should give away the Alexa toolbar as a measure of blogs’ performance. A far more accurate and fair solution would be to ask those blogs who wish to be ranked to sign up to a program like google analytics and make the results available.
So what’s the solution? I would suggest hits is the only viable measure of a site’s popularity. Hits will go up as more people visit a site. Ok, there will be more hits than individuals visiting and hits probably actually rise faster than number of individuals visiting because more visitors mean more comments meaning people come back time more often but that doesn’t matter – each blog is subject to that same effect (unless they ban commenting) – and if the object is to measure blog’s relative ‘influence’ having multiple pageviews from the same person each day is just as valuable as a person who comes once a day and only looks at the front page.
My suggestion to nzblogosphere: drop everything else, and just count hits. Tell blogs that if they want to be ranked they need to have a hit counter that you can access, either from their blog or a meter site.