Voodoo metrics: Facing the music

by Urs E. Gattiker on 2013/01/15 · 2 comments 8,136 views

in a analytics: rating and ranking - who's #1,a dos and don'ts

How good is your favorite blog? Find out: My.ComMetrics – rankings
Is your favorite blog missing? Suggest the blog – we will track it for you – for FREE, of course.
You can’t always get what you want
We are evaluation-obsessed, and in turn we suffer a ranking obsession. Unfortunately, most rankings are useless when it comes to the bottom line.
The first post in this series was Fashion blogs: Is trust possible?
Tips, Tools, Monitoring, Best Practice

Best Fashion Blogs - Ranking

Recently I came across a very interesting blog post by Beth Kanter about Facebook Insight. However, after reading it I was left wondering how Facebook got their data. Should understanding the methodology not be first on my agenda?

Other people have suggested that Klout is no more trustworthy. Accordingly, which numbers, benchmarks, rankings, measurement tools and monitoring results should we use?

By the way, sign up for our blog – it is FREE! Get the next installment of this series first.

See also, Welche Erfolgskriterien hat ein Fashion Blog? (German version of the first post in this series).

1. Why does your metric matter more than mine?

You must ensure that the rationale behind using any type of rating or ranking makes sense to your stakeholders. If neither your boss nor client fully comprehend how you arrived at the numbers and what they mean in practice (think bottom line), you are in serious trouble.

Make sure that your metrics help gain insight about the matters customers and management care about. If the amount of traffic is important, explain and demonstrate how this will relate to leads or advertising income on your blog (i.e. key drivers management cares about).

2. Why should I trust your numbers?

If you do not spell out how you got your numbers, you are presenting a black box and your audience will probably complain about it.

To illustrate, a recruiter that notices your score on Klout will think you have influence, something they want for their company, thereby improving your attractiveness as an employee. But wait! Since the recruiter cannot find any convincing information that Klout’s methodology measures what it says it does, they withhold judgment.

Would you risking purchasing a house without seeing it first? Unlikely. So why should you do so with social media ratings, rankings and measurements – what makes them any different?

3. Shall we go for lunch?

Just because people like to read lists, and so magazines compile them does not mean the numbers are credible. Things are not that different for fashion bloggers. There are numerous rankings available that leave a lot to be desired when it comes to understanding which criteria determine inclusion of a particular blog, such as:

ebuzzing top blog rankings
Cision – top fashion blogs – UK, DE, US, etc.
Top 20 fashion blogs (Great Britain)
TOP 10-Liste der Schweizer Modeblogs (Top Ten Swiss Fashion Blogs)

Fashion bloggers, brands, etc. imbue these rankings with an authority that is largely unjustified, especially considering many can be manipulated. This was sadly demonstrated during 2012 when several US universities gamed college rankings.
Who is #1?

Conclusion – Running on empty: Signs of failure

Some have argued that trust remains an issue because brands are still wary of the many inexperienced bloggers posting about their Spring line-up at Milan or Paris Fashion Week. Moreover, the content is unmoderated and easily accessible. And of course, while some are very good at it (e.g., writing style, research done before publishing the content), others publish no more than rough drafts.

Finally, as long as such rankings put Mashable (the news site for social media and Internet enthusiasts) as high up on the list as top universities such as Harvard, ETH Zurich or Cambridge, some questions remain regarding the quality and trustworthiness of these rankings. Customer beware – or be a fool.

Get more ComMetrics content on Google, Fashion, design, trust ratings and rankings (just click the URL to get some very interesting results).

Source: Voodoo metrics: Facing the music

I look forward to your thoughts and comments below.


Urs E. Gattiker, Ph.D. - CyTRAP Labs - ComMetrics.

The author: This post was written by social media marketing and strategy expert Urs E. Gattiker, who also writes about issues that connect social media with compliance, and thrives on the challenge of measuring how it all affects your bottom line.

His latest book, Social Media Audit: Measure for Impact, was recently published by Springer Science Publishers.

Connect with ComMetrics on Google+ or the author using: Email | Twitter | | Xing



  • http://twitter.com/data_nerd Carla Gentry CSPO

    Nice article Urs – and agree about inexperienced bloggers and marketers – they hurt our business and our reputation (like everyone is a guru, even in Data Science) – Trust, experience and the ability to communicate, VERY important! Thanks for writing!

    • http://commetrics.drkpi.ch/articles/what-they-do-not-teach-you-at-lady-gaga-university/ Urs E. Gattiker

      Dear Carla Carla Gentry CSPO

      Thanks so much for stopping by and letting me know what you think about this issue.

      As always, right on the money.

      Sometimes I wonder if all it takes is making sure that one screams louder than the guy next door…. so many hear… and voila, one must be an expert.

      Quality over quantity…. unfortunately it is often the opposite.

      Thanks for sharing @data_nerd:twitter

      Urs @ComMetrics

Previous post:

Next post: