Posts Tagged twitter

How accurate are online reputation tools?

Last week, we were introduced to PeerIndex, Klout and Kred. I decided to check out what scores I had on each, and see if the information they hold about me is accurate or not.


Klout score

Klout has scored me 39 out of 100 for online influence.

It’s highlighted my topics as Journalism, Twitter, Photography, Feminism, and Activism. So far, so good. When I go to manage my topics it then suggests London, Dubai, Art, Police, and Social Media. I understand London (live there), Dubai (have friends there, have tweeted about it a lot), and social media (it’s an obvious interest of mine). Art I can also understand – I love street art – but Police? Why?

Then it throws up even weirder suggestions. Greece? The NUS? Final Cut Pro? I have perhaps tweeted about Greece a few times but am no way near expert or especially interested in it beyond the Eurozone crisis, and since starting my account I’ve not tweeted about or been involved in student politics. I haven’t used Final Cut Pro for years (though admittedly I do know how to use it) and I’ve certainly never tweeted about it. That said, it does have my LinkedIn credentials and FCP is listed as a piece of software I can use.

Do I recognise myself in there? Yes, definitely. But I do feel that it’s not wholly representative of how I present myself online or how I actually am, and I think that out of context (ie without knowing why on earth Dubai is in there or my feelings about Dubai), those interests could be misinterpreted somewhat.


Kred scoreKred has given me 778 influence and an outreach level of 8. Sounds pretty impressive, but I’m not sure how it came to that conclusion.

The communities that I am apparently involved in are quite interesting. Travel, reporters and publishing are all fairly obvious – I’ve tweeted photos etc from my trips abroad, I’m connected to a lot of reporters on Twitter, and I have ‘journalist’ in my Twitter name.

I’m not a parent, but I do follow a great many people who might have children (let’s face it, it’s unusual to find people without children when they are over a certain age, and I tend to follow people who are older than me anyway). Automotive was the one that really made me laugh, though. Aside from having a car, which I barely drive as is, I don’t have any interest in cars or the automotive industry.


Peer IndexPeerIndex seems to have me down as a bit of a bore. You can see my Top Topics to the right. I wouldn’t say they are particularly wrong, it’s just that the combination of all five paints me as a very different person than the impression you’d get from a) seeing me; b) a full list of my interests.

I’m not sure where Museums came from – when I was in New York, I gushed about how great the Met was, but I don’t actually go to museums that much, nor do I tweet about them. Spirits and cocktails also makes me sound like a connoisseur – I’m flattered, but it’s not in the least true!

PeerIndex has put my ‘benchmark topics’ as arts and entertainment (50), news and society (49) and science and environment (48). It also has sport in there (18) – would that be a remnant from when I sarcastically live-tweeted Euro 2012? I have zero interest in sport!

Lastly, influencers and influenced… According to PeerIndex I’m influenced by people whom, although I like them, have very little impact on my clicking/retweeting behaviour. And, looking at the list of people I supposedly influence, there are some faces I’ve never even seen before on there. I’m pretty good at remembering Twitter names/pictures, so it’s strange that there’s some people I’ve just never heard of. And I’m influencing them? Hm. Ok.

So what now?

Well, I think these tools can be helpful if it isn’t used as the be-all and end-all of your social media strategy, but more as a guideline as to what makes a good Twitter account. The factors that are taken into account are telling as to your ‘social media personality’ – not in a definitive, these-are-your-interests way, but personality in the way that you socialise online. For instance, Kred values ‘outreach’ – that is, how generous you are to other people – replying, mentioning, retweeting or following others. This makes perfect sense and places emphasis on the frankly undervalued and misunderstood ‘social’ part of social media; after all, you wouldn’t turn up to a party empty-handed and without saying hello to anyone!

As for which of these is ‘the best’… At a push, I would probably go with Klout, but they are all hit and miss and I suspect they lack intrinsic value in themselves, only being of genuine use in certain contexts.


, , , , , , , ,

Leave a comment

Do we have a better way of measuring engagement online?

There are loads of tools that help you measure social media/community engagement online right now. Clearly this is something that people are becoming more and more concerned about; who is looking at, reading about, writing about our product? Who is sharing our news stories? Why?

I just can’t help but notice that so much of it is about numbers.

Klout scores

Klout assesses your engagement (supposedly) and gives you a number, ‘ranking’ you in how you influence people in your circle, ie how much you can get them to engage with things you write about or point out online. I’ll be honest; I just don’t understand the reasoning behind of pinning a number to your ‘value’ as an engaging user. What does the number 46 tell me about you? Bugger-all. Are Klout scores merely another vanity tool, a way to tell you you’re great… or a way to tell other people that you’re great?*


I use Hootsuite a lot (though I am going to move to for various reasons) to schedule, since Tweetdeck was bought by Twitter and fell off a very high cliff. I like Hootsuite – I’m a free user, and I get detailed analytics about which articles do well, where people click from, etc – but again my issue is that these are all numerical values. They don’t tell me much about the intention behind the action.

Did someone click my link by accident? Did they click it because they saw someone else retweet it? How many degrees is this person from me? Are they glad they clicked it or are they annoyed because it wasn’t what they expected or wanted? The answer to those questions would perhaps be more interesting. It would be useful to know if people click directly from my page or from other people’s retweets, because if it’s the case that people click through retweets, then that makes a retweet – through people you already know – arguably more valuable than the amount of followers you have. Similarly, it’d be much easier to ‘do social media right’ if I knew how successful I was at pointing people to what they wanted to read. What’s the point in having followers who don’t click links or engage with you?

Why use quantitative data to measure actions?

It’s easy. I get it. But really, what does having 50,000 followers tell me about someone? That they’ve been on the site for long enough, that they are a nice person, that they are useful? Perhaps. But that doesn’t mean that someone with 500 followers isn’t also all of those things.

The key thing is: engagement has intention and meaning beyond numbers. I wonder how many people click on Daily Mail links because they don’t like it and they want to hate-read. How many people tweet along with the #XFactor hashtag but love to hate it? Numbers just don’t cut it in these instances.

What about Facebook? Facebook Page Insights gave us stats about users ‘talking about’ a page, users ‘engaging with’ a page (both in terms of who has seen it, and who has liked, commented, shared). I have no idea if people are talking about my page in a positive way. In the case that they are talking negatively, there’s not a lot I can do to resolve that person’s negative perception of my page. (In fact, I have yet to find a way of actually seeing where people are talking about my page, but that’s a different issue.)

My answer to all of these questions would be that analysing engagement in a way that takes into account intention or meaning would be brilliantly useful for social media/communities editors.

Of course, this analysis is already done – by people who are employed by brands or PR companies, to monitor social media for mentions of the brand. Is there a brand with so much action on social media that they cannot cope? I don’t know. But it would be a lot easier to automate it.

I’m not arguing that current analytical tools are not useful or should not be used. Not by a long shot. Some of them are really sophisticated (and I’m aware as a free/non-corporate user, I don’t have full access to them) and great for measuring your success on social media. I would just be wary of drawing too many absolute conclusions about what those figures really mean when we have so little information about what’s behind them.

Automating qualitative analysis of engagement

People are currently trying to fix this very problem with comments on articles. In fact, recently, there was a Hack Day on ‘re-imagining comments’ which a team from The Times won. The ideas to come out of that are definitely interesting. These take into account either an extra layer of ‘moderation’ whereby communities or staff label people as useful/experts, or an analysis of the words used in the comment.

So when you comment “this is great, I agree”, it’s flagged up as a positive comment; “terrible article” is clearly a negative one. It’s definitely a move closer to the kind of thing I’m talking about, but there are some obvious issues especially when it comes to exact words that could mean something very different out of context. Instead of searching for words or phrases in isolation, the whole sentence/paragraph needs to be contextually analysed. Now it gets difficult… right?

I like coding now and again, but I’ve never touched social media APIs and I wouldn’t have a clue about where to start. Maybe the next Hack Day could be about re-imagining analytical tools?

If I’ve missed an important analytical tool which does take into account semantics, feel free to tweet or leave a comment. I’m very interested in trying it out!

*If you’ve found a use for Klout, again…tweet me, because I cannot for the life of me understand how it’s useful

, , , , ,

1 Comment