A notch above a monkey

Tag frequency ratio

Yesterday I talked about influence of language and tag design on ratio between the number of unique and all tags. I haven’t discussed why this number would be interesting and what would it tell us.

Let’s start with a simple graph:

Tag space

Blue circles represent objects. Connections represent tags and rectangulars are pages with hits for a specific unique tag. As we can see, all images but one have two tags (number of connections from a circle) and the most popular tag is attached to 4 images (number of connections from a rectangular).

What ratio tells us is an average frequency of a given tag (how many connections does a typical rectangular have). The higher it is, more hits will be returned by search.

However, tag connections and rectangulars also form a path between objects. Therefore higher ratio also means a better connected graph with (again on average) shorter paths between different objects. For example if we look at the red path on example graph then left top object is at least two clicks away from the top one and at least four clicks away from the bottom right one.

If tag browsing and searching are main methods of exploration, then a loner like the most right circle is practically unreachable and more tags an object has, the better chances it has to be discovered.

Now, I presented a very simplified graph with a fairly even distribution of tags. Normally you wouldn’t have this. A word like cat is far more likely to be used as a tag than something like hippopotamus resulting in creation of super-nodes with far more connections to objects than system’s tag frequency ratio.

With time you’d also expect this ratio to grow. Vocabulary, especially of commonly used words, is far more limited than number of pictures people can take and with time it becomes harder to create a unique tag. Flickr has tens or even hundred millions of tags, but certainly far less unique ones.

Graph topography and things like super-nodes not only skew the picture, they can also change the perception and application use. I’ll write more about how in few months, when there will be more knowing and less guessing.

Tags

Tags are increasingly popular and rightfully so. I’ve built my share of applications with their own taxonomies and I’m certain they simply don’t work. They sort of work if they were built for specialized needs and are used only by trained, disciplined people with excellent organizational skills.

Which means almost never.

Tags (aka folksonomies) are messy. There’s no real system, any bozo can attach whatever it wants and you’d be a fool to blindly trust any specific tag. They are the worst possible system apart from everything else we tried so far.

That’s why we decided to implement them in Marela. Language used on Marela is Slovene and that led to slightly different design that commonly found elsewhere.

We decided to treat multiple words separated with spaces as one tag and use commas as a delimiters between different tags. First reason for this is that tagging something like New Zealand becomes more natural. The other was that in Slovene compound words like handbag are very often separate words. For example, handbag would be ro??na torbica .

Another problem, which we haven’t tackled yet, but probably will have to, is that Slovene is a complicated language in ways that make tagging a nasty problem. There are six cases, but nominative is usually used. Still three different grammatical numbers (singular, dual and plural) together with three different genders (masculine, feminine and neutral) leave multiple options for the same thing. If you were looking for blue objects, you’d need to search at least for tags modra , modro , modri and modre . Right now you have to do this manually.

And then there are problems that plaque other tagging systems as well. Most common of them are misspelled words, like Wein instead of Wien for Vienna.

All these lead to a fairly flat tag space with a ratio of 5.6 between all tags and unique ones. I’m not sure how it would change if we treated spaces differently or even what is a common ratio for other languages and other applications. I’m guessing it wouldn’t change the ratio too much because of noun cases, but it remains to be investigated.

So, why does it matter?

Well, that’s a matter for another post, which I’ll probably write tomorrow.

When to give in?

Probably the most common misfortune every creator encounters is that something he thought up doesn’t or won’t work as planned and it has to be changed. In a way half of work is done by just recognizing and accepting that it doesn’t work.

But how do you do that?

Our change of image navigation was in retrospect quite easy. As a friend said: “You don’t have to satisfy everyone, but you should satisfy at least somebody.”

It wasn’t easy for me, because I was quite attached to it and I failed to recognize it as a problem. And this wasn’t even a close call.

So, how do you decide when to give in to requests conflicting with your vision?

Relying on a personal hunch might work for a while, but as a long-term strategy it’s probably not much better than rolling a dice.