Wednesday, December 31, 2014
The Algorithm for Serendipidity
I have resisted Kindle, again. Despite the state of my room, and the fact that I plan to relocate to another country sometime soon. It is slightly ironic that I am studying the relationship between technology and knowledge, and yet I am reluctant to surrender my book-reading habits to Amazon, however much I may love it.
The reason is, for me, serendipity trumps convenience.
In Too Big To Know, David Weinberger talks about our two kinds of attempts to organise the world: Algorithmic and Social. The first one is to let the machine organise, based on a secret sauce of behavioral prediction. The other is to let our friends recommend what we may like, leveraging the possibility that we may now have a network of 'weak connections', who might be able to provide us with insights beyond our immediate environment. The holy grail of this organised world is indeed to optimally combine the two, because we can easily point to the limitations of each approach on its own: This is about machines aggregating behavioural predictions of a great network of similarly inclined people and then extrapolating statistical possibilities of me liking something (or someone).
Yet, at the heart of all this remain the same principle that we followed ever since we felt the need to filter our knowledge: The surrender of the possibilities that come from experience. Earlier, we listened to our Gurus and friends, and followed Coffee House gossip to engage selectively with our world. The better ways that we invented today is to seek such information more passively, in one click as they say, by mining the data from around the world and listening to the wisdom of the machines. It does work perfectly to a degree, but as I have learned checking about Amazon's recommendations for me over the last 15 years that I used the service, it actually works too perfectly by shutting down all possibilities of serendipity and consigning me to a neat echo-chamber of my own walled garden.
Amazon's top recommendation for me this Christmas was a Nintendo 3DS game, as I have bought a console as a gift a few months ago. This is a perfectly logical way of predicting behaviour, and I am sure it is correct both in algorithmic and social sense. Such simple irrationalities are to be expected: we are still a long way off from building algorithms that can work out correctly the occasional quirks of human social life and unexpected (not to mention unreasonable) behaviour. One could argue that over a longer period of time, such issues can be smoothed out, but regarding this, Keynes was prescient - "In the long run, we are all dead" - and the consumer and the entrepreneur have no use for "long run".
Indeed, this is not about Amazon making me stupid: It sure doesn't, as I look up books on it constantly to learn more about them, and also to check out similar items, recommendations and all. It is a more relative thing about how much of my reading preferences I want to give up to its algorithm. The most beautiful moments of my rather mediocre life are usually the fifteen minutes I steal from my Saturday shopping trips to stop by at the local library, where I make, more usually than not, unexpected discoveries every week. The world's information stock may be doubling every three years thanks to Digital explosion, but this is more about obscuring more than knowing more: The best moments for a book lover now-a-days is still about finding out-of-print books left untouched on Library shelves for years waiting for the perfect moment for a man with odd tastes feeling through it.
So, in the end, I decided to keep myself a prisoner of the analog chaos - one more year perhaps! There is an element of nostalgia, surely, but also a search for the algorithm of serendipity. The point about the submersion in books (literally, as you can see) is not just about the musty smell and all that, but the physical nature of engagement (a visit to the library as opposed to online browsing) that creates a stimulation that our poor simian brains need for engagement. I would rather spend a few hours playing Plants-versus-Zombies rather than turning a zombie in my book buying.
A friend has recently forwarded me a quote from Lord Macaulay's speech in the British Parliament on 2nd February 1835. I reproduce the...
Introduction : The Business of Gift Giving Business gift giving has always been common and contentious at the same time. Business gifts are ...
This has been the best and worst of the times for Higher and Professional Education. While people pursuing Higher and Professional Educati...
The inspiration behind this post comes from several conversations with my colleague Pratik Dattani, the former UK Director of FICCI, an In...
It is possible to see the recent history as an interplay between Politics and Economics, and 2016 as some kind of inflection point that ma...
Over the last several decades, the politics of college has reached a consensus: Everyone seemed to agree that more people attending colleg...
I wrote previously about the College Trap ( see here ) - how college can't be denied to anyone in a democratic society and yet, the pr...
It only seems natural to hire people who fit the organisation's culture. In fact, the most common excuse for executive failure is the ...
I came across the term, 'self-colonialization', in a news report on Arundhati Roy's recent speech in Berlin. She was speaking ...
Despite the euphoria in the Indian media, new-found confidence of the Indian businessmen and the sense of optimism on High Street, India rem...
How To Live
"Far better it is to dare mighty things, to win glorious triumphs even though checkered by failure, than to rank with those poor spirits who neither enjoy nor suffer much because they live in the grey twilight that knows neither victory nor defeat."
- Theodore Roosevelt
- Theodore Roosevelt
We shall not cease from exploration
And the end of all our exploring
Will be to arrive where we started
And know the place for the first time.
- T S Eliot
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.