The Opinions of the few

How participation inequality blinds the wisdom of crowds and creates the opinions of the few


Technology trends and news by David Saad
July 18, 2008 | last edited July 22, 2008 | Comments (12)

1432
 

(Editor's note: This post is being re-published and highlighted due to its popularity.) 

The wisdom of crowds theory as advanced by the New Yorker columnist James Surowiecki contends that the collective opinions of a group of people is often smarter than the opinion of a single member of the group, or for that matter, the opinion of an expert.  The central thesis is based on the fact that the diversity, independence, decentralization, disorganization, and aggregation of opinions make the entire group reach a smarter decision.  Corollary, when opinions are too homogeneous, too centralized, too divided, too imitative, and too emotional then the crowd usually fails to achieve its collective intelligence.  For instance, our judicial jury-based system is based on this seemingly counterintuitive notion.

 

The Participation Inequality theory as advanced by Will Hill of AT&T Laboratories and later cited by Jakob Nielsen in his Alertbox blog posting entitled "Participation Inequality: Encouraging More Users to Contribute", states that only a tiny minority of users in an online community contributes for a disproportionately large amount of content creation.  Specifically, user participation in an online community follows the "1% rule", sometimes also referred to as the "90-9-1 rule":

  • 90% of users are lurkers who tend to read content but rarely, if ever, contribute anything whether creating original content or commenting on any content.
  • 9% of users contribute occasionally by either writing original content or commenting on existing content, even though we now know that most tend to do the latter.
  • 1% of users contribute the most by regularly creating new original content or commenting on existing content. 

Since those two theories came about, and rolling forward to 2005 when a wave of entrepreneurs, including myself admittedly, attempted to exploit the potential of the wisdom of crowds, I now candidly recognize how we were all blinded by the light of Participation Inequality.  To put it even more bluntly, those of us who knew about the Participation Inequality chose to ignore it and preferred to be carried by the excitement of the wisdom of crowds.

 

Current rating/review/vote/reputation/meritocracy systems collect the opinions of the few - that 1%.  Some may argue that there are ways to reduce such participation inequality as suggested by Nielsen himself, nonetheless, inequality remains even if reduced.  Thus, on close analysis, the minority represented by that tiny 1%, enhanced or otherwise, consists of the extreme.  For example, in a political blog, the minority consists of diehards who fall on the left or on the right.  The great majority of people who fall in the center belong to the lurkers group - they never bother to express their opinions.  In an example of a product commentary, consumers who are likely to comment are the ones who either love the product or hate it.  Thus, in order to be enticed to comment, passion (for or against) is the motivating factor to engage by expressing one's opinion.

 

It is indeed this passion which is the main cause of breach of the wisdom of crowds assertion.  Specifically, since the great majority of reviews come from the tiny minority of diehards who fall on either side, then the collective opinion is too homogeneous, too centralized, too divided, too imitative, and too emotional to be a wisdom of any kind.

 

In retrospect, and very candidly, those of us who claim to be building systems based on the wisdom of crowds aren't doing so.  That doesn't necessarily mean that what we're building is useless, but let's admit that it isn't the wisdom of crowds but the opinions of the few.

 

If my analysis is correct, then the next big question, begged to be asked is obviously the following: "is the opinion of the few valuable?"...

12 comments

Submit yours
Comment_gbg
Mark Gibons, 124 days ago
If you need brain surgery, you only need the opinions of a few experts and not the wisdom of the crowds. So yes, there are many cases where the opinions of the few is needed, in fact more so than the wisdom of crowds.

Login to reply Mark


Comment_gbg
martin english, 168 days ago
It comes down to 2 issues: 1) The echo chamber effect - if you get, say, more than 50% participation, are they just regurgitating the 'opinions of the few', or are they making their own minds up ? 2) You need diversity, not just numbers. Doesn't matter how many of people like me participate, you'd probably get a an almost unanimous outcome. But me and Obama ? You'd get a different result. Not cause he's smarter (probably a given), but because both he and his experiences are different are different from mine.... Different country, different education, etc. If you add one opinion from a third world country and one from Europe, you start getting a better 'Wisdom of the Crowds' than if you selected four people from one of those opinion.

Login to reply martin


Comment_gbg
Lisa Coneli, 170 days ago
No. I don't think that that's what David is saying. It's not the quantity but the quality. I think what David is saying is the diversity of opinions needs to be present in order for a wisdom to emerge. The fact that 100%, 90%, or 30% of the group participate or not is not as important as the quality of opinions of the participants. For example, in one extreme case, you have everybody participating and everybody has the same opinion or 50% have opposite opinuions. Those are polorized cases which tend to not produce any wisdom. That's the argument.

Login to reply Lisa


Comment_gbg
Gilbert Michaelson, 170 days ago
What you seem to be applying is that the only way to get the wisdom of crowds is to have the entire group express their opinion like in your example of a jury. If that's the case, then the wisdom of crowds can rarely be attained because it is impossible to have each and every individual in a market express his/her opinion.

Login to reply Gilbert


David Saad
David Saad, 171 days ago
Yes, Lisa. You got it right. As far as the viability of my company (Clupedia) it is certainly viable because I do believe that there is value in offering the opinions of the few even though it isn't the wisdom of crowds.

Login to reply David


Comment_gbg
Lisa Coneli, 171 days ago
Correct me if I am wrong, you're not challenging the validity of the wisdom of crowds but questioning whether or not the system that have been built so far who claim to offer the wisdom of crowds are actually offering nothing more than the opinions of the few. Right? If so, I admire you're courage and your candor considering that your assertion puts in question the viability of your own company, doesn't it.

Login to reply Lisa


Comment_gbg
tim regan, 172 days ago
I always look at the wisdom of crowds concept a bit like watching a footbal game. The players are adding the content and the crowd is watching, commenting, theorising etc, but not really adding 'content'. Unless we take a wider view and wonder, if the crowd was not there would the game actually happen? Perception is often reality and if the crowd were not there then the few (1%) do not really matter. I think the 'few' are actually followers (a type of leader) looking to see what the crowd will be 'attracted to' or 'watch'. If you can figure out how to do that I guess you would be part of the wisdom of the few.

Login to reply tim


Comment_gbg
Mark Gibons, 172 days ago
Not quite, Swamy. Indicating whether a review is helpful or not does not necessarily address the point that David is raising which has to deal with the fact that the reviews posted are likely to fall in the two extremes as he mentioned, and therefore ending up being opinions of the few and not necessarily the wisdom of the crowds. At least that's what I understood from his argument, which makes sense.

Login to reply Mark


Comment_gbg
Swamy Viswanathan, 172 days ago
I think that Amazon.com has done a nice job of trying to address this problem by allowing reviews themselves to be rated. They do make sure that the "most helpful" reviews are highlighted. I think that this plays to the psychology that while most of us are lurkers, we are certainly willing to express some opinion about those that have taken the trouble to say something on their own. Consequently I believe this may be a simple way to sort through participation bias.

Login to reply Swamy


Marc Dangeard
Marc Dangeard, 172 days ago
Actually there is another way to look at the concept of "wisdom of the crowds". An example of how it works is that experiment that they ran where they had a room of people looking at a screen and then half the room on the right side with green flags, and half the room on the left side with red flags. The film on the screen was from the cabin of a plane, and there was a system to count how many green of red flags were up at any time. The plane was driven right or left based on how many flags were up from one color or the other. The crowd was flying the plane that way. The goal was to fly through hoops along the way Scary experiment when you think about doing this in a real life situation, but it was amazing to see that it was actually working. So what I get from all this is that there is wisdom is management (driving) through statistics (the crowd). This is a theory of management that Deming has been pushing in his book "Out of the crisis", and this is the beauty of what can be done with the web these days. While production is the result of a few participating, when it comes to figuring out how to improve your service, the reaction of the crowd will tell you. If the service is good, attendance (the lurkers, and this is their value add) will increase. If your service is no good, you'll know real fast too, and then you can try to figure out what to do about it. The wisdom of the crowd is statistics. In Open Source for example, this is where the code gets sorted out I believe. Since everything available and free to distribute, what makes the difference is the feedback that the crowd (the lurkers) gives to the producers (the 1% few).

Login to reply Marc


Bambi Francisco
Bambi Francisco , 172 days ago
Nice write-up David. This reminds me of something Jimmy Wales (of Wikipedia fame) told me long ago. About 1.5% of Wikipedia users create two-thirds of the content. I do think the Internet allows for the "wisdom of crowds" theory to be carried out. In the news business, more people go to the source and specialists on topics. The problem is the "few" whose opinions are considered valuable are the ones who tend to be more prolific and consistent. They don't necessarily have to be smarter or wiser than the crowds, they're just "valuable" largely because they're consistent (and somewhat informative).

Login to reply Bambi


Comment_gbg
Jon Bjork, 172 days ago
From my experience with management, local politics, and even church, it is the few that are willing to lead or do the work. There is an "I don't have time for this" or "I don't want the responsibility" position that lurks in all of us, creating what I don't like to call laziness or apathy. I've found that most people have good intentions, but just don't get around to converting them into accomplishments. Most people don't run for president, then complain about the person that did step up. If we are going to have wisdom of the many, it's going to take the motivating leadership of the few encouraging them. Jon

Login to reply Jon


Vator.tv top stories

Tips on cost reduction

2008-11-03-tips-on-cost-reduction

From investor

by Jeremy Liew
November 3, 2008
Don't be a wimp; do the best for your company

WooMe cuts cost to extend life

4825_woomee_lessonweb2

From entrepreneur

by Bambi Francisco
November 10, 2008
CEO Stokols of online introductory site says he's slowing it down a bit to wait for a recovery

Facebook sues Power.com

2010-01-02-facebook-sues-powercom

Technology trends and news

by Bambi Francisco
January 2, 2009
Apparently, Power wasn't in compliance with other social networks

Tila Tequila ushers in reality TV on Woome

4841_stokols_woomeepitch

Entrepreneur interview

by Bambi Francisco
November 13, 2008
Speed-dating site turns 'dating intros' into new form of entertainment

Why developers prefer iPhone to WindowsMobile

4864_stan-miasnikov-of-phatware-compressed

Entrepreneur interview

by John Shinal
November 12, 2008
PhunkWare's founder says Apple's OS makes it easier to focus on features

Tips to consider for better online marketing

2008-12-17-tips-to-consider-for-better-online-marketing

From entrepreneur

by Mike Fruchter
December 17, 2008
Thoughts to consider for better online marketing

Ignorance and bliss

2008-11-01-ignorance-and-bliss

From entrepreneur

by Demian Entrekin
November 1, 2008
How much knowledge is too much?

10 tools for listening in social media

2008-12-09-10-tools-for-listening-in-social-media

From entrepreneur

by Mike Fruchter
December 10, 2008
Brand monitoring tools
© 2008 Vator, Inc.