Size matters

Two brains are better than one, but do too many cooks spoil the broth? A new mathematical model claims to identify the optimal size of a crowdsourcing group, and bigger doesn’t necessarily mean better. By Bronwen Morgan

Size matters crop

Crowdsourcing – the process of getting ideas, work, or funding from a crowd of people – has become central to modern business and, in the guise of online communities, to market research. It would be easy to assume that the bigger the group, the better the outcome. But new research suggests that this may not be the case.

A team of academics, led by Zoran Levnajic of the Faculty of Information Studies in Slovenia, has created a new mathematical model that says – for some tasks – crowdsourcing a problem works best when a certain subset of the population chooses not to participate.

“Human beings probably have an innate tendency to operate in groups,” the paper explains. “The emerging skill of social problem-solving has allowed our ancestors to face the challenges of gradually increasing complexity. This factor not only determined our evolutionary success, but still shapes our cultural and social behaviour.”

But the paper points out that while the existence of large sub-groups of collaborators guarantees a stable support for the community as a whole, it also creates a “socioecological niche for the free-riders”, who are described as those that benefit from the available social support while “providing little to its development”.

Levnajic and his colleagues tested this hypothesis virtually, by simulating a scenario in which groups of varying sizes within virtual populations were randomly assigned tendencies either to collaborate or to work individually on a problem. The groups were then assigned problems of varying levels of complexity to be solved, and the results compared. A score was also introduced for each player: ‘fitness’, which represents the player’s own benefit in terms of new knowledge acquired from the task.

It was found that for very hard problems, players had no preference on collaborating, regardless of the size of the group. But, for very easy tasks, players in small groups strongly tended to collaborate – in fact, tendency to collaborate increased with task simplicity, while for players in big groups, this tendency decreased.

The team reasoned that when a task is extremely difficult, it is hard to solve it collectively as well as individually, which leads to there being no preference for either problem-solving approach. But, as the tasks become gradually easier, it becomes less beneficial for players in small groups to work individually, since this reduces the size of the ‘collaborating subgroup’, making it so small that little to no fitness – knowledge benefit – is gained from it for anyone involved. So the choice to collaborate is a safer one in terms of guaranteeing at least some fitness for all players.

But in a larger group carrying out an easy task, there is more incentive to choose not to collaborate, as the collaborating subgroup will always be reasonably large and contribute significant fitness. But, if a player chooses to work individually, they will still be guaranteed some knowledge benefit, making it a relatively safe choice to free-ride in this way.

“An individual facing a new challenge in isolation has considerably smaller chances of solving it, despite relying on the available knowledge,” the paper says. “Yet, if a solution under these circumstances is ultimately found, this subject learns much more than when the solution is found collectively.”

It was found that a group size of 50 had the optimal system whereby both collaboration and individualism were equally beneficial for a task of any difficulty. A group size of 100 saw too many players working in isolation in the hope of getting a free ride, so that the group gained less overall.

We hope you enjoyed this article.
Research Live is published by MRS.

The Market Research Society (MRS) exists to promote and protect the research sector, showcasing how research delivers impact for businesses and government.

Members of MRS enjoy many benefits including tailoured policy guidance, discounts on training and conferences, and access to member-only content.

For example, there's an archive of winning case studies from over a decade of MRS Awards.

Find out more about the benefits of joining MRS here.

0 Comments


Display name

Email

Join the discussion

Newsletter
Stay connected with the latest insights and trends...
Sign Up
Latest From MRS

Our latest training courses

Our new 2025 training programme is now launched as part of the development offered within the MRS Global Insight Academy

See all training

Specialist conferences

Our one-day conferences cover topics including CX and UX, Semiotics, B2B, Finance, AI and Leaders' Forums.

See all conferences

MRS reports on AI

MRS has published a three-part series on how generative AI is impacting the research sector, including synthetic respondents and challenges to adoption.

See the reports

Progress faster...
with MRS 
membership

Mentoring

CPD/recognition

Webinars

Codeline

Discounts