澳门六合彩资料库

People Who Contribute Least in Crowdsourcing Can Do the Most to Improve a Public Good

Rewarding People to Give Ratings Increased Accuracy and Improved Quality, Researchers Suggest

News
Finger pointing to stars on computer screen signifying a product or service rating
Getty Images

Whether talking about the office kitchen, hiking trails or ratings on Yelp, there are always people who put in effort to leave those spaces better. There are also those who contribute nothing to that public good.

New research using large-scale online experiments suggests that rewarding people to contribute to a virtual public good, such as a simulated online rating for a ferry system, increased the accuracy of the ratings and improved the overall quality of that resource.

The multidisciplinary team, including researchers from the University of California, Davis; Hunter College, College of New York; the Max Planck Institute for Empirical Aesthetics; and Princeton University tested ideas about collective action in a simulation incorporating more than 500 people worldwide. Team expertise included communication science, sociology, computer science, psychology and animal behavior.

The was published this week in the Proceedings of the National Academy of Sciences.

鈥淲hen you have a collective action problem, you either want to prevent a bad thing from happening or you want to harness all this energy to make a good thing happen,鈥 said Seth Frey, an assistant professor of communication at 澳门六合彩资料库 Davis and co-author of the paper. Frey studies collective action, or the science of creating systems that can maintain shared resources.

He said the study could have broader applications for online retailers鈥 rating systems. 鈥淲hat our results could mean for Amazon ratings, Yelp stars, or clothing retailers is that if those sites gave rewards for engaging in reviews, they would not only attract more product ratings, but more accurate ratings, which helps everyone.鈥 

Riding ferries for coins

The team developed a 3D virtual world where online players enjoyed a limited amount of time to collect coins on tropical islands. In the game, ferries that took players from island to island all traveled at different speeds.

The game included a rating system so players could help each other choose the fastest ferry. Those ratings were shared among all players. Some participants rated most or all the ferries, contributing to the public good, while others hardly rated any, researchers said.

鈥淵ou just have to learn over time by exploring and testing which ones are best,鈥 said Nori Jacoby, a research group leader at the Max Planck Institute for Empirical Aesthetics and a co-author on the study. 鈥淲e made that a collective effort by letting people leave ratings so other people can learn quickly which ferry would be their best choice.鈥

Improving a public good

The public good represented in this game was the ferry ratings, but similar human behaviors in the real world affect online rating systems, forestry management and even climate change, researchers said. Frey said that in the game, leaving ratings was considered a pro-social act because it benefited everyone.

One of the challenges for maintaining a public good is the presence of free riders 鈥 or people who may participate and enjoy the resource but don鈥檛 contribute ratings. Just as there are people who don鈥檛 leave ratings on Yelp, not everyone left ratings for ferries in this study鈥檚 virtual world, either, researchers said.  

But, when players were awarded coins for providing ratings, the proportion of players who left ratings at all increased from an average of 35% to 70%. Free riders who were responsive to incentives provided higher quality evaluations and balanced out the over-optimistic ratings of more intrinsically motivated contributors, researchers said. Players who had been providing ratings without a reward tended to rate ferries much better than they actually were.

鈥淚t鈥檚 a cruel irony that the folks least likely to participate for the collective good are the ones we most need due to their superior skills,鈥 said Dalton Conley, Henry Putnam University Professor in Sociology at Princeton and a co-author on the study.

This study鈥檚 finding that rewards for improving a shared resource contrasted with previous research, the paper鈥檚 authors said.

In the game, incentives overcame the 鈥渃ollective action鈥 problem related to the game鈥檚 ratings. The most common example of a collective action problem, said Frey, is the 鈥渢ragedy of the commons,鈥 where people destroy a shared resource 鈥 like a forest, a park or the office kitchen 鈥 by acting completely in their own self-interest. The incentives encouraged players to work together.

鈥淲e can just let people have personal experiences and learn for themselves or we effectively harness the knowledge of the collective in a way that benefits everybody,鈥 said Frey. 

Media Resources

Media Contacts:

  • Alex Russell, College of Letters and Science, parussell@ucdavis.edu
  • Karen Nikos-Rose, News and Media Relations, 530-219-5472, kmnikos@ucdavis.edu

Primary Category

Tags