When the Crowd is Not Enough: Improving User Experience with Social Media through Automatic Quality Analysis

Publication
Mar 1, 2016
Abstract

Social media gives voice to the people, but also opens the door to low-quality contributions, which degrade the experi- ence for the majority of users. To address the latter issue, the prevailing solution is to rely on the ”wisdom of the crowds” to promote good content (e.g., via votes or ”like” buttons), or to downgrade bad content. Unfortunately, such crowd feedback may be sparse, subjective, and slow to accumulate. In this pa- per, we investigate the effects, on the users, of automatically filtering question-answering content, using a combination of syntactic, semantic, and social signals. Using this filtering, a large-scale experiment with real users was performed to mea- sure the resulting engagement and satisfaction. To our knowl- edge, this experiment represents the first reported large-scale user study of automatically curating social media content in real time. Our results show that automated quality filtering indeed improves user engagement, usually aligning with, and often outperforming, crowd-based quality judgments. 

  • The 19th ACM conference on Computer-Supported Cooperative Work and Social Computing (CSCW 2016)
  • Conference/Workshop Paper

BibTeX