TY - JOUR
T1 - Discovering, assessing, and mitigating data bias in social media
AU - Morstatter, Fred
AU - Liu, Huan
N1 - Funding Information:
This work is sponsored, in part, by Office of Naval Research (ONR) grant N000141410095 and by the Department of Defense under the MINERVA initiative through the ONR N00014131083 .
Publisher Copyright:
© 2017 Elsevier B.V.
PY - 2017/6
Y1 - 2017/6
N2 - Social media has generated a wealth of data. Billions of people tweet, sharing, post, and discuss everyday. Due to this increased activity, social media platforms provide new opportunities for research about human behavior, information diffusion, and influence propagation at a scale that is otherwise impossible. Social media data is a new treasure trove for data mining and predictive analytics. Since social media data differs from conventional data, it is imperative to study its unique characteristics. This work investigates data collection bias associated with social media. In particular, we propose computational methods to assess if there is bias due to the way a social media site makes its data available, to detect bias from data samples without access to the full data, and to mitigate bias by designing data collection strategies that maximize coverage to minimize bias. We also present a new kind of data bias stemming from API attacks with both algorithms, data, and validation results. This work demonstrates how some characteristics of social media data can be extensively studied and verified and how corresponding intervention mechanisms can be designed to overcome negative effects. The methods and findings of this work could be helpful in studying different characteristics of social media data.
AB - Social media has generated a wealth of data. Billions of people tweet, sharing, post, and discuss everyday. Due to this increased activity, social media platforms provide new opportunities for research about human behavior, information diffusion, and influence propagation at a scale that is otherwise impossible. Social media data is a new treasure trove for data mining and predictive analytics. Since social media data differs from conventional data, it is imperative to study its unique characteristics. This work investigates data collection bias associated with social media. In particular, we propose computational methods to assess if there is bias due to the way a social media site makes its data available, to detect bias from data samples without access to the full data, and to mitigate bias by designing data collection strategies that maximize coverage to minimize bias. We also present a new kind of data bias stemming from API attacks with both algorithms, data, and validation results. This work demonstrates how some characteristics of social media data can be extensively studied and verified and how corresponding intervention mechanisms can be designed to overcome negative effects. The methods and findings of this work could be helpful in studying different characteristics of social media data.
KW - Data collection
KW - Data collection bias
KW - Data mining
KW - Machine learning
KW - Social data bias
KW - Social media mining
KW - Twitter
UR - http://www.scopus.com/inward/record.url?scp=85050187929&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85050187929&partnerID=8YFLogxK
U2 - 10.1016/j.osnem.2017.01.001
DO - 10.1016/j.osnem.2017.01.001
M3 - Article
AN - SCOPUS:85050187929
SN - 2468-6964
VL - 1
SP - 1
EP - 13
JO - Online Social Networks and Media
JF - Online Social Networks and Media
ER -