TY - JOUR
T1 - "When they say weed causes depression, but it's your fav antidepressant"
T2 - Knowledgeaware attention framework for relationship extraction
AU - Yadav, Shweta
AU - Lokala, Usha
AU - Daniulaityte, Raminta
AU - Thirunarayan, Krishnaprasad
AU - Lamy, Francois
AU - Sheth, Amit
N1 - Publisher Copyright:
© 2021 Yadav et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
PY - 2021/3
Y1 - 2021/3
N2 - With the increasing legalization of medical and recreational use of cannabis, more research is needed to understand the association between depression and consumer behavior related to cannabis consumption. Big social media data has potential to provide deeper insights about these associations to public health analysts. In this interdisciplinary study, we demonstrate the value of incorporating domain-specific knowledge in the learning process to identify the relationships between cannabis use and depression. We develop an end-toend knowledge infused deep learning framework (Gated-K-BERT) that leverages the pretrained BERT language representation model and domain-specific declarative knowledge source (Drug Abuse Ontology) to jointly extract entities and their relationship using gated fusion sharing mechanism. Our model is further tailored to provide more focus to the entities mention in the sentence through entity-position aware attention layer, where ontology is used to locate the target entities position. Experimental results show that inclusion of the knowledge-aware attentive representation in association with BERT can extract the cannabis- depression relationship with better coverage in comparison to the state-of-the-art relation extractor.
AB - With the increasing legalization of medical and recreational use of cannabis, more research is needed to understand the association between depression and consumer behavior related to cannabis consumption. Big social media data has potential to provide deeper insights about these associations to public health analysts. In this interdisciplinary study, we demonstrate the value of incorporating domain-specific knowledge in the learning process to identify the relationships between cannabis use and depression. We develop an end-toend knowledge infused deep learning framework (Gated-K-BERT) that leverages the pretrained BERT language representation model and domain-specific declarative knowledge source (Drug Abuse Ontology) to jointly extract entities and their relationship using gated fusion sharing mechanism. Our model is further tailored to provide more focus to the entities mention in the sentence through entity-position aware attention layer, where ontology is used to locate the target entities position. Experimental results show that inclusion of the knowledge-aware attentive representation in association with BERT can extract the cannabis- depression relationship with better coverage in comparison to the state-of-the-art relation extractor.
UR - http://www.scopus.com/inward/record.url?scp=85103338984&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85103338984&partnerID=8YFLogxK
U2 - 10.1371/journal.pone.0248299
DO - 10.1371/journal.pone.0248299
M3 - Article
C2 - 33764983
AN - SCOPUS:85103338984
SN - 1932-6203
VL - 16
JO - PloS one
JF - PloS one
IS - 3 March
M1 - e0248299
ER -