Exploring Dialogism Using Language Models

Stefan Ruseti, Maria Dorinela Dascalu, Dragos Georgian Corlatescu, Mihai Dascalu, Stefan Trausan-Matu, Danielle S. McNamara

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Dialogism is a philosophical theory centered on the idea that life involves a dialogue among multiple voices in a continuous exchange and interaction. Considering human language, different ideas or points of view take the form of voices, which spread throughout any discourse and influence it. From a computational point of view, voices can be operationlized as semantic chains that contain related words. This study introduces and evaluates a novel method of identifying semantic chains using BERT, a state-of-the-art language model for computational linguistics. The resulting model generalizes to multiple relations including repetitions, semantically related concepts from WordNet (i.e., synonyms, hypernyms, hyponyms, and siblings), as well as pronominal resolutions. By combining the attention scores between words, word pairs are merged into connected components that denote emerging voices from the discourse. The introduced visualization argues for a more dense capturing of inner semantic links between words and even compound words in contrast to classical methods of building lexical chains.

Original languageEnglish (US)
Title of host publicationArtificial Intelligence in Education - 22nd International Conference, AIED 2021, Proceedings
EditorsIdo Roll, Danielle McNamara, Sergey Sosnovsky, Rose Luckin, Vania Dimitrova
PublisherSpringer Science and Business Media Deutschland GmbH
Number of pages6
ISBN (Print)9783030782696
StatePublished - 2021
Event22nd International Conference on Artificial Intelligence in Education, AIED 2021 - Virtual, Online
Duration: Jun 14 2021Jun 18 2021

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12749 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference22nd International Conference on Artificial Intelligence in Education, AIED 2021
CityVirtual, Online


  • Dialogism
  • Language models
  • Semantic chains

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science


Dive into the research topics of 'Exploring Dialogism Using Language Models'. Together they form a unique fingerprint.

Cite this