Dialogism Meets Language Models for Evaluating Involvement in CSCL Conversations

Maria Dorinela Dascalu, Stefan Ruseti, Mihai Dascalu, Danielle S. McNamara, Stefan Trausan-Matu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

The use of technology as a facilitator in learning environments has become increasingly prevalent with the global pandemic caused by COVID-19. As such, computer-supported collaborative learning (CSCL) gains a wider adoption in contrast to traditional learning methods. At the same time, the need for automated tools capable of assessing and stimulating collaboration between participants has become more stringent, as human monitoring of the increasing volume of conversations becomes overwhelming. This paper introduces a method grounded in dialogism for evaluating students’ involvement in chat conversations based on semantic chains computed using language models. These semantic chains reflect emergent voices from dialogism that span and interact throughout the conversation. Our integrated method uses contextual information captured by BERT transformer models to identify links in a chain that connects semantically related concepts from a voice uttered by one or more participants. Two types of visualizations were generated to depict the longitudinal propagation and the transversal inter-animation of voices within the conversation. In addition, a list of handcrafted features derived from the constructed chains and computed for each participant is introduced. Several machine learning algorithms were tested using these features to evaluate the extent to which semantic chains are predictive of student involvement in chat conversations.

Original languageEnglish (US)
Title of host publicationLudic, Co-design and Tools Supporting Smart Learning Ecosystems and Smart Education - Proceedings of the 6th International Conference on Smart Learning Ecosystems and Regional Development, SLERD 2021
EditorsÓscar Mealha, Mihai Dascalu, Tania Di Mascio
PublisherSpringer Science and Business Media Deutschland GmbH
Pages67-78
Number of pages12
ISBN (Print)9789811639296
DOIs
StatePublished - 2022
Event6th International Conference on Smart Learning Ecosystems and Regional Development, SLERD 2021 - Virtual, Online
Duration: Jun 24 2021Jun 25 2021

Publication series

NameSmart Innovation, Systems and Technologies
Volume249
ISSN (Print)2190-3018
ISSN (Electronic)2190-3026

Conference

Conference6th International Conference on Smart Learning Ecosystems and Regional Development, SLERD 2021
CityVirtual, Online
Period6/24/216/25/21

Keywords

  • Computer-supported collaborative learning
  • Dialogism
  • Language models
  • Semantic chains

ASJC Scopus subject areas

  • General Decision Sciences
  • General Computer Science

Fingerprint

Dive into the research topics of 'Dialogism Meets Language Models for Evaluating Involvement in CSCL Conversations'. Together they form a unique fingerprint.

Cite this