TY - JOUR
T1 - The relationship between collaborative problem solving behaviors and solution outcomes in a game-based learning environment
AU - Sun, Chen
AU - Shute, Valerie J.
AU - Stewart, Angela E.B.
AU - Beck-White, Quinton
AU - Reinhardt, Caroline R.
AU - Zhou, Guojing
AU - Duran, Nicholas
AU - D'Mello, Sidney K.
N1 - Publisher Copyright:
© 2021 Elsevier Ltd
PY - 2022/3
Y1 - 2022/3
N2 - Collaborative problem solving (CPS) is an essential skill for the 21st century workforce but remains difficult to assess. Understanding how CPS skills affect CPS performance outcomes can inform CPS training, task design, feedback design, and automated assessment. We investigated CPS behaviors (individually and in co-occurring patterns) in 101 (N = 303) remote triads who collaboratively played an educational game called Physics Playground for 45-min. Team interactions consisted of open-ended speech occurring over videoconferencing with screen sharing. We coded participant's utterances relative to a CPS framework consisting of three facets (i.e., competencies such as constructing shared knowledge) manifested in 19 specific indicators (e.g., responds to others' questions/ideas). A matching technique was used to isolate the effect of CPS behaviors on CPS outcomes (quality of solution of a game level) controlling for pertinent covariates. Mixed-effects ordinal regression models indicated that proposing solution ideas and discussing results were the major predictors of CPS performance, and that team-member activities surrounding idea generation mattered. These findings highlighted the importance of both individual and collective contributions and social and cognitive skills in successful CPS outcomes.
AB - Collaborative problem solving (CPS) is an essential skill for the 21st century workforce but remains difficult to assess. Understanding how CPS skills affect CPS performance outcomes can inform CPS training, task design, feedback design, and automated assessment. We investigated CPS behaviors (individually and in co-occurring patterns) in 101 (N = 303) remote triads who collaboratively played an educational game called Physics Playground for 45-min. Team interactions consisted of open-ended speech occurring over videoconferencing with screen sharing. We coded participant's utterances relative to a CPS framework consisting of three facets (i.e., competencies such as constructing shared knowledge) manifested in 19 specific indicators (e.g., responds to others' questions/ideas). A matching technique was used to isolate the effect of CPS behaviors on CPS outcomes (quality of solution of a game level) controlling for pertinent covariates. Mixed-effects ordinal regression models indicated that proposing solution ideas and discussing results were the major predictors of CPS performance, and that team-member activities surrounding idea generation mattered. These findings highlighted the importance of both individual and collective contributions and social and cognitive skills in successful CPS outcomes.
KW - Collaborative problem solving
KW - Game-based learning
KW - Human-human interaction
KW - Triads
UR - http://www.scopus.com/inward/record.url?scp=85120400059&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85120400059&partnerID=8YFLogxK
U2 - 10.1016/j.chb.2021.107120
DO - 10.1016/j.chb.2021.107120
M3 - Article
AN - SCOPUS:85120400059
SN - 0747-5632
VL - 128
JO - Computers in Human Behavior
JF - Computers in Human Behavior
M1 - 107120
ER -