TY - GEN
T1 - Effect of Image Captioning with Description on the Working Memory
AU - Uppara, Nithiya Shree
AU - McDaniel, Troy
AU - Venkateswara, Hemanth
N1 - Publisher Copyright:
© 2021, Springer Nature Switzerland AG.
PY - 2021
Y1 - 2021
N2 - Working memory plays an important role in human activities across academic, professional, and social settings. Working memory is defined as the memory extensively involved in goal-directed behaviors in which information must be retained and manipulated to ensure successful task execution. The aim of this research is to understand the effect of image captioning with image description on an individual’s working memory. A study was conducted with eight neutral images comprising situations relatable to daily life such that each image could have a positive or negative description associated with the outcome of the situation in the image. The study consisted of three rounds where the first and second round involved two parts and the third round consisted of one part. The image was captioned a total of five times across the entire study. The findings highlighted that only 25% of participants were able to recall the captions which they captioned for an image after a span of 9–15 days; when comparing the recall rate of the captions, 50% of participants were able to recall the image caption from the previous round in the present round; and out of the positive and negative description associated with the image, 65% of participants recalled the former description rather than the latter.
AB - Working memory plays an important role in human activities across academic, professional, and social settings. Working memory is defined as the memory extensively involved in goal-directed behaviors in which information must be retained and manipulated to ensure successful task execution. The aim of this research is to understand the effect of image captioning with image description on an individual’s working memory. A study was conducted with eight neutral images comprising situations relatable to daily life such that each image could have a positive or negative description associated with the outcome of the situation in the image. The study consisted of three rounds where the first and second round involved two parts and the third round consisted of one part. The image was captioned a total of five times across the entire study. The findings highlighted that only 25% of participants were able to recall the captions which they captioned for an image after a span of 9–15 days; when comparing the recall rate of the captions, 50% of participants were able to recall the image caption from the previous round in the present round; and out of the positive and negative description associated with the image, 65% of participants recalled the former description rather than the latter.
KW - Image captioning
KW - Sentiment analysis
KW - Working memory
UR - http://www.scopus.com/inward/record.url?scp=85119867304&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85119867304&partnerID=8YFLogxK
U2 - 10.1007/978-3-030-90328-2_7
DO - 10.1007/978-3-030-90328-2_7
M3 - Conference contribution
AN - SCOPUS:85119867304
SN - 9783030903275
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 107
EP - 120
BT - HCI International 2021 - Late Breaking Papers
A2 - Stephanidis, Constantine
A2 - Harris, Don
A2 - Li, Wen-Chin
A2 - Schmorrow, Dylan D.
A2 - Fidopiastis, Cali M.
A2 - Antona, Margherita
A2 - Gao, Qin
A2 - Zhou, Jia
A2 - Zaphiris, Panayiotis
A2 - Ioannou, Andri
A2 - Ioannou, Andri
A2 - Sottilare, Robert A.
A2 - Schwarz, Jessica
A2 - Rauterberg, Matthias
PB - Springer Science and Business Media Deutschland GmbH
T2 - 23rd International Conference on Human-Computer Interaction, HCII 2021
Y2 - 24 July 2021 through 29 July 2021
ER -