TY - GEN
T1 - “what i see is what you get” explorations of live artwork generation, artificial intelligence, and human interaction in a pedagogical environment
AU - Herruzo, Ana
AU - Pashenkov, Nikita
N1 - Publisher Copyright:
© ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering 2020.
PY - 2020
Y1 - 2020
N2 - In this paper we review the overall process for the design, development, and deployment of “What I See Is What You Get”, an experiential installation that creates live interactive visuals, by analyzing human facial expressions and behaviors, accompanied by text generated using Machine Learning algorithms trained on the art collection of The J. Paul Getty Museum in Los Angeles. The project is developed by students and faculty in an academic environment and exhibited at the Getty Museum. We also study the pedagogical process implemented to address the curriculum’s learning outcomes in an “applied” environment while designing a contemporary new media art piece. Special attention is paid to the level and quality of the interaction between users and the piece, demonstrating how advances in technology and computing such as Deep Learning and Natural Language Processing can contribute to deeper connections and new layers of interactivity.
AB - In this paper we review the overall process for the design, development, and deployment of “What I See Is What You Get”, an experiential installation that creates live interactive visuals, by analyzing human facial expressions and behaviors, accompanied by text generated using Machine Learning algorithms trained on the art collection of The J. Paul Getty Museum in Los Angeles. The project is developed by students and faculty in an academic environment and exhibited at the Getty Museum. We also study the pedagogical process implemented to address the curriculum’s learning outcomes in an “applied” environment while designing a contemporary new media art piece. Special attention is paid to the level and quality of the interaction between users and the piece, demonstrating how advances in technology and computing such as Deep Learning and Natural Language Processing can contribute to deeper connections and new layers of interactivity.
KW - Applied computing
KW - Artificial intelligence
KW - Creative Technologies
KW - Higher education
KW - Information visualization
KW - Interactive art
KW - Machine learning
KW - New media technologies
KW - Real-time generated graphics
UR - http://www.scopus.com/inward/record.url?scp=85089315214&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85089315214&partnerID=8YFLogxK
U2 - 10.1007/978-3-030-53294-9_23
DO - 10.1007/978-3-030-53294-9_23
M3 - Conference contribution
AN - SCOPUS:85089315214
SN - 9783030532932
T3 - Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST
SP - 343
EP - 359
BT - Interactivity, Game Creation, Design, Learning, and Innovation - 8th EAI International Conference, ArtsIT 2019, and 4th EAI International Conference, DLI 2019, Proceedings
A2 - Brooks, Anthony
A2 - Brooks, Eva Irene
PB - Springer
T2 - 8th EAI International Conference on ArtsIT, Interactivity and Game Creation, ArtsIT 2019, and the 4th EAI International Conference on Design, Learning, and Innovation, DLI 2019
Y2 - 6 November 2019 through 8 November 2019
ER -