TY - GEN
T1 - The design of a real-time, multimodal biofeedback system for stroke patient rehabilitation
AU - Chen, Yinpeng
AU - Huang, He
AU - Xu, Weiwei
AU - Wallis, Richard Isaac
AU - Sundaram, Hari
AU - Rikakis, Thanassis
AU - Ingalls, Todd
AU - Olson, Loren
AU - He, Jiping
PY - 2006
Y1 - 2006
N2 - This paper presents a novel real-time, multi-modal biofeedback system for stroke patient therapy. The problem is important as traditional mechanisms of rehabilitation are monotonous, and do not incorporate detailed quantitative assessment of recovery in addition to traditional clinical schemes. We have been working on developing an experiential media system that integrates task dependent physical therapy and cognitive stimuli within an interactive, multimodal environment. The environment provides a purposeful, engaging, visual and auditory scene in which patients can practice functional therapeutic reaching tasks, while receiving different types of simultaneous feedback indicating measures of both performance and results. There are three contributions of this paper - (a) identification of features and goals for the functional task (b) The development of sophisticated feedback (auditory and visual) mechanisms that match the semantics of action of the task. We additionally develop novel action-feedback coupling mechanisms. (c) New metrics to validate the ability of the system to promote learnability, stylization and engagement. We have validated the system for nine subjects with excellent results.
AB - This paper presents a novel real-time, multi-modal biofeedback system for stroke patient therapy. The problem is important as traditional mechanisms of rehabilitation are monotonous, and do not incorporate detailed quantitative assessment of recovery in addition to traditional clinical schemes. We have been working on developing an experiential media system that integrates task dependent physical therapy and cognitive stimuli within an interactive, multimodal environment. The environment provides a purposeful, engaging, visual and auditory scene in which patients can practice functional therapeutic reaching tasks, while receiving different types of simultaneous feedback indicating measures of both performance and results. There are three contributions of this paper - (a) identification of features and goals for the functional task (b) The development of sophisticated feedback (auditory and visual) mechanisms that match the semantics of action of the task. We additionally develop novel action-feedback coupling mechanisms. (c) New metrics to validate the ability of the system to promote learnability, stylization and engagement. We have validated the system for nine subjects with excellent results.
KW - Action-feedback coupling
KW - Analysis
KW - Biofeedback
KW - Validation
UR - http://www.scopus.com/inward/record.url?scp=34547168865&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=34547168865&partnerID=8YFLogxK
U2 - 10.1145/1180639.1180804
DO - 10.1145/1180639.1180804
M3 - Conference contribution
AN - SCOPUS:34547168865
SN - 1595934472
SN - 9781595934475
T3 - Proceedings of the 14th Annual ACM International Conference on Multimedia, MM 2006
SP - 763
EP - 772
BT - Proceedings of the 14th Annual ACM International Conference on Multimedia, MM 2006
T2 - 14th Annual ACM International Conference on Multimedia, MM 2006
Y2 - 23 October 2006 through 27 October 2006
ER -