The Integation Of Speech Recognition Technique In Role-Playing Computer Game For Down Syndrome Children Mandrin Learning

• Main Author: Lim, Chin Chuan
• Format: Thesis
• Language: English; English
• Published: 2017
• Subjects: T Technology (General); TK Electrical engineering. Electronics Nuclear engineering
• Online Access: http://eprints.utem.edu.my/id/eprint/20756/; http://libraryopac.utem.edu.my/webopac20/Record/0000106633

Down syndrome individuals are known to have difficulties in speech, both pronunciation of words and making sentences. Such problem is caused by the innate physical impairment of their mouth muscles, as well as the cognitive and intelligence impairment. The myths about bilingualism in down syndrome children causing adverse effects on their language development have been debunked, showing that learning more than one language is possible for them without negative consequences. Many applications and courseware have been designed for down syndrome individuals to enhance their language learning experience. Such applications and courseware usually targeting words recognition and reading therapy, but the syntax and expressive language training are rarely focused. In this research, a 2-Dimensional role-playing game is integrated with state-of-the-art speech recognition technology to provide assistive training on Mandarin syntax and short sentences uttering for down syndrome children. The cognitive capabilities of down syndrome children are considered, and the multimedia application design standards for special education are followed. The research outcome is a game designed according to the Waterfall system development life cycle, while the educational contents are planned with hybrid ASSURE and Gerlach-Ely Instructional design model. The resultant game prototype is tested by five typically developing children age between five years old to six years old, and five adults. The results show that majority of the participant shown positive emotion playing the game, which implies that using RPG for speech practices is feasible. Since only the mildly impaired down syndrome children are able to read and speak, this research is intended to cater for the children under this category. Similar emotion trends are expected from the down syndrome children, which means that they would be motivated to speak with better grammar and remember to use the grammar correctly in their daily lives, as the RPG provides visual context for the sentences they speak.