Multimodal Framework Design, Children’s Multimodal Usage Patterns and the Efficacy of Mutual Disambiguation for Children

Multimodal Interfaces for Children Study Overview

nParticipants aged 7 to 10 asked to interact with a science education application called Immersive Science Education for Elementary Kids (I SEE!).

nI SEE! teaches about marine biology through animated marine animals

nInput involved asking marine animals questions formulated using speech, pen, or both.

nSpeech input recognition was initiated by a pen tap or writing.