Multimodal Framework Design, Children’s Multimodal Usage Patterns and the Efficacy of Mutual Disambiguation for Children

Speech and Gesture Framework API: Goals

nProvide unimodal gesture and speech recognition as well as multimodal combined speech and gesture recognition support for:

qNavigating, creating, and populating 3D environments

qControlling and directing inhabitants or avatars in such environments

nWeb based support for applications using unimodal and multimodal speech and gesture recognition

nAutomated statistics gathering tools for both unimodal and multimodal speech and gesture usage as well as multimodal disambiguation statistics