Multimodal Framework Design, Children’s Multimodal Usage Patterns and the Efficacy of Mutual Disambiguation for Children

Unification-based Multimodal Integration Agent

nUnification is an operation that takes multiple inputs and combines them into a single interpretation

nFramework will utilize semantic unification to produce an N-best list consisting of plausible unimodal and multimodal interpretations

nTo be implemented partially based on QuickSet multimodal unification methodology:

qDescribed by Cohen and Johnston

qBased on a typed feature structure (FS) consistently designed across unimodal and multimodal input modes.