Multimodal Framework Design, Children’s Multimodal Usage Patterns and the Efficacy of Mutual Disambiguation for Children

Multimodal Interface Terminology

nSemantic-level Fusion – method of integrating semantic information derived from parallel input modes in a multimodal architecture.

nFrame-based Integration – pattern matching technique used for merging attribute value data structures in order to fuse semantic information from two input modes into a common meaning.

nUnification-based integration – a logic based method used for integrating partial meaning fragments from two input modes into a common meaning.

nWindows-Icon-Mouse-Pointer (WIMP) Interfaces – refers to conventional OS and application interfaces based upon the window and icon metaphor GUI using the mouse as a pointing device.