Multimodal Framework Design, Children’s Multimodal Usage Patterns and the Efficacy of Mutual Disambiguation for Children

Differences Between Conventional GUIs & Multimodal Interfaces

Conventional GUIs

nAssume there is a single event stream that controls event loop with processing being sequential

nAssume interface actions are atomic and unambiguous

nDo not require temporal constraints. Architecture is not time sensitive.

Multimodal Interfaces

nTypically process continuous and simultaneous input from parallel input streams

nProcess input modes using recognition based technology

nRequire time stamping of input and development of temporal constraints on mode fusion operations.