Multimodal Framework Design, Children’s Multimodal Usage Patterns and the Efficacy of Mutual Disambiguation for Children

Multimodal Integration Agent Summary

nConsistent semantic level feature structures passed to multimodal integration agent from speech and gesture recognition components. nIf multiple input interpretations are plausible an N-best list is produced. nSelection of final interpretation from N-best list is based on default priorities or customized priorities specified by the framework API user. nThis customization ability allows for testing various prioritization settings.