Multimodal Framework Design, Children’s Multimodal Usage Patterns and the Efficacy of Mutual Disambiguation for Children

RAPUNSEL Multimodal Support

nnavigating and directing child’s character, e.g. “Walk to this.” while pointing to an object to be walked to, or “Pick the ball up.” while pointing to a particular ball;

ncreating objects, e.g. “Create a green ball here.” while pointing to a location;

nchanging objects, e.g. “Make this bridge wider.”, while dragging along the width of the bridge;

nmoving objects, e.g. “Move this from here to here” as child first points to object then points to the new desired location; and

nasking questions, e.g. “What is this?” said whilst pointing to an unknown object.