RAPUNSEL Interface Use Case Scenario
nC: “Make green ball” Makes circular symbol gesture at location somewhere in 3D world scene.
(new ball appears at the gestured to location)
nC: “No! Make it red.”
n (same ball turns red)
nC: “Make a river like this.” Draws rivers path along the ground. n (a river following that path appears between child’s character and the ball) nC: “Walk to it.” No gesture.
‘it’ is assumed to be the river based on discourse model.
(character walks to river)
nC: “No! Walk to the [unintelligible word].” Points at the ball. Mutual disambiguation used to establish unintelligible word was ‘ball’
(Character shakes head as it cannot cross the river) nC: “Can you cross this?” Points to character and then gestures along river’s path. n   (Character speech balloon appears stating a bridge is required to cross the river) nC: “Create a bridge in front of Wobble.” No Gesture. Wobble is the character’s name.
(A bridge appears in front of Wobble)