Initiating human-machine interaction based on visual attention
A device for interacting with a user is presented. The device includes a target area, a sensor coupled to the target area, wherein the sensor detects whether a human is present in a predefined proximity region and detects a direction of visual attention given by the human in the predefined proximity region, a processor coupled to the sensor and making a determination that the user's visual attention is in a direction of the target area for a minimum visual contact period, and an input engine that is activated based on the determination.
1. A device for interacting with a user, comprising:
a head connected to a body, the head comprising a shell and a target area formed as part of an outer surface of the shell, the target area comprising a display device, the head being configured to rotate about an axis with the body remaining in position;
a sensor formed in the shell of the head and being coupled to the target area, wherein the sensor detects whether a human is present in a predefined proximity region around the target area and in response to the detecting that a human is present in the predefined proximity region around the target area, detects a direction of visual attention on the target area given by the human in the predefined proximity region;
a processor coupled to the sensor and making a determination that the user's visual attention is in a direction of the target area for a minimum visual contact period, wherein the processor is configured to determine the user's position in the predefined proximity region and rotate the head so that the target area is in a predefined orientation with respect to the user, and wherein the processor is configured to determine the user's visual attention is in the direction of the target area by locating the user's eye and determining, based on movement of the eye, that the user is looking at the target area of the device for the minimum visual contact period; and
an input engine that is activated based on the determination, wherein based on the determination, an image is shown by the display device on the target area to indicate the input engine is activated.
2. The device of claim 1 further comprising a microphone, wherein the input engine is a voice input engine that listens for a voice command from the user upon activation.
3. The device of claim 1 , wherein the sensor comprises a camera.
4. The device of claim 1 , wherein the sensor is positioned behind the target area.
5. The device of claim 1 further comprising another sensor positioned in a different part of the device.
6. The device of claim 1 further comprising an output mechanism for signaling to the user that the input engine is activated.
7. The device of claim 6 , wherein the output mechanism comprises at least one of a speaker, a movable hardware part, and the display device.
8. The device of claim 1 further comprising a motor driver coupled to the processor to move hardware parts, wherein the motor driver and the processor are enclosed in the shell.
9. A method of transitioning an input engine between sleep mode and interactive mode, comprising:
detecting a user is present in a predefined proximity region of a target area on a device, the device comprising a head connected to a body and the head comprising a shell, the target area being formed as part of an outer surface of the shell and comprising a display device, the head being configured to rotate about an axis with the body remaining in position;
determining the user's position in the predefined proximity region and rotating the target area to be in a predefined orientation with respect to the user;
in response to the detecting that the user is present in the predefined proximity region of the target area, identifying a user eye of the user present in the predefined proximity region of the target area;
determining a direction of user's visual attention based on movement of the eye to determine that the user is looking at the target area of the device;
activating the input engine to receive input in response to determining the visual attention is on the target area in a predefined direction for a minimum visual contact period; and
in response to the activating, providing an image displayed by the display device on the target area to indicate the input engine is activated.
10. The method of claim 9 further comprising generating a signal that the input engine is in interactive mode upon transitioning from the sleep mode to the interactive mode.
11. The method of claim 10 , wherein the signal is one or more of an audio signal, a visual display, and a hardware movement.
12. The method of claim 9 further comprising de-activating the input engine in response to receiving no input for a predetermined time duration.
13. The method of claim 9 further comprising de-activating the input engine in response to determining that the user is more than a predefined distance away from the target area.
14. The method of claim 9 further comprising de-activating the input engine in response to receiving a trigger word.