Contextual user interface
Embodiments of the present invention analyze a context in which a user interacts with a computer interface and automatically optimizes the interface for the context. The controller or control mode the user selects for interaction may define the context, in part. Examples of control modes include gesturing, audio control, use of companion devices, and use of dedicated control devices, such as game controllers and remote controls. The different input devices are designed for different tasks. Nevertheless, a user will frequently attempt to perform a task using a control input that is not adapted for the task. Embodiments of the present invention change the characteristics of the user interface to make it easier for the user to complete an intended task using the input device of the user's choice.
1. One or more computer-storage media having computer executable instructions embodied thereon, which when executed by a computing device, causes the computing device to perform a method of presenting an interface that is optimized for a present context, the method comprising:
determining a present context by analyzing actions of a person comprising holding a game object;
generating a user interface of a video game application associated with the game object that is optimized for the present context, wherein input for the user interface is received using the game object;
upon receiving a hand gesture, identifying a new context; and
in response to identifying the new context, automatically adapting the user interface for gesture input.
2. The media of claim 1 , wherein the actions are determined by analyzing image data of the person.
3. The media of claim 1 , wherein the method further comprises automatically re-optimizing the user interface upon determining a new context for the interface.
4. The media of claim 1 , wherein the actions comprise use of a left hand to hold the game object and the user interface is optimized for use with left handed input.
5. The media of claim 1 , wherein the game object is a tennis racquet and the video game is a tennis game.
6. The media of claim 1 , wherein the game object is a piece of clothing worn by the person.
7. The media of claim 1 , wherein automatically adapting the user interface comprises increasing a size of a control input for gesture interaction.
8. The media of claim 1 , wherein automatically adapting the user interface comprises generating a new interface that is different than the generated user interface of the video game application.
9. A method of presenting an interface that is optimized for a present context, the method comprising:
determining a present context by analyzing actions of a person comprising holding a game object;
generating a user interface of a video game application associated with the game object that is optimized for the present context, wherein input for the user interface is received using the game object;
upon receiving an action comprising a hand gesture, identifying a context different from the present context; and
in response to identifying the new context, automatically adapting the user interface for gesture input.
10. The method of claim 9 , wherein the actions are determined by analyzing image data of the person.
11. The method of claim 9 , wherein the method further comprises automatically re-optimizing the user interface upon determining a new context for the interface.
12. The method of claim 9 , wherein the actions comprise use of a left hand to hold the game object and the user interface is optimized for use with left handed input.
13. The method of claim 9 , wherein the game object is a tennis racquet and the video game is a tennis game.
14. The method of claim 9 , wherein the game object is a piece of clothing worn by the person.
15. The method of claim 10 , wherein the method further comprises:
determining another new context for the user interface by analyzing image data depicting an environment of the person and signal data received from a companion device indicating the companion device is wirelessly connected to the computing system, the image data indicating that the user has picked up the companion device; and
automatically optimizing the user interface for the another new context by changing the user interface to enable control by the companion device.
16. A computing system comprising:
a processor; and
computer storage memory having computer-executable instructions stored thereon which, when executed by the processor, implement a method of presenting an interface that is optimized for a present context, the method comprising:
determining a present context by analyzing actions of a person comprising holding a game object;
generating a user interface of a video game application associated with the game object that is optimized for the present context, wherein input for the user interface is received using the game object;
determining a new context for the video game application based on identifying a hand gesture; and
in response to determining the new context, automatically changing the user interface for gesture input.
17. The system of claim 16 , wherein the method further comprises:
determining another new context for the user interface by analyzing image data depicting an environment of the person and signal data received from a companion device indicating the companion device is wirelessly connected to the computing system, the image data indicating that the user has picked up the companion device; and
automatically optimizing the user interface for the another new context by changing the user interface to enable control by the companion device.
18. The system of claim 17 , wherein the new context is disambiguated from multiple possible contexts using previous user interactions with the user interface.
19. The system of claim 17 , wherein determining the present context comprises determining a control mode utilized by a user to interact with the user interface.
20. The system of claim 16 , wherein the actions comprise use of a left hand to hold the game object and the user interface is optimized for use with left handed input.