Interactivity with a mixed reality
Methods of interacting with a mixed reality are presented. A mobile device captures an image of a real-world object where the image has content information that can be used to control a mixed reality object through an offered command set. The mixed reality object can be real, virtual, or a mixture of both real and virtual.
1. A method of interacting with a mixed reality, comprising:
providing a mobile phone device having a physical handheld display;
using the mobile device to electronically capture image data of at least a portion of a multi-part real-world object;
using the image data to identify an attribute associated with the real-world object;
using the attribute to interact with software being operated at least in part remote to the mobile device to obtain a first command set for a first part of the real-world object and a second, different command set for a second part of the real-world object from a distal database storing a plurality command sets for multiple, mixed reality objects, where the command sets comprise network API addresses corresponding to commands that control the first and the second parts, respectively;
offering the first and the second command set to the mobile phone device;
combining at least one virtual interface comprising the commands sets with the image data of the real-world object to form mixed reality representations of the first and the second parts;
displaying the at least one virtual interface on the handheld display to allow a user to select a command from one of the command sets; and
executing the command by issuing call over a network from the mobile device to a corresponding network API address of the command drawn from the network API addresses.
2. The method of claim 1 , wherein the real-world object is an appliance.
3. The method of claim 1 , wherein the first part is physically distinct from the second part.
4. The method of claim 1 , wherein the first part is a component of a consumer electronic appliance.
5. The method of claim 1 , wherein the first part is an element of an electronic game.
6. The method of claim 5 , wherein the attribute indicates the real-world object is a goal object of the game.
7. The method of claim 1 , wherein, the real-world object is a kitchen appliance.
8. The method of claim 5 , wherein the attribute indicates the real-world object has a value in the game.
9. The method of claim 1 , wherein the attribute comprises at least one of the following a name, a class, and an environmental characteristic.
10. The method of claim 1 , wherein the command is one of an “on” command and an “off” command.
11. The method of claim 1 , wherein the selecting of the command results in changing a channel.
12. The method of claim 1 , wherein the selecting of the command results in playing music.
13. The method of claim 1 , wherein the command inputs data associated with a virtual weapon.
14. The method of claim 1 , wherein the command inputs data associated with virtual travel.
15. The method of claim 1 , wherein the image data comprises a still image.
16. The method of claim 1 , wherein the image data comprises a video image.
17. The method of claim 1 , further comprising using an additional sensor associated with the mobile device to interact with the software.
18. The method of claim 17 , wherein the sensor provides information associated with a physical location.
19. The method of claim 17 , wherein the sensor provides information associated with at least one of an orientation and an acceleration of the mobile device.