DATA MANIPULATION BASED ON REAL WORLD OBJECT MANIPULATION
A system and method for data manipulation based on real world object manipulation is described. A device captures an image of a physical object. The image is communicated via a network to a remote server. The remote server includes virtual object data associated with the image and a communication notification for a user of the computing device. The device receives the virtual object data and displays the virtual image in a virtual landscape using the virtual object data. In response to relative movement between the computing device and the physical object caused by the user, the virtual image is modified.
1 . A method comprising:
assigning, by a computing device, a first virtual function to a first physical manipulation of an inanimate physical object, the first virtual function being a first adjustment to configuration settings of an electronic device, and the first physical manipulation of the inanimate physical object being a first caused change in physical orientation of the inanimate physical object;
detecting, based on images of the inanimate physical object captured by the computing device, an occurrence of the first physical manipulation of the inanimate physical object;
in response to detecting the first physical manipulation of the inanimate physical object, generating a command to perform the first virtual function assigned to the first physical manipulation; and
transmitting the command to perform the first virtual function to the electronic device, the command to perform the first virtual function causing the electronic device to perform the first adjustment to configuration settings of the electronic device.
2 . The method of claim 1 , further comprising:
assigning a second virtual function to a second physical manipulation of the inanimate physical object, the second virtual function being a second adjustment to configuration settings of the electronic device, the second adjustment being different than the first adjustment, and the second physical manipulation of the inanimate physical object being a second caused change in physical orientation of the inanimate physical object, the second caused change being different that the first caused change;
detecting, based on image data captured of the inanimate physical object, an occurrence of the second physical manipulation of the inanimate physical object;
in response to detecting the second physical manipulation of the inanimate physical object, generating a command to perform the second virtual function assigned to the second physical manipulation; and
transmitting, the command to perform the second virtual function to the electronic device, the command to perform the second virtual function causing the electronic device to perform the second adjustment to configuration settings of the electronic device.
3 . The method of claim 2 , wherein the electronic device is electronically unconnected to the inanimate physical object.
4 . The method of claim 1 , wherein detecting the occurrence of the first physical manipulation of the inanimate physical object comprises:
capturing, using an optical sensor of the computing device, a first image of the inanimate physical object, the inanimate physical object being oriented in a first position in the first image;
capturing, using the optical sensor of the computing device, a second image of the inanimate physical object, the second image being captured after the first image, the inanimate physical object being oriented in a second position in the second image; and
determining, based on the first position and the second position, that the first caused change in physical orientation of the inanimate physical object occurred.
5 . The method of claim 1 , further comprising:
capturing, using an optical sensor of the computing device, an image of the inanimate physical object;
comparing the image to a reference image of a known inanimate physical object;
determining that the inanimate physical object depicted in the image matches the known inanimate physical object depicted in the reference image; and
determining that the inanimate physical object depicted in the image is the known inanimate physical object.
6 . The method of claim 5 , further comprising:
identifying virtual content corresponding to the known inanimate physical object; and
presenting the virtual content on a display of the computing device.
7 . The method of claim 6 , wherein the virtual content is presented at a position on the display of the computing device that overlaps with an image of the inanimate physical object that is concurrently displayed on the display.
8 . A computing device comprising:
one or more computer processors; and
one or more computer-readable mediums storing instructions that, when executed by the one or more computer processors, cause the computing device to perform operations comprising:
assigning a first virtual function to a first physical manipulation of an inanimate physical object, the first virtual function being a first adjustment to configuration settings of an electronic device, and the first physical manipulation of the inanimate physical object being a first caused change in physical orientation of the inanimate physical object;
detecting, based on images of the inanimate physical object captured by the computing device, an occurrence of the first physical manipulation of the inanimate physical object;
in response to detecting the first physical manipulation of the inanimate physical object, generating a command to perform the first virtual function assigned to the first physical manipulation; and
transmitting the command to perform the first virtual function to the electronic device, the command to perform the first virtual function causing the electronic device to perform the first adjustment to configuration settings of the electronic device.
9 . The computing device of claim 8 , the operations further comprising:
assigning a second virtual function to a second physical manipulation of the inanimate physical object, the second virtual function being a second adjustment to configuration settings of the electronic device, the second adjustment being different than the first adjustment, and the second physical manipulation of the inanimate physical object being a second caused change in physical orientation of the inanimate physical object, the second caused change being different that the first caused change;
detecting, based on image data captured of the inanimate physical object, an occurrence of the second physical manipulation of the inanimate physical object;
in response to detecting the second physical manipulation of the inanimate physical object, generating a command to perform the second virtual function assigned to the second physical manipulation; and
transmitting, the command to perform the second virtual function to the electronic device, the command to perform the second virtual function causing the electronic device to perform the second adjustment to configuration settings of the electronic device.
10 . The computing device of claim 9 , wherein the electronic device is electrically unconnected to the inanimate physical object.
11 . The computing device of claim 8 , wherein detecting the occurrence of the first physical manipulation of the inanimate physical object comprises:
capturing, using an optical sensor of the computing device, a first image of the inanimate physical object, the inanimate physical object being oriented in a first position in the first image;
capturing, using the optical sensor of the computing device, a second image of the inanimate physical object, the second image being captured after the first image, the inanimate physical object being oriented in a second position in the second image; and
determining, based on the first position and the second position, that the first caused change in physical orientation of the inanimate physical object occurred.
12 . The computing device of claim 8 , the operations further comprising:
capturing, using an optical sensor of the computing device, an image of the inanimate physical object;
comparing the image to a reference image of a known inanimate physical object;
determining that the inanimate physical object depicted in the image matches the known inanimate physical object depicted in the reference image; and
determining that the inanimate physical object depicted in the image is the known inanimate physical object.
13 . The computing device of claim 12 , the operations further comprising:
identifying virtual content corresponding to the known inanimate physical object; and
presenting the virtual content on a display of the computing device.
14 . The computing device of claim 13 , wherein the virtual content is presented at a position on the display of the computing device that overlaps with an image of the inanimate physical object that is concurrently displayed on the display.
15 . A non-transitory computer-readable medium storing instructions that, when executed by one or more computer processors of a computing device, cause the computing device to perform operations comprising:
assigning a first virtual function to a first physical manipulation of an inanimate physical object, the first virtual function being a first adjustment to configuration settings of an electronic device, and the first physical manipulation of the inanimate physical object being a first caused change in physical orientation of the inanimate physical object;
detecting, based on images of the inanimate physical object captured by the computing device, an occurrence of the first physical manipulation of the inanimate physical object;
in response to detecting the first physical manipulation of the inanimate physical object, generating a command to perform the first virtual function assigned to the first physical manipulation; and
transmitting the command to perform the first virtual function to the electronic device, the command to perform the first virtual function causing the electronic device to perform the first adjustment to configuration settings of the electronic device.
16 . The non-transitory computer-readable medium of claim 15 , the operations further comprising:
assigning a second virtual function to a second physical manipulation of the inanimate physical object, the second virtual function being a second adjustment to configuration settings of the electronic device, the second adjustment being different than the first adjustment, and the second physical manipulation of the inanimate physical object being a second caused change in physical orientation of the inanimate physical object, the second caused change being different that the first caused change;
detecting, based on image data captured of the inanimate physical object, an occurrence of the second physical manipulation of the inanimate physical object;
in response to detecting the second physical manipulation of the inanimate physical object, generating a command to perform the second virtual function assigned to the second physical manipulation; and
transmitting, the command to perform the second virtual function to the electronic device, the command to perform the second virtual function causing the electronic device to perform the second adjustment to configuration settings of the electronic device.
17 . The non-transitory computer-readable medium of claim 16 , wherein the electronic device is electrically unconnected to the inanimate physical object.
18 . The non-transitory computer-readable medium of claim 15 , wherein detecting the occurrence of the first physical manipulation of the inanimate physical object comprises:
capturing, using an optical sensor of the computing device, a first image of the inanimate physical object, the inanimate physical object being oriented in a first position in the first image;
capturing, using the optical sensor of the computing device, a second image of the inanimate physical object, the second image being captured after the first image, the inanimate physical object being oriented in a second position in the second image; and
determining, based on the first position and the second position, that the first caused change in physical orientation of the inanimate physical object occurred.
19 . The non-transitory computer-readable medium of claim 15 , the operations further comprising:
capturing, using an optical sensor of the computing device, an image of the inanimate physical object;
comparing the image to a reference image of a known inanimate physical object;
determining that the inanimate physical object depicted in the image matches the known inanimate physical object depicted in the reference image; and
determining that the inanimate physical object depicted in the image is the known physical object.
20 . The non-transitory computer-readable medium of claim 19 , the operations further comprising:
identifying virtual content corresponding to the known inanimate physical object; and
presenting the virtual content on a display of the computing device, the virtual content presented at a position on the display of the computing device that overlaps with an image of the inanimate physical object that is concurrently displayed on the display.