DIGITIZED INTERACTIONS WITH AN IDENTIFIED OBJECT
Techniques of providing digitized interactions with identified objects are disclosed. In some embodiments, sensor data of an object can be received. The sensor data may have been captured by a computing device of a user. A category of the object can be identified based on at least one characteristic of the object from the sensor data. A characterizing feature of the category of the object can be determined. Virtual content can be generated based on the characterizing feature. The virtual content can be caused to be displayed concurrently with a view of the object on a display screen of the computing device.
1 . A computer-implemented method comprising:
receiving sensor data of an object, the sensor data having been captured by a computing device of a user;
identifying, by a machine having a memory and at least one processor, a category of the object based on at least one characteristic of the object from the sensor data;
determining a characterizing feature of the category of the object;
generating virtual content based on the characterizing feature; and
causing the virtual content to be displayed concurrently with a view of the object on a display screen of the computing device.
2 . The method of claim 1 , wherein the at least one characteristic of the object comprises at least one of a shape of the object, a size of the object, a color of the object, the position of the object, the temperature/pressure/other sensor reading of the object, orientation or position of the object, generic text disposed on the object, and a generic visual element disposed on the object.
3 . The method of claim 1 , wherein the category of the object is identified by performing a machine learning process.
4 . The method of claim 3 , wherein performing the machine learning process comprises accessing or searching a third party or public database based on the at least one characteristic of the object.
5 . The method of claim 1 , wherein determining the characterizing feature comprises performing a machine learning process.
6 . The method of claim 5 , wherein performing the machine learning process involves accessing or crawling a third party or public dataset based on the category of the object.
7 . The method of claim 1 , wherein generating the virtual content comprises performing a machine learning process.
8 . The method of claim 1 , wherein generating the visual content comprises:
determining a software application based on the category of the object, the software application managing user content configured by the user;
retrieving the user content from the software application; and
generating the virtual content based on the retrieved user content.
9 . The method of claim 8 , wherein the virtual content comprises the retrieved user content.
10 . The method of claim 1 , wherein causing the virtual content to be displayed comprises overlaying the view of the object with the virtual content.
11 . The method of claim 1 , further comprising:
identifying content that is disposed on the object based on the sensor data;
determining a software application based on the category of the object, the software application being accessible by the user on the computing device; and
providing, to the software application, data corresponding to the identified content for use by the software application in modifying application content of the software application.
12 . The method of claim 1 , wherein the sensor data comprises video or still pictures.
13 . The method of claim 1 , wherein the user computing device comprises one of a smart phone, a tablet computer, a wearable computing device, a head-mounted display device, a vehicle computing device, a laptop computer, and a desktop computer.
14 . The method of claim 1 , wherein the receiving, identifying, determining, generating, and causing are performed by a remote server separate from the computing device.
15 . A system comprising:
a machine having a memory and at least one processor; and
an object identification module, executable on the at least one processor, configured to perform operations comprising:
receiving sensor data of an object, the sensor data having been captured by a computing device of a user; and
identifying, by a machine having a memory and at least one processor, a category of the object based on at least one characteristic of the object from the sensor data;
a characterizing feature module configured to perform operations comprising determining a characterizing feature of the category of the object; and
a virtual content module configured to perform operations comprising:
generating virtual content based on the characterizing feature; and
causing the virtual content to be displayed concurrently with a view of the object on a display screen of the computing device.
16 . The system of claim 15 , wherein the at least one characteristic of the object comprises at least one of a shape of the object, a size of the object, a color of the object, an orientation of the object, generic text disposed on the object, and a generic visual element disposed on the object.
17 . The system of claim 15 , wherein at least one of identifying the category of the object, determining the characterizing feature, and generating the virtual content comprises performing a machine learning process.
18 . The system of claim 15 , wherein the virtual content module is further configured to perform operations comprising:
determining a software application based on the category of the object, the software application managing user content configured by the user;
retrieving the user content from the software application; and
generating the virtual content based on the retrieved user content.
19 . The system of claim 1 , wherein the virtual content module is further configured to perform operations comprising:
identifying visual content that is placed with a fixed or dynamic spatial relationship to the object based on the sensor data;
determining a software application based on the category of the object, the software application being accessible by the user on the computing device; and
providing, to the software application, data corresponding to the visual content for use by the software application in modifying application content of the software application.
20 . A non-transitory machine-readable storage device, tangibly embodying a set of instructions that, when executed by at least one processor, causes the at least one processor to perform operations comprising:
receiving sensor data of an object, the sensor data having been captured by a computing device of a user;
identifying a category of the object based on at least one characteristic of the object from the sensor data;
determining a characterizing feature of the category of the object;
generating virtual content based on the characterizing feature; and
causing the virtual content to be displayed concurrently with a view of the object on a display screen of the computing device.