Granted Patent B2

US 9,626,801 · App. 14/145,567 · Granted Apr 18, 2017

Inventor: Brian Mullins (Sierra Madre, CA)

Assignee: DAQRI, LLC

G06T19/006G06K9/00671

Abstract

Claims (68)

1. A server comprising:

a sensor coupled to an object; and

a processor comprising an augmented reality application, the augmented reality application configured to perform operations comprising:

accessing live data generated by the sensor;

computing physical characteristics of the object using the live data;

generating a three-dimensional model of the object using the computed physical characteristics of the object;

generating a visual indicator based on the physical characteristics of the object; and

communicating the three-dimensional model of the object and the visual indicator to a viewing device configured to capture an image of the object, the viewing device being configured to display the three-dimensional model of the object and the visual indicator in a display of the viewing device.

2. The server of claim 1 , wherein the operations further comprises:

receiving an identification of the object from the viewing device; and

accessing live data corresponding to the identification of the object.

3. The server of claim 2 , wherein the operations further comprises:

communicating the live data to the viewing device,

wherein the viewing device is configured to compute the physical characteristics of the object using the live data, and to generate the visual indicator.

4. The server of claim 3 , wherein the viewing device is configured to:

display the visual indicator based on a position of the image of the object in the display of the viewing device.

5. The server of claim 1 , wherein the visual indicator comprises at least one of an animation with movements based on the live data, and shapes and colors that change according to the live data.

6. The server of claim 1 , wherein the physical characteristics of the object include a weight, a force, a pressure, a heart rate, a pressure rate, or EEG data.

7. The server of claim 1 , wherein the operations further comprises:

accessing historical physical characteristics of the object; and

generating the visual indicator based on a difference between the physical characteristics of the object and the historical physical characteristics of the object.

8. The server of claim 1 , wherein the operations further comprises:

receiving a parameter related to the object from the viewing device, the parameter identifying a second object related to the object;

computing modified physical characteristics of the object based on the live data affected by the parameter;

generating a modified visual indicator based on the modified physical characteristics of the object; and

communicating the modified visual indicator to the viewing device.

9. The server of claim 1 , wherein the operations further comprises:

identifying a second object; and

determining that the second object is associated with the object,

wherein the viewing device is configured to capture an image of the second object, and to display the three-dimensional model of the object and the visual indicator on top of the second object in response to determining that the second object is associated with the object.

10. The server of claim 1 , wherein the viewing device comprises:

an optical device configured to capture the image of the object; and

a display configured to display the visual indicator in a transparent display, a position and size of the visual indicator in the transparent display based on a position and orientation of the viewing device relative to the object.

11. A method comprising:

accessing live data generated by a sensor coupled to an object;

computing physical characteristics of the object using the live data;

generating a three-dimensional model of the object using the computed physical characteristics of the object;

generating a visual indicator based on the physical characteristics of the object; and

communicating the three-dimensional model of the object and the visual indicator to a viewing device configured to capture an image of the object, the viewing device being configured to display the three-dimensional model of the object and the visual indicator in a display of the viewing device.

12. The method of claim 11 , further comprising:

receiving an identification of the object from the viewing device; and

accessing live data corresponding to the identification of the object.

13. The method of claim 12 , further comprising:

communicating the live data to the viewing device;

computing the physical characteristics of the object using the live data at the viewing device; and

generating the visual indicator at the viewing device.

14. The method of claim 13 , further comprising:

displaying the visual indicator based on a position of the image of the object in the display of the viewing device.

15. The method of claim 11 , wherein the visual indicator comprises at least one of an animation with movements based on the live data, and shapes and colors that change according to the live data.

16. The method of claim 11 , wherein the physical characteristics of the object include a weight, a force, a pressure, a heart rate, a pressure rate, or EEG data.

17. The method of claim 11 , further comprising:

receiving a parameter related to the object from the viewing device, the parameter identifying a second object related to the object;

computing modified physical characteristics of the object based on the live data affected by the parameter;

generating a modified visual indicator based on the modified physical characteristics of the object; and

communicating the modified visual indicator to the viewing device.

18. The method of claim 11 , further comprising:

identifying a second object; and

determining that the second object is associated with the object,

wherein the viewing device is configured to capture an image of the second object, and to display the three-dimensional model of the object and the visual indicator on top of the second object in response to determining that the second object is associated with the object.

19. The method of claim 11 , further comprising:

capturing the image of the object with an optical device of the viewing device; and

displaying the visual indicator of the physical characteristics of the object in a transparent display of the viewing device, a position and size of the visual indicator in the transparent display based on a position and orientation of the viewing device relative to the object.

20. A non-transitory machine-readable medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

accessing live data generated by a sensor coupled to an object;

computing physical characteristics of the object using the live data;

generating a three-dimensional model of the object using the computed physical characteristics of the object;

generating a visual indicator based on the physical characteristics of the object; and

communicating the three-dimensional model of the object and the visual indicator to a viewing device configured to capture an image of the object, the viewing device being configured to display the three-dimensional model of the object and the visual indicator in a display of the viewing device.

Assignments (12)

Continuity (1)