Generating augmented reality content for unknown objects
Techniques described herein provide a method for defining virtual content for real objects that are unknown or unidentified at the time of the development of the application for an augmented reality (AR) environment. For example, at the time of development of an AR application, the application developer may not know the context that the mobile device may operate in and consequently the types or classes of real object and the number of real objects that the AR application may encounter. In one embodiment, the mobile device may detect unknown objects from a physical scene. The mobile device may then associate an object template with the unknown object based on the physical attributes, such as height, shape, size, etc., associated with the unknown object. The mobile device may render a display object at the pose of the unknown object using at least one display property of the object template.
1. A method for constructing a digital representation of a physical scene, comprising:
selecting an unknown object from the physical scene;
determining at least one physical attribute associated with the unknown object;
comparing the at least one physical attribute associated with the unknown object against a physical attribute qualifier of an object template, wherein the object template represents an object different than the unknown object;
selecting, by a processor, the object template based on the comparison of the at least one physical attribute associated with the unknown object against the physical attribute qualifier of the object template, the selecting including determining that the physical attribute qualifier of the object template matches the physical attribute associated with the unknown object; and
rendering a display object in the digital representation of the physical scene at a position of the unknown object from the physical scene using at least one display property associated with the object template.
2. The method of claim 1 , wherein the at least one physical attribute associated with the unknown object comprises one or more of shape of the unknown object, size of the unknown object, location of the unknown object, pose of the unknown object, order of appearance of the unknown object with respect to other objects, mode of an application associated with the rendering of the display object, and attributes of other unknown objects.
3. The method of claim 1 , wherein the at least one display property associated with the object template comprises one or more of graphical and animation properties.
4. The method of claim 3 , wherein the graphical properties of the object template comprises one or more of color, size, texture, shape, collision detection, occlusion, and transparency.
5. The method of claim 1 , wherein properties of the object template are selected by a developer using an editing interface at a time of development of an application.
6. The method of claim 1 , wherein the unknown object is one of a plurality of unknown objects and the object template is associated with multiple unknown objects from the plurality of unknown objects.
7. The method of claim 1 , wherein the object template is one of a plurality of object templates.
8. The method of claim 1 , wherein rendering the display object comprises rendering the display object on an image representing the physical scene to be displayed on a display screen of a mobile device.
9. A mobile device for constructing a digital representation of a physical scene, comprising:
a camera configured to obtain image data indicative of the physical scene;
a processor coupled to memory and configured to:
select an unknown object from the physical scene;
determine at least one physical attribute associated with the unknown object;
compare the at least one physical attribute associated with the unknown object against a physical attribute qualifier of an object template, wherein the object template represents an object different than the unknown object;
select the object template based on the comparison of the at least one physical attribute associated with the unknown object against the physical attribute qualifier of the object template, the selecting including determining that the physical attribute qualifier of the object template matches the physical attribute associated with the unknown object; and
render a display object in the digital representation of the physical scene at a position of the unknown object from the physical scene using at least one display property associated with the object template.
10. The mobile device of claim 9 , wherein the at least one physical attribute associated with the unknown object comprises one or more of shape of the unknown object, size of the unknown object, location of the unknown object, pose of the unknown object, order of appearance of the unknown object with respect to other objects, mode of an application associated with the rendering of the display object, and attributes of other unknown objects.
11. The mobile device of claim 9 , wherein the at least one display property associated with the object template comprises one or more of graphical and animation properties.
12. The mobile device of claim 11 , wherein the graphical properties of the object template comprises one or more of color, size, texture, shape, collision, occlusion, and transparency.
13. The mobile device of claim 9 , wherein properties of the object template are selected by a developer, using an editing interface at a time of development of an application.
14. The mobile device of claim 9 , wherein the unknown object is one of a plurality of unknown objects and the object template is associated with multiple unknown objects from the plurality of unknown objects.
15. The mobile device of claim 9 , wherein the object template is one of a plurality of object templates.
16. The mobile device of claim 9 , wherein rendering the display object comprises rendering the display object on an image representing the physical scene to be displayed on a display screen of the mobile device.
17. A non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium comprises instructions executable by a processor, the instructions comprising instructions to:
select an unknown object from a physical scene;
determine at least one physical attribute associated with the unknown object;
compare the at least one physical attribute associated with the unknown object against physical attribute qualifier of an object template, wherein the object template represents an object different than the unknown object;
select the object template based on the comparison of the at least one physical attribute associated with the unknown object against the physical attribute qualifier of the object template, the selecting including determining that the physical attribute qualifier of the object template matches the physical attribute associated with the unknown object; and
render a display object in a digital representation of the physical scene at a position of the unknown object from the physical scene using at least one display property associated with the object template.
18. The non-transitory computer-readable storage medium of claim 17 , wherein the at least one physical attribute associated with the unknown object comprises one or more of shape of the unknown object, size of the unknown object, location of the unknown object, pose of the unknown object, order of appearance of the unknown object with respect to other objects, mode of an application associated with the rendering of the display object, and attributes of other unknown objects.
19. The non-transitory computer-readable storage medium of claim 17 , wherein the at least one display property associated with the object template comprises one or more of graphical and animation properties.
20. The non-transitory computer-readable storage medium of claim 19 , wherein the graphical properties of the object template comprise one or more of color, size, texture, shape, collision detection, occlusion, and transparency.
21. The non-transitory computer-readable storage medium of claim 17 , wherein properties of the object template are selected by a developer using an editing interface at a time of development of an application.
22. The non-transitory computer-readable storage medium of claim 17 , wherein the unknown object is one of a plurality of unknown objects and the object template is associated with multiple unknown objects from the plurality of unknown objects.
23. The non-transitory computer-readable storage medium of claim 17 , wherein the object template is one of a plurality of object templates.
24. The non-transitory computer-readable storage medium of claim 17 , wherein rendering the display object comprises rendering the display object on an image representing the physical scene to be displayed on a display screen of a mobile device.
25. An apparatus for constructing a digital representation of a physical scene, comprising:
means for selecting an unknown object from a physical scene;
means for determining at least one physical attribute associated with the unknown object;
means for comparing the at least one physical attribute associated with the unknown object against a physical attribute qualifier of an object template, wherein the object template represents an object different than the unknown object;
means for selecting the object template based on the comparison of the at least one physical attribute associated with the unknown object against the physical attribute qualifier of the object template, the selecting including determining that the physical attribute qualifier of the object template matches the physical attribute associated with the unknown object; and
means for rendering a display object in a digital representation of the physical scene at a position of the unknown object from the physical scene using at least one display property associated with the object template.
26. The apparatus of claim 25 , wherein the at least one physical attribute associated with the unknown object comprises one or more of shape of the unknown object, size of the unknown object, location of the unknown object, pose of the unknown object, order of appearance of the unknown object with respect to other objects, mode of an application associated with the rendering of the display object, and attributes of other unknown objects.
27. The apparatus of claim 25 , wherein the at least one display property associated with the object template comprises one or more of graphical and animation properties.
28. The apparatus of claim 27 , wherein the graphical properties of the object template comprise one or more of color, size, texture, shape, collision detection, occlusion, and transparency.
29. The apparatus of claim 25 , wherein properties of the object template are selected by a developer using an editing interface at the time of development of an application.
30. The apparatus of claim 25 , wherein the unknown object is one of a plurality of unknown objects and the object template is associated with multiple unknown objects from the plurality of unknown objects.