Surface aware lens
Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for rendering three-dimensional virtual objects within real world environments. Virtual rendering of a three-dimensional virtual object can be altered appropriately as a user moves around the object in the real world, and the three-dimensional virtual object can exist similarly for multiple users. Virtual object rendering can be with respect to a reference surface in a real world environment, which reference surface can be selected by a user as part of the virtual object rendering process.
1. A system, comprising:
a memory; and
at least one hardware processor coupled to the memory and comprising a virtual object rendering system, the virtual object rendering system causing the system to perform operations comprising:
receiving an input to activate a surface aware lens that facilitates rendering of a virtual object in a three-dimensional space captured within a camera view;
detecting a reference surface in the three-dimensional space captured within the camera view;
orienting the virtual object based on the reference surface, the orienting of the virtual object comprising:
assigning the virtual object to a position in three-dimensional space based on the detected reference surface, and
identifying tracking indicia operable to track the virtual object in the three-dimensional space;
rendering the virtual object to appear in the three-dimensional space captured within the camera view, the virtual object being rendered with respect to the reference surface;
tracking, by a first tracking subsystem from among a set of tracking subsystems, the virtual object at the position in the three-dimensional space using the tracking indicia;
detecting, by the first tracking subsystem, an interruption of the tracking indicia; and
in response to detecting the interruption of the tracking indicia, tracking the virtual object at the position in the three-dimensional space via a second tracking subsystem from among the set of tracking subsystems.
2. The system of claim 1 , wherein the detecting of the reference surface is based on user input.
3. The system of claim 1 , wherein the position in the three-dimensional space is a predefined distance from the reference surface.
4. The system of claim 3 , wherein the rendering of the virtual object with respect to the reference surface includes rendering and maintaining the virtual object at the predefined distance from the reference surface.
5. The system of claim 1 , wherein the system further includes a redundant tracking system comprising the set of tracking subsystems, the set of tracking subsystems comprising a gyroscopic tracking system, a natural feature tracking system, and simultaneous localization and mapping tracking.
6. The system of claim 1 , wherein the rendering of the virtual object includes rendering a separate virtual representation related to the virtual object at the reference surface.
7. The system of claim 6 , wherein the separate virtual representation is a simulated shadow of the virtual object.
8. The system of claim 1 , further comprising:
receiving user selection of a template from among a set of templates, the template corresponding to the virtual object.
9. The system of claim 8 , wherein the virtual object includes customized personal avatar content.
10. The system of claim 1 , wherein the virtual object includes content based on external factors related to the three-dimensional space.
11. The system of claim 10 , wherein the content based on external factors is dynamically changed over time.
12. The system of claim 1 , wherein the operations further comprise:
maintaining customized user content;
receiving a selection of the customized user content; and
wherein the rendering of the virtual object includes rendering the selection of the customized user content with respect to the reference surface.
13. The system of claim 12 , wherein the operations further comprise:
sharing the selection of the customized user content with a user other than the user that created the customized user content.
14. The method of claim 13 , wherein:
the rendering of the virtual object with respect to the reference surface comprises:
rendering and maintaining the virtual object at the assigned position.
15. The method of claim 12 , wherein the detecting of the reference surface includes detecting a real-world fixed surface within the three-dimensional space.
16. A method for rendering a virtual object in a three-dimensional space captured within a camera view by a virtual object rendering system, the method comprising:
receiving an input to activate a surface aware lens that facilitates the rendering of the virtual object in the three-dimensional space captured within a camera view;
detecting a reference surface in the three-dimensional space captured within the camera view;
orienting the virtual object based on the reference surface, the orienting of the virtual object comprising:
assigning the virtual object to a position in three-dimensional space based on the detected reference surface, and
identifying tracking indicia operable to track the virtual object in the three-dimensional space; and
rendering the virtual object to appear in the three-dimensional space captured within the camera view, the virtual object being rendered with respect to the reference surface;
tracking, by a first tracking subsystem from among a set of tracking subsystems, the virtual object at the position in the three-dimensional space using the tracking indicia;
detecting, by the first tracking subsystem, an interruption of the tracking indicia; and
in response to detecting the interruption of the tracking indicia, tracking the virtual object at the position in the three-dimensional space via a second tracking subsystem from among the set of tracking subsystems.
17. The method of claim 16 , further comprising:
maintaining customized user content;
receiving a selection of the customized user content for a new reference surface; and
rendering the selection of the customized user content at the new reference surface.
18. A non-transitory machine-readable storage medium including a virtual object rendering system that includes instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
receiving an input to activate a surface aware lens that facilitates the rendering of a virtual object in three-dimensional space captured within a camera view;
detecting a reference surface in the three-dimensional space captured within the camera view;
orienting the virtual object based on the reference surface, the orienting of the virtual object comprising:
assigning the virtual object to a position in three-dimensional space based on the detected reference surface, and
identifying tracking indicia operable to track the virtual object in the three-dimensional space; and
rendering the virtual object to appear in the three-dimensional space captured within the camera view, the virtual object being generated with respect to the reference surface;
tracking, by a first tracking subsystem from among a set of tracking subsystems, the virtual object at the position in the three-dimensional space using the tracking indicia;
detecting, by the first tracking subsystem, an interruption of the tracking indicia; and
in response to detecting the interruption of the tracking indicia, tracking the virtual object at the position in the three-dimensional space via a second tracking subsystem from among the set of tracking subsystems.