Displaying graphics in multi-view scenes
A computing device includes a memory for storing instructions and a processor. The processor is configured to execute the instructions to identify a location for a graphical element in a predefined three-dimensional scene using depth information of content included in two or more different two-dimensional representations of the predefined three-dimensional scene. The processor is also configured to produce two or more different two-dimensional representations of the predefined three-dimensional scene including the graphical element.
1. A computer-implemented method comprising:
identifying, by a processor, a focal plane associated with a predefined three-dimensional scene from a set of two or more different two-dimensional representations of the predefined three dimensional scene, each respective representation in the set of the two or more different two-dimensional representations having a different perspective of view of the predefined three-dimensional scene, wherein the focal plane is identified by high spatial frequency components of a portion of an object represented in each of the different two or more two-dimensional representations;
determining, by the processor, a depth of the focal plane for positioning a graphical element in the predefined three-dimensional scene based on the portion of the object used to identify the focal plane, identified by high spatial frequency components, and being represented in the set of two or more different two-dimensional representations,
wherein determining the depth of the focal plane for positioning the graphical element comprises:
determining parallax between corresponding high spatial frequency components of the portion of the object used to identify the focal plane and present in each representation in the set of two or more different two-dimensional representations,
determining depth information using the parallax of the set of two or more representations in which each representation has a different perspective of view of the predefined three-dimensional scene,
identifying other objects in the predefined three-dimensional scene, and
superimposing the graphical element in the focal plane of the scene based on the determined depth information of the portion of the object used to identify the focal plane to preserve depth perception, wherein superimposing includes determining a position for each of two or more perspective views of the graphical element in a corresponding two-dimensional representation of the predefined three-dimensional scene such that the graphical element is placed in the focal plane and is absent occlusion by the portion of the object and the other objects in the predefined three-dimensional scene; and
producing a modified set of two or more two-dimensional representations of the predefined three-dimensional scene, wherein each two-dimensional representation in the modified set includes a perspective view of the superimposed graphical element absent occlusion from the objects included in the three-dimensional scene, and the individual two-dimensional representations in the modified set are configured such that the graphical element appears in the focal plane.
2. The computer-implemented method of claim 1 in which determining the depth information includes comparing the high spatial frequency components of the two or more different two-dimensional representations of the predefined three-dimensional scene.
3. The computer-implemented method of claim 1 in which the high spatial frequency components include edges of content.
4. The computer-implemented method of claim 1 in which the high spatial frequency components are detected by high pass filtering.
5. The computer-implemented method of claim 1 in which producing the modified set of two or more two-dimensional representations includes representing the graphical element with two or more different two-dimensional views.
6. The computer-implemented method of claim 1 in which the graphical element represents at least one of a geometrical object, a portion of a user interface, an image and text.
7. The computer-implemented method of claim 1 in which the depth information is determined from compressed video data.
8. The computer-implemented method of claim 1 , the set of two or more different two-dimensional representations of the predefined three dimensional scene being represented in a frequency domain.
9. The computer-implemented method of claim 1 , the set of two or more different two-dimensional representations of the predefined three dimensional scene being compressed.
10. A computing device comprising:
a memory for storing instructions; and
a processor configured to execute the instructions to:
identify a focal plane associated with a predefined three-dimensional scene from a set of two or more different two-dimensional representations of the predefined three dimensional scene, each respective representation in the set of the two or more different two-dimensional representations having a different perspective of view of the predefined three-dimensional scene, wherein the focal plane is identified by high spatial frequency components of a portion of an object represented in each of the two or more two-dimensional representations;
determine a depth of the focal plane for positioning a graphical element in the predefined three-dimensional scene based on the portion of the object used to identify the focal plane, identified by high spatial frequency components, and being represented in the set of two or more different two-dimensional representations,
wherein determining the depth of the focal plane for positioning the graphical element comprises:
determining parallax between corresponding high spatial frequency components of the portion of the object used to identify the focal plane and present in each representation in the set of two or more two-dimensional representations,
determining depth information using the parallax of the set of two or more representations in which each representation has a different perspective of view of the predefined three-dimensional scene,
identifying other objects in the predefined three-dimensional scene, and
superimposing the graphical element in the focal plane of the scene based on the determined depth information of the portion of the object used to identify the focal plane to preserve depth perception, wherein superimposing includes determining a position for each of two or more perspective views of the graphical element in a corresponding two-dimensional representation of the predefined three-dimensional scene such that the graphical element is placed in the focal plane and is absent occlusion by the portion of the object and the other objects in the predefined three-dimensional scene; and
produce a modified set of two or more two-dimensional representations of the predefined three-dimensional scene, wherein each two-dimensional representation in the modified set includes a perspective view of the superimposed graphical element absent occlusion from the objects included in the three-dimensional scene, and the individual two-dimensional representations in the modified set are configured such that the graphical element appears in the focal plane.
11. The computing device of claim 10 , in which to determine the depth information, the processor is configured to compare the high spatial frequency components of the two or more different two-dimensional representations of the predefined three-dimensional scene.
12. The computing device of claim 10 , in which the high spatial frequency components include edges of content.
13. The computing device of claim 10 , in which the processor is configured to high pass filter to detect the high spatial frequency components.
14. The computing device of claim 10 , in which producing the modified set of two or more two-dimensional representations includes representing the graphical element with two or more different two-dimensional views.
15. The computing device of claim 10 , in which the graphical element represents at least one of a geometrical object, a portion of a user interface, an image and text.
16. The computing device of claim 10 , in which the depth information is determined from compressed video data.
17. The computing device of claim 10 , the set of two or more different two-dimensional representations of the predefined three dimensional scene being represented in a frequency domain.
18. The computing device of claim 10 , the set of two or more different two-dimensional representations of the predefined three dimensional scene being compressed.
19. One or more non-transitory computer readable media storing instructions that are executable by a processing device, and upon such execution cause the processing device to perform operations comprising:
identifying, by a processor, a focal plane associated with a predefined three-dimensional scene from a set of two or more different two-dimensional representations of the predefined three dimensional scene, each respective representation in the set of the two or more different two-dimensional representations having a different perspective of view of the predefined three-dimensional scene, wherein the focal plane is identified by high spatial frequency components of a portion of an object represented in each of the two or more two-dimensional representations;
determining depth of the focal plane for positioning a graphical element in the predefined three-dimensional scene based on the portion of the object used to identify the focal plane, identified by high spatial frequency components, and being represented in the set of two or more different two-dimensional representations,
wherein determining the depth of the of the focal plane for positioning the graphical element comprises:
determining parallax between corresponding high spatial frequency components of the portion of the object used to identify the focal plane and present in each representation in the set of two or more two-dimensional representations,
determining depth information using the parallax of the set of two or more representations in which each representation has a different perspective of view of the predefined three-dimensional scene,
identifying other objects in the predefined three-dimensional scene, and
superimposing the graphical element in the focal plane of the scene based on the determined depth information of the portion of the object used to identify the focal plane to preserve depth perception, wherein superimposing includes determining a position for each of two or more perspective views of the graphical element in a corresponding two-dimensional representation of the predefined three-dimensional scene such that the graphical element is placed in the focal plane and is absent occlusion by the portion of the object and the other objects in the predefined three-dimensional scene; and
producing a modified set of two or more two-dimensional representations of the predefined three-dimensional scene, wherein each two-dimensional representation in the modified set includes a perspective view of the superimposed graphical element absent occlusion from the objects included in the three-dimensional scene, and the individual two-dimensional representations in the modified set are configured such that the graphical element appears in the focal plane.
20. The computer readable media of claim 19 , in which determining the depth information includes comparing the high spatial frequency components of the two or more different two-dimensional representations of the predefined three-dimensional scene.
21. The computer readable media of claim 19 , in which the high spatial frequency components include edges of content.
22. The computer readable media of claim 19 , in which the high spatial frequency components are detected by high pass filtering.
23. The computer readable media of claim 19 , in which producing the modified set of two or more two-dimensional representations includes representing the graphical element with two or more different two-dimensional views.
24. The computer readable media of claim 19 , in which the graphical element represents at least one of a geometrical object, a portion of a user interface, an image and text.
25. The computer readable media of claim 19 , in which the depth information is determined from compressed video data.
26. The computer readable media of claim 19 , the set of two or more different two-dimensional representations of the predefined three dimensional scene being represented in a frequency domain.
27. The computer readable media of claim 19 , the set of two or more different two-dimensional representations of the predefined three dimensional scene being compressed.