Non-uniform stereo rendering
Examples of the disclosure describe systems and methods for recording augmented reality and mixed reality experiences. In an example method, an image of a real environment is received via a camera of a wearable head device. A pose of the wearable head device is estimated, and a first image of a virtual environment is generated based on the pose. A second image of the virtual environment is generated based on the pose, wherein the second image of the virtual environment comprises a larger field of view than a field of view of the first image of the virtual environment. A combined image is generated based on the second image of the virtual environment and the image of the real environment.
1. A method comprising:
receiving an image of a real environment, said image having a first field of view;
receiving an image of a virtual environment, said image having a second field of view different from the first field of view; and
generating a combined image based on the image of the virtual environment and the image of the real environment,
wherein:
generating the combined image comprises performing a planar projection, said planar projection comprising mapping a point of the image of the virtual environment to a corresponding point of the image of the real environment.
2. The method of claim 1 , further comprising:
generating a cropped image based on the image of the virtual environment; and
presenting a stereoscopic image based on the cropped image.
3. The method of claim 2 , wherein the cropped image has a field of view smaller than the field of view of the image of the virtual environment.
4. The method of claim 2 , wherein the image of the virtual environment is associated with a framebuffer size, and wherein the cropped image is associated with the same framebuffer size.
5. The method of claim 1 , wherein the image of the virtual environment comprises an aspect ratio, and wherein the image of the real environment comprises the same aspect ratio.
6. The method of claim 1 , wherein the image of the real environment comprises a first resolution and the image of the virtual environment comprises a second resolution different from the first resolution.
7. The method of claim 1 , wherein receiving the image of the real environment comprises receiving said image via a camera.
8. The method of claim 7 , wherein the camera is configured to be placed to a left side of a user's left eye.
9. The method of claim 7 , wherein the camera is configured to be placed to a right side of a user's right eye.
10. The method of claim 7 , wherein the camera is configured to be placed in between a user's left eye and the user's right eye.
11. The method of claim 1 , wherein said generating the combined image comprises generating the combined image via a first device, and wherein the method further comprises presenting the combined image via a display of a second device, different from the first device.
12. The method of claim 1 , wherein said generating the combined image comprises generating the combined image via a first device, and wherein the method further comprises presenting the combined image via a display of the first device.
13. The method of claim 1 , wherein the first field of view is greater than the second field of view.
14. A system comprising:
one or more processors configured to perform a method comprising:
receiving an image of a real environment, said image having a first field of view;
receiving an image of a virtual environment, said image having a second field of view different from the first field of view; and
generating a combined image based on the image of the virtual environment and the image of the real environment,
wherein:
generating the combined image comprises performing a planar projection, said planar projection comprising mapping a point of the image of the virtual environment to a corresponding point of the image of the real environment.
15. The system of claim 14 , wherein said generating the combined image comprises generating the combined image via a first device, and wherein the method further comprises presenting the combined image via a display of a second device, different from the first device.
16. The system of claim 14 , wherein said generating the combined image comprises generating the combined image via a first device, and wherein the method further comprises presenting the combined image via a display of the first device.
17. The system of claim 14 , wherein the first field of view is greater than the second field of view.
18. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform a method comprising:
receiving an image of a real environment, said image having a first field of view;
receiving an image of a virtual environment, said image having a second field of view different from the first field of view; and
generating a combined image based on the image of the virtual environment and the image of the real environment,
wherein:
generating the combined image comprises performing a planar projection, said planar projection comprising mapping a point of the image of the virtual environment to a corresponding point of the image of the real environment.
19. The non-transitory computer-readable medium of claim 18 , wherein said generating the combined image comprises generating the combined image via a first device, and wherein the method further comprises presenting the combined image via a display of the first device.
20. The non-transitory computer-readable medium of claim 18 , wherein the first field of view is greater than the second field of view.