Techniques for displaying and capturing images
Embodiments disclosed herein are directed to devices, systems, and methods for separately processing an image stream to generate a first set of images for display by a set of displays and a second set of images for storage or transfer as part of a media capture event. Specifically, a first set of images from an image stream may be used to generate a first set of transformed images, and these transformed images may be displayed on a set of displays. A second set of images may be selected from the image stream in response to a capture request associated with a media capture event, and the second set of images may be used to generate a second set of transformed images. A set of output images may be generated from the second set of transformed images, and the set of output images may be stored or transmitted for later viewing.
1. A device comprising:
a set of cameras;
a set of displays;
a memory; and
one or more processors operatively coupled to the memory, wherein the one or more processors are configured to execute instructions causing the one or more processors to:
capture an image stream using the set of cameras;
generate a first set of transformed images from the image stream by applying a first transformation operation to images of the image stream;
display the first set of transformed images using the set of displays;
receive a capture request to capture a set of stereo output images; and
generate, in response to receiving the capture request, the set of stereo output images, wherein generating the set of stereo output images comprises:
selecting a set of images from the image stream;
generating a second set of transformed images from the set of images by applying a second transformation operation different than the first transformation operation to the set of images; and
generating, using the second set of transformed images, the set of stereo output images, wherein:
the first set of transformed images and the second set of transformed images are generated from the same images.
2. The device of claim 1 , wherein generating the set of stereo output images comprises:
generating a fused stereo output image from two or more image pairs of the set of images.
3. The device of claim 1 , wherein the set of stereo output images comprises a stereo video.
4. The device of claim 3 , wherein generating the set of stereo output images comprises:
performing a video stabilization operation on the second set of transformed images.
5. The device of claim 1 , wherein the first transformation operation is a perspective correction operation.
6. The device of claim 1 , wherein the second transformation operation is an image rectification operation.
7. The device of claim 1 , wherein generating the set of stereo output images comprises generating metadata associated with the set of stereo output images.
8. The device of claim 7 , wherein the metadata comprises field of view information of the set of cameras.
9. The device of claim 7 , wherein the metadata comprises pose information for the set of stereo output images.
10. The device of claim 7 , wherein the metadata comprises a set of default disparity values for the set of stereo output images.
11. The device of claim 10 , wherein generating metadata associated with the set of stereo output images comprises selecting the set of default disparity values based on a scene captured by the set of stereo output images.
12. A method comprising:
capturing, using a set of cameras of a device, an image stream;
generating a first set of transformed images from the image stream by applying a first transformation operation to images of the image stream;
displaying, at a set of displays of a device, the first set of transformed images;
receiving a capture request to capture a set of stereo output images; and
generating, in response to receiving the capture request, the set of stereo output images, wherein generating the set of stereo output images comprises:
selecting a set of images from the image stream;
generating a second set of transformed images from the set of images by applying a second transformation operation different than the first transformation operation to the set of images; and
generating, using the second set of transformed images, the set of stereo output images, wherein:
the first set of transformed images and the second set of transformed images are generated from the same images.
13. The method of claim 12 , wherein generating the set of stereo output images comprises:
generating a fused stereo output image from two or more image pairs of the set of images.
14. The method of claim 12 , wherein the set of stereo output images comprises a stereo video.
15. The method of claim 14 , wherein generating the set of stereo output images comprises:
performing a video stabilization operation on the second set of transformed images.
16. The method of claim 12 , wherein the first transformation operation is a perspective correction operation.
17. The method of claim 12 , wherein the second transformation operation is an image rectification operation.
18. The method of claim 12 , wherein generating the set of stereo output images comprises generating metadata associated with the set of stereo output images.
19. The method of claim 18 , wherein the metadata comprises field of view information of the set of cameras.
20. The method of claim 18 , wherein the metadata comprises pose information for the set of stereo output images.
21. The method of claim 18 , wherein the metadata comprises a set of default disparity values for the set of stereo output images.
22. The method of claim 21 , wherein generating metadata associated with the set of stereo output images comprises selecting the set of default disparity values based on a scene captured by the set of stereo output images.
23. The method of claim 12 , comprising adding virtual content to the first set of transformed images.