Techniques for displaying and capturing images
Embodiments disclosed herein are directed to devices, systems, and methods for separately processing an image stream to generate a first set of images for display by a set of displays and a second set of images for storage or transfer as part of a media capture event. Specifically, a first set of images from an image stream may be used to generate a first set of transformed images, and these transformed images may be displayed on a set of displays. A second set of images may be selected from the image stream in response to a capture request associated with a media capture event, and the second set of images may be used to generate a second set of transformed images. A set of output images may be generated from the second set of transformed images, and the set of output images may be stored or transmitted for later viewing.
1 . One or more processors configured to:
receive an image stream from at least one camera;
apply a first transformation operation to images of the image stream;
output, for display, the images transformed using the first transformation operation;
receive a capture request to capture a set of stereo output images; and
generate, in response to receiving the capture request and while applying the first transformation and outputting the images transformed using the first transformation operation, the set of stereo output images, wherein generating the set of stereo output images comprises:
applying a second transformation operation different than the first transformation operation to a set of images from the image stream; and
generating, using the set of images transformed using the second transformation operation, the set of stereo output images, wherein:
the set of images transformed using the first transformation operation and the set of images transformed using the second transformation operation are generated from the same images.
2 . The one or more processors of claim 1 , wherein generating the set of stereo output images comprises:
generating a fused stereo output image from two or more image pairs of the set of images.
3 . The one or more processors of claim 1 , wherein the set of stereo output images comprises a stereo video.
4 . The one or more processors of claim 3 , wherein generating the set of stereo output images comprises:
performing a video stabilization operation on the set of images transformed using the second transformation operation.
5 . The one or more processors of claim 1 , wherein the first transformation operation is a perspective correction operation.
6 . The one or more processors of claim 1 , wherein the second transformation operation is an image rectification operation.
7 . The one or more processors of claim 1 , wherein generating the set of stereo output images comprises generating metadata associated with the set of stereo output images.
8 . A method comprising:
generating, from an image stream received from at least one camera, a first set of transformed images by applying a first transformation operation to images of the image stream;
outputting, for display, the first set of transformed images;
receiving a capture request to capture a set of stereo output images; and
generating, in response to receiving the capture request while applying the first transformation and outputting the images transformed using the first transformation operation, the set of stereo output images, wherein generating the set of stereo output images comprises:
applying a second transformation operation different than the first transformation operation to a set of images from the image stream to generate a second set of transformed images; and
generating, using the second set of transformed images, the set of stereo output images, wherein:
the first set of transformed images and the second set of transformed images are generated from the same images.
9 . The method of claim 8 , wherein generating the set of stereo output images comprises generating metadata associated with the set of stereo output images.
10 . The method of claim 9 , wherein the metadata comprises pose information for the set of stereo output images.
11 . The method of claim 9 , wherein the metadata comprises field of view information of the at least one camera.
12 . The method of claim 9 , wherein the metadata comprises a set of default disparity values for the set of stereo output images.
13 . The method of claim 12 , wherein generating metadata associated with the set of stereo output images comprises selecting the set of default disparity values based on a scene captured by the set of stereo output images.
14 . The method of claim 8 , comprising adding virtual content to the first set of transformed images.
15 . A non-transitory computer readable medium comprising instructions, which when executed by a processing unit, cause the processing unit to:
receive an image stream from at least one camera;
apply a first transformation operation to images of the image stream;
output, to at least one display, the images transformed using the first transformation operation;
receive a capture request to capture a set of stereo output images; and
generate, in response to receiving the capture request and while applying the first transformation operation and outputting the images transformed using the first transformation operation, the set of stereo output images, wherein generating the set of stereo output images comprises:
applying a second transformation operation different than the first transformation operation to a set of images from the image stream; and
generating, using the set of images transformed using the second transformation operation, the set of stereo output images, wherein:
the images transformed using the first transformation operation and the set of images transformed using the second transformation operation are generated from the same images.
16 . The non-transitory computer readable medium of claim 15 , wherein the first transformation operation is a perspective correction operation.
17 . The non-transitory computer readable medium of claim 15 , wherein the second transformation operation is an image rectification operation.
18 . The non-transitory computer readable medium of claim 15 , wherein generating the set of stereo output images comprises:
generating a fused stereo output image from two or more image pairs of the set of images.
19 . The non-transitory computer readable medium of claim 15 , wherein generating the set of stereo output images comprises generating metadata associated with the set of stereo output images.
20 . The non-transitory computer readable medium of claim 19 , wherein the metadata comprises field of view information associated with the image stream.