Methods and apparatus for capturing, processing and/or communicating images
An unobstructed image portion of a captured image from a first camera of a camera pair, e.g., a stereoscopic camera pair including fisheye lenses, is combined with a scaled extracted image portion generated from a captured image from a second camera in the camera pair. An unobstructed image portion of a captured image from the second camera of the camera pair is combined with a scaled extracted image portion generated from a captured image from the first camera in the camera pair. As part of the combining obstructed image portions which were obstructed by part of the adjacent camera are replaced in some embodiments. In some embodiments, the obstructions are due to adjacent fisheye lens. In various embodiments fish eye lenses which have been cut to be flat on one side are used for the left and right cameras with the spacing between the optical axis approximating the spacing between the optical axis of a human person's eyes.
1. A method comprising:
receiving a first image captured by a first camera of a camera pair, the first image comprising a first unobstructed image portion and a first obstructed image portion;
receiving a second image captured by a second camera of the camera pair, the second image comprising a second unobstructed image portion and a second obstructed image portion obstructed by a component of the first camera;
scaling the second unobstructed image portion to generate a scaled portion of the second image; scaling the first unobstructed image portion to generate a scaled portion of the first image;
generating a first composite image by combining the first unobstructed image portion with the scaled portion of the second image;
generating a second composite image by combining the second unobstructed image portion with the scaled portion of the first image; and
combining the first composite image and the second composite image into a single frame.
2. The method of claim 1 , further comprising:
encoding the single frame to generate an encoded stereoscopic image frame.
3. The method of claim 2 , further comprising transmitting the encoded stereoscopic image frame to a stereoscopic playback device.
4. The method of claim 1 , wherein the first camera comprises a first fisheye lens, and wherein the first fisheye lens obstructs a portion of a field of view of the second camera adjacent to the first camera.
5. The method of claim 1 , wherein generating the first composite image comprises:
aligning at least a portion of an object in the scaled portion of the second image with a corresponding portion of the object in the first unobstructed portion of the first image; and
combining the scaled portion of the second image with the first unobstructed portion of the first image.
6. The method of claim 1 , wherein the first camera comprises a first asymmetric lens, and wherein the second camera comprises a second asymmetric lens.
7. A non-transitory computer readable medium comprising computer readable code executable by one or more processors to:
receive a first image captured by a first camera of a camera pair, the first image comprising a first unobstructed image portion and a first obstructed image portion;
receive a second image captured by a second camera of the camera pair, the second image comprising a second unobstructed image portion and a second obstructed image portion obstructed by a component of the first camera;
scale the second unobstructed image portion to generate a scaled portion of the second image; scale the first unobstructed image portion to generate a scaled portion of the first image;
generate a first composite image by combining the first unobstructed image portion with the scaled portion of the second image;
generate a second composite image by combining the second unobstructed image portion with the scaled portion of the first image; and
combine the first composite image and the second composite image into a single frame.
8. The non-transitory computer readable medium of claim 7 , further comprising computer readable code to:
encode the single frame to generate an encoded stereoscopic image frame.
9. The non-transitory computer readable medium of claim 8 , further comprising computer readable code to:
transmit the encoded stereoscopic image frame to a stereoscopic playback device.
10. The non-transitory computer readable medium of claim 8 , wherein the computer readable code to generate the first composite image comprises computer readable code to:
align at least a portion of an object in the scaled portion of the second image with a corresponding portion of the object in the first unobstructed portion of the first image; and
combine the scaled portion of the second image with the first unobstructed portion of the first image.
11. The non-transitory computer readable medium of claim 7 , wherein the first camera comprises a first fisheye lens, and wherein the first fisheye lens obstructs a portion of a field of view of the second camera adjacent to the first camera.
12. The non-transitory computer readable medium of claim 7 , wherein the first camera comprises a first asymmetric lens, and wherein the second camera comprises a second asymmetric lens.
13. A system comprising:
one or more processors; and
one or more computer readable media comprising computer readable code executable by the one or more processors to:
receive a first image captured by a first camera of a camera pair, the first image comprising a first unobstructed image portion and a first obstructed image portion;
receive a second image captured by a second camera of the camera pair, the second image comprising a second unobstructed image portion and a second obstructed image portion obstructed by a component of the first camera;
scale the second unobstructed image portion to generate a scaled portion of the second image;
scale the first unobstructed image portion to generate a scaled portion of the first image;
generate a first composite image by combining the first unobstructed image portion with the scaled portion of the second image;
generate a second composite image by combining the second unobstructed image portion with the scaled portion of the first image; and
combine the first composite image and the second composite image into a single frame.
14. The system of claim 13 , further comprising computer readable code to:
encode the single frame to generate an encoded stereoscopic image frame.
15. The system of claim 14 , further comprising computer readable code to:
transmit the encoded stereoscopic image frame to a stereoscopic playback device.
16. The system of claim 14 , wherein the computer readable code to generate the first composite image comprises computer readable code to:
align at least a portion of an object in the scaled portion of the second image with a corresponding portion of the object in the first unobstructed portion of the first image; and
combine the scaled portion of the second image with the first unobstructed portion of the first image.
17. The system of claim 13 , wherein the first camera comprises a first fisheye lens, and wherein the first fisheye lens obstructs a portion of a field of view of the second camera adjacent to the first camera.