Methods and apparatus for capturing and/or combining images
In various embodiments light redirection device positions of one or more optical chains are moved between image capture times while the position of the camera device including the multiple optical chains remains fixed. The sequentially captured images are combined to form a larger image than is captured during a single time period. Multiple optical chains are used in parallel, each with its own image sensor and light redirection device, in some embodiments. Depth information may and in some embodiments is generated and used to combine the images in a manner intended to minimize or avoid parallax distortions in the composite image which is produced.
1. A method of generating a composite image, the method comprising;
operating a first optical chain of a camera device including a first light redirection device set at a first angle to capture a first image including a first portion of a scene area;
operating a second optical chain of the camera device including a second light redirection device to capture a second image including a second portion of the scene area that is horizontally adjacent said first portion of the scene area;
operating a third optical chain of the camera device including a third light redirection device to capture a third image including a third portion of the scene area, said third portion of the scene area being horizontally adjacent said second portion of the scene area;
changing the angle of said first light redirection device from said first angle to a second angle to alter a field of view of the first optical chain in a vertical direction;
changing an angle of the second light redirection device to alter a field of view of the second optical chain in the vertical direction;
changing an angle of the third light redirection device to alter a field of view of the third optical chain in the vertical direction;
operating the first, second and third optical chains to capture fourth, fifth and sixth images, respectively; and
generating a composite image from said first, second, third, fourth, fifth, and sixth images.
2. The method of claim 1 , further comprising:
generating video from images captured by at least said first optical chain at different time periods, said video including a sequence of frames including at least one frame generated by combining images, corresponding to different vertical portions of the scene area, captured by said first optical chain at different times.
3. The method of claim 1 ,
wherein said first, second and third images are captured during a first period and
wherein the fourth, fifth and sixth images are captured during a second period of time, the method further comprising:
maintaining the position of the camera device throughout said first and second periods of time.
4. The method of claim 3 , wherein the first, second, and third images correspond to first, second and third portions of a scene which are above said fourth, fifth and sixth portions of the scene.
5. The method of claim 1 ,
wherein generating a composite image from said first, second, third, fourth, fifth and sixth images includes:
incorporating at least a part of said first, second and third images into said composite image.
6. The method of claim 1 , further comprising:
controlling light redirection device movement as a function of a video frame capture rate.
7. The method of claim 6 , wherein controlling light redirection device movement as a function of the video frame capture rate includes moving the first light redirection device of the first optical chain so that z different images are captured per video frame, where z corresponds to the number of images captured by the first optical chain that are used to generate said composite image.
8. The method of claim 1 , wherein the first, second and third images correspond to a first capture time and the fourth, fifth and sixth images correspond to a second capture time.
9. The method of claim 8 , wherein the camera device is maintained in the same position for said first and second capture times.
10. A camera device comprising:
a first optical chain including a first light redirection device, said first light redirection device being movable to different angles to change a field of view of the first optical chain in a vertical direction;
a second optical chain including a second light redirection device, said second light redirection device being movable to different angles to change a field of view of the second optical chain in a vertical direction;
a third optical chain including a third light redirection device, said third light redirection device being movable to different angles to change a field of view of the third optical chain in a vertical direction;
a light redirection device control module configured to determine i) a first set of light redirection device angles to be used to control the positions of the first, second and third light redirection devices during a first image capture time period and ii) a second different set of light redirection device angles to be used to control the positions of the first, second and third light redirection devices during a second image capture time period, and wherein said second different set of light redirection device angles correspond to fields of view of the first, second and third optical chains which are offset in the vertical direction from fields of view of the first, second and third optical chains, respectively, when the first set of light redirection device angles is used to control the positions of the first, second and third light redirection devices;
an image capture control module configured to:
operate the first optical chain to capture a first image including a first portion of a scene area during the first image capture time period, operate the second optical chain to capture a second image including a second portion of the scene area that is horizontally adjacent said first portion of the scene area, operate the third optical chain during the first image capture time period to capture a third image including a third portion of the scene area, said third portion of the scene area being horizontally adjacent said second portion of the scene area; and
operate the first optical chain to capture a fourth image including a fourth portion of a scene area during a second image capture time period in which the second different set of light redirection device angles is used, operate the second optical chain during said second image capture time period to capture a fifth image including a fifth portion of the scene area that is horizontally adjacent said fourth portion of the scene area, and operate the third optical chain during the second image capture time period to capture a sixth image including a sixth portion of the scene area, said sixth portion of the scene area being horizontally adjacent said fifth portion of the scene area; and
a composite image generation module configured to generate a composite image from said first, second, third, fourth, fifth and sixth images.
11. The camera device of claim 10 , wherein said first, second and third images are captured during the first image capture time period, the camera device further comprising:
a stability control module configured to maintain camera stability throughout the first image capture time period and the second image capture time period.
12. The camera device of claim 11 , wherein the first second, and third images correspond to portions of a scene area of interest above portions of the scene area of interest obtained from said fourth, fifth and sixth images.
13. The camera device of claim 11 , wherein said composite image generation module is configured to generate a composite image from said first, second, third, fourth, fifth, and sixth images by incorporating at least a part of said first image corresponding to said first scene area portion into said composite image and at least a part of said second image corresponding to said second scene area portion into said composite image.
14. The camera device of claim 10 , further comprising:
a light redirection device movement timing control module configured to control light redirection device movement as a function of a video frame capture rate.
15. The camera device of claim 14 , wherein said light redirection device movement timing control module controls light redirection device movement as a function of the video capture rate to move the light redirection device so that z different images are captured per video frame, where z corresponds to the number of images captured by the first optical chain to generate a single composite video frame.
16. The camera device of claim 10 , wherein the composite image generation module is further configured to generate said composite image by using a portion of said third image which corresponds to a scene area portion above a scene area portion corresponding to said sixth image.
17. The camera device of claim 13 , wherein the camera device is maintained in the same position for the first and second image capture time periods.
18. The camera device of claim 10 , wherein the camera device is maintained in the same position for said first and second image capture time periods.
19. A non-transitory computer readable medium comprising processor executable instructions which when executed by a processor control a camera device to perform the steps of:
operate a first optical chain of a camera device including a first light redirection device set at a first angle to capture a first image including a first portion of a scene area;
operate a second optical chain of the camera device including a second light redirection device to capture a second image including a second portion of the scene area that is horizontally adjacent said first portion of the scene area;
operate a third optical chain of the camera device including a third light redirection device to capture a third image including a third portion of the scene area, said third portion of the scene area being horizontally adjacent said second portion of the scene area;
change the angle of said first light redirection device from said first angle to a second angle to alter a field of view of the first optical chain in a vertical direction;
change an angle of the second light redirection device to alter a field of view of the second optical chain in the vertical direction;
change an angle of the third light redirection device to alter a field of view of the third optical chain in the vertical direction;
operate the first, second and third optical chains to capture fourth, fifth and sixth images, respectively; and
generate a composite image from said first, second, third, fourth, fifth and sixth images.