IP Library Patent Application 14965575
Patent Application
App. No. 14/965,575

Stereo Autofocus

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
14/965,575
Abstract

A first image capture component may capture a first image of a scene, and a second image capture component may capture a second image of the scene. There may be a particular baseline distance between the first image capture component and the second image capture component, and at least one of the first image capture component or the second image capture component may have a focal length. A disparity may be determined between a portion of the scene as represented in the first image and the portion of the scene as represented in the second image. Possibly based on the disparity, the particular baseline distance, and the focal length, a focus distance may be determined. The first image capture component and the second image capture component may be set to focus to the focus distance.

Claims (58)

1 . A method comprising:

capturing, by a first image capture component of a stereo camera, a first image of a scene;

capturing, by a second image capture component of the stereo camera, a second image of the scene, wherein there is a particular baseline distance between the first image capture component and the second image capture component, and wherein at least one of the first image capture component or the second image capture component has a focal length;

determining a disparity between a portion of the scene as represented in the first image and the portion of the scene as represented in the second image;

based on the disparity, the particular baseline distance, and the focal length, determining a focus distance; and

setting the first image capture component and the second image capture component to focus to the focus distance.

2 . The method of claim 1 comprising:

capturing, by the first image capture component focused to the focus distance, a third image of a scene;

capturing, by the second image capture component focused to the focus distance, a fourth image of the scene; and

using a combination of the third image and the fourth image to form a stereo image of the scene.

3 . The method of claim 1 , wherein determining the disparity between the portion of the scene as represented in the first image and the portion of the scene as represented in the second image comprises:

identifying a first m×n pixel block in the first image;

identifying a second m×n pixel block in the second image; and

shifting the first m×n pixel block or the second m×n pixel block until the first m×n pixel block and the second m×n pixel block are substantially aligned, wherein the disparity is based on a pixel distance represented by the shift.

4 . The method of claim 3 , wherein shifting the first m×n pixel block or the second m×n pixel block comprises shifting the first m×n pixel block or the second m×n pixel block only on an x axis.

5 . The method of claim 1 , wherein the portion of the scene includes a feature with a corner, and wherein determining the disparity between the portion of the scene as represented in the first image and the portion of the scene as represented in the second image comprises:

detecting the corner in the first image and the second image; and

warping the first image or the second image to the other according to a translation so that the corner in the first image and the second image substantially matches, wherein the disparity is based on a pixel distance represented by the translation.

6 . The method of claim 1 , wherein the first image capture component and the second image capture component have different image capture resolutions.

7 . The method of claim 1 , wherein the focus distance is based on a product of the particular baseline and the focal length divided by the disparity.

8 . The method of claim 1 , wherein the focal value is an integer value selected from a particular range of integer values, wherein the integer values in the particular range are respectively associated with voltages, and wherein the voltages, when applied to the first image capture component and the second image capture component, cause the first image capture component and the second image capture component to focus approximately at the portion of the scene.

9 . The method of claim 8 , wherein setting the first image capture component and the second image capture component to focus to the focus distance comprises applying a voltage associated with the focus distance to each of the first image capture component and the second image capture component.

10 . The method of claim 8 , further comprising:

before capturing the first image and the second image, calibrating the respective associations between the integer values in the particular range and the voltages based on characteristics of the first image capture component and the second image capture component.

11 . The method of claim 1 , wherein each of the first image capture component and the second image capture component comprises respective apertures, lenses, and recording surfaces.

12 . An article of manufacture including a non-transitory computer-readable medium, having stored thereon program instructions that, upon execution by a computing device, cause the computing device to perform operations comprising:

capturing, by a first image capture component, a first image of a scene;

capturing, by a second image capture component, a second image of the scene, wherein there is a particular baseline distance between the first image capture component and the second image capture component, and wherein at least one of the first image capture component or the second image capture component has a focal length;

determining a disparity between a portion of the scene as represented in the first image and the portion of the scene as represented in the second image;

based on the disparity, the particular baseline distance, and the focal length, determining a focus distance; and

setting the first image capture component and the second image capture component to focus to the focus distance.

13 . The article of manufacture of claim 12 , wherein the operations further comprise:

capturing, by the first image capture component focused to the focus distance, a third image of a scene;

capturing, by the second image capture component focused to the focus distance, a fourth image of the scene; and

combining the third image and the fourth image to form a stereo image of the scene.

14 . The article of manufacture of claim 12 , wherein determining the disparity between the portion of the scene as represented in the first image and the portion of the scene as represented in the second image comprises:

identifying a first m×n pixel block in the first image;

identifying a second m×n pixel block in the second image; and

shifting the first m×n pixel block or the second m×n pixel block until the first m×n pixel block and the second m×n pixel block are substantially aligned, wherein the disparity is based on a pixel distance represented by the shift.

15 . The article of manufacture of claim 12 , wherein the portion of the scene includes a feature with a corner, and wherein determining the disparity between the portion of the scene as represented in the first image and the portion of the scene as represented in the second image comprises:

detecting the corner in the first image and the second image; and

warping the first image or the second image to the other according to a translation so that the corner in the first image and the second image substantially matches, wherein the disparity is based on a pixel distance represented by the translation.

16 . The article of manufacture of claim 12 , wherein the focus distance is based on a product of the particular baseline and the focal length divided by the disparity.

17 . The article of manufacture of claim 12 , wherein the focal value is an integer value selected from a particular range of integer values, wherein the integer values in the particular range are respectively associated with voltages, and wherein the voltages, when applied to the first image capture component and the second image capture component, cause the first image capture component and the second image capture component to focus approximately at the portion of the scene.

18 . The article of manufacture of claim 17 , wherein setting the first image capture component and the second image capture component to focus to the focus distance comprises applying a voltage associated with the focus distance to each of the first image capture component and the second image capture component.

19 . The article of manufacture of claim 12 , wherein the operations further comprise:

before capturing the first image and the second image, calibrating the respective associations between the integer values in the particular range and the voltages based on characteristics of the first image capture component and the second image capture component.

20 . A computing device comprising:

a first image capture component;

a second image capture component;

at least one processor;

memory; and

program instructions, stored in the memory, that upon execution by the at least one processor cause the computing device to perform operations comprising:

capturing, by the first image capture component, a first image of a scene;

capturing, by the second image capture component, a second image of the scene, wherein there is a particular baseline distance between the first image capture component and the second image capture component, and wherein at least one of the first image capture component or the second image capture component has a focal length;

determining a disparity between a portion of the scene as represented in the first image and the portion of the scene as represented in the second image;

based on the disparity, the particular baseline distance, and the focal length, determining a focus distance; and

setting the first image capture component and the second image capture component to focus to the focus distance.

Assignments (2)
CHANGE OF NAME Recorded Dec 5, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044695/0115 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 11, 2015
From: WEI, JIANING
To: GOOGLE INC.
Reel/Frame 037270/0259 →