Granted Patent B2

US 8,611,584 · App. 12/542,577 · Granted Dec 17, 2013

Inventors: Edward Teoh (Subang Jaya, MY); Willie Song (Bayan Lepas, MY)

Assignee: Avago Technologies General IP (Singapore) Pte. Ltd.

Abstract

Claims (33)

1. A system for performing optical navigation comprising:

an image sensor having an array of photosensitive elements configured to capture frames of image data of a navigation surface;

a feature detector operably connected to the image sensor to receive a particular frame of image data of the navigation surface, the feature detector being configured to determine whether the particular frame of image data includes a portion with prominent trackable features, the portion of the particular frame of image data including fewer pixels than the particular frame of image data; and

a cross-correlator operably connected to the feature detector and the image sensor, the cross-correlator being configured to cross-correlate the particular frame of image data with another frame of image data using every pixel of the particular frame of image data and the another frame of image data if the feature detector determines that the particular frame of image data does not include the portion with the prominent trackable features, the cross-correlator being further configured to cross-correlate the portion of the particular frame of image data with a corresponding portion of the another frame of image data if the feature detector determines that the particular frame of image data does include the portion with the prominent trackable features, the corresponding portion of the another frame of image data including fewer pixels than the another frame of image data, the results of cross-correlation performed by the cross-correlator being used to estimate displacement with respect to the navigation surface,

wherein the feature detector is configured to determine whether the particular frame of image data includes a second portion with the prominent trackable features, and wherein the cross-correlator is configured to cross-correlator the second portion of the particular frame of image data with a corresponding second portion of the another frame of image data if the feature detector determines that the particular frame of image data includes the second portion with the prominent trackable features.

2. The system of claim 1 wherein the feature detector is configured to determine whether the particular frame of image data includes the portion with the prominent trackable features based on contrast values between adjacent pixels of the particular frame of image data.

3. The system of claim 2 wherein the feature detector is configured to determine whether a target portion of the particular frame of image data is the portion with the prominent trackable features using a cumulative sum of contrast values of the target portion, the target portion of the particular frame of image data being determined by the feature detector to be the portion with the prominent trackable features if the cumulative sum of contrast values of the target portion exceeds a threshold value and no other portion of the particular frame of image data has a higher cumulative sum of contrast values than the cumulative sum of contrast values of the target portion.

4. The system of claim 1 wherein the particular frame of image data is an N×N pixel frame of image data and the portion with the prominent trackable features is an M×M pixel portion, where M is less than N.

5. The system of claim 4 wherein the particular frame of image data is a 19×19 pixel frame of image data and the portion with the prominent trackable features is a 7×7 pixel portion.

6. The system of claim 1 wherein the cross-correlator is configured to interpolate the results of cross-correlation of the portion of the particular frame of image data with the corresponding portion of the another frame of image data with the results of cross-correlation of the second portion of the particular frame of image data with the corresponding second portion of the another frame of image data.

7. The system of claim 6 wherein the particular frame of image data is a 19×19 pixel frame of image data and the portion and the second portion with the prominent trackable features are 7×7 pixel portions.

8. A method for performing optical navigation, the method comprising:

capturing frames of image data of a navigation surface;

determining whether a particular frame of image data of the navigation surface includes a portion with prominent trackable features, the portion of the particular frame of image data including fewer pixels than the particular frame of image data;

if the particular frame of image data does not include the portion with the prominent trackable features, cross-correlating the particular frame of image data with another frame of image data using every pixel of the particular frame of image data and the another frame of image data;

if the particular frame of image data does include the portion with the prominent trackable features, cross-correlating the portion of the particular frame of image data with a corresponding portion of the another frame of image data, the corresponding portion of the another frame of image data including fewer pixels than the another frame of image data; and

generating displacement values based on the results of the cross-correlating of the particular frame of image data with the another frame of image data or the cross-correlating of the portion of the particular frame of image data with the corresponding portion of the another frame of image data, the displacement values being an estimate of displacement with respect to the navigation surface,

wherein the determining whether the particular frame of image data includes the portion with the prominent trackable features includes determining whether the particular frame of image data includes a second portion with the prominent trackable features, and wherein the cross-correlating the portion of the particular frame of image data with the corresponding portion of the another frame of image data includes cross-correlating the second portion of the particular frame of image data with a corresponding second portion of the another frame of image data.

9. The method of claim 8 wherein the determining whether the particular frame of image data includes the portion with the prominent trackable features includes determining whether the particular frame of image data includes the portion with the prominent trackable features based on contrast values between adjacent pixels of the particular frame of image data.

10. The method of claim 9 wherein the determining whether the particular frame of image data includes the portion with the prominent trackable features includes determining whether a target portion of the particular frame of image data is the portion with the prominent trackable features using a cumulative sum of contrast values of the target portion, the target portion of the particular frame of image data being determined to be the portion with the prominent trackable features if the cumulative sum of contrast values of the target portion exceeds a threshold value and no other portion of the particular frame of image data has a higher cumulative sum of contrast values than the cumulative sum of contrast values of the target portion.

11. The method of claim 8 wherein the particular frame of image data is an N×N pixel frame of image data and the portion with the prominent trackable features is an M×M pixel portion, where M is less than N.

12. The method of claim 11 wherein the particular frame of image data is a 19×19 pixel frame of image data and the portion with the prominent trackable features is a 7×7 pixel portion.

13. The method of claim 8 further comprising interpolating the results of cross-correlation of the portion of the particular frame of image data with the corresponding portion of the another frame of image data with the results of cross-correlation of the second portion of the particular frame of image data with the corresponding second portion of the another frame of image data.

14. The method of claim 13 wherein the particular frame of image data is a 19×19 pixel frame of image data and the portion and the second portion with the prominent trackable features are 7×7 pixel portions.

15. A method for performing optical navigation, the method comprising:

capturing frames of image data of a navigation surface;

determining whether a particular frame of image data of the navigation surface includes a portion with prominent trackable features, the particular frame of image data being an N×N pixel frame of image data and the portion of the particular frame of image data being an M×M pixel portion, where M is less than N;

if the particular frame of image data does not include the portion with the prominent trackable features, cross-correlating the particular frame of image data with another frame of image data using every pixel of the particular frame of image data and the another frame of image data;

if the particular frame of image data does include the portion with the prominent trackable features, cross-correlating the portion of the particular frame of image data with a corresponding portion of the another frame of image data, the corresponding portion of the another frame of image data including fewer pixels than the another frame of image data; and

generating displacement values based on the results of the cross-corrleating of the particular frame of image data with the another frame of image data or the cross-correlating of the portion of the particular frame of image data with the corresponding portion of the another frame of image data, the displacement values being an estimate of displacement with respect to the navigation surface,

wherein the determining whether the particular frame of image data includes the portion with the prominent trackable features includes determining whether the particular frame of image data includes a second portion with the prominent trackable features, and wherein the cross-correlating the portion of the particular frame of image data with the corresponding portion of the another frame of image data includes cross-correlating the second portion of the particular frame of image data with a corresponding second portion of the another frame of image data.

16. The method of claim 15 wherein the determining whether the particular frame of image data includes the portion with the prominent trackable features includes determining whether the particular frame of image data includes the portion with the prominent trackable features based on contrast values between adjacent pixels of the particular frame of image data.

17. The method of claim 16 wherein the determining whether the particular frame of image data includes the portion with the prominent trackable features includes determining whether a target portion of the particular frame of image data is the portion with the prominent trackable features using a cumulative sum of contrast values of the target portion, the target portion of the particular frame of image data being determined to be the portion with the prominent trackable features if the cumulative sum of contrast values of the target portion exceeds a threshold value and no other portion of the particular frame of image data has a higher cumulative sum of contrast values than the cumulative sum of contrast values of the target portion.

Assignments (8)

Continuity (1)