IP Library Granted Patent US 8,094,937
Granted Patent B2
US 8,094,937 · App. 11/736,072 · Granted Jan 10, 2012

System and method for labeling feature clusters in frames of image data for optical navigation

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,094,937
App. No.
11/736,072
Granted
Jan 10, 2012
Kind
B2
Abstract

A system and method for labeling feature clusters in frames of image data for optical navigation uses distances between feature clusters in a current frame of image data and feature clusters in a previous frame of image data to label the feature clusters in the current frame of image data using identifiers associated with the feature cluster in the previous frame of image data that have been correlated with the feature clusters in the current frame of image data.

Claims (31)

1. A method for labeling feature clusters in frames of image data for optical navigation, said method comprising:

electronically capturing beacon light sources in said frames of image data as said feature clusters using an image sensor with an electronic imaging sensor array of an optical navigation system, said frames of image data including a current frame of image data and a previous frame of image data that are captured at different times;

identifying current feature clusters in said current frame of image data;

correlating said current feature clusters in said current frame of image data with previous feature clusters in said previous frame of image data based on distances between said current and previous feature clusters such that a current feature cluster in said current frame of image data and a previous feature cluster in said previous frame of image data that both correspond to the same beacon light source are correlated with each other; and

labeling each of said current feature clusters with an identifier associated with one of said previous feature clusters that has been correlated with that current feature cluster,

wherein at least one of said identifying, said correlating and said labeling is performed by a navigation engine in one of an integrated circuit and a processor of said optical navigation system.

2. The method of claim 1 further comprising computing centroids of said current feature clusters in said current frame of image data, said distances between said current feature clusters and said previous feature clusters being distances between said centroids of said current feature clusters and centroids of said previous feature clusters.

3. The method of claim 1 wherein said identifying includes assigning provisional identifiers for said current feature clusters and wherein said labeling includes replacing a provisional identifier of each of said current feature clusters with said identifier associated with one of said previous feature clusters that has been correlated with that current feature cluster.

4. The method of claim 1 wherein said correlating includes correlating a particular current feature cluster of said current feature clusters with a particular previous feature cluster of said previous feature clusters based on a distance between said particular current and previous feature clusters, said distance between said particular current and previous feature clusters being the shortest distance between any of said current feature clusters and any of said previous feature clusters.

5. The method of claim 4 wherein said correlating includes correlating another current feature cluster of said current feature clusters with another previous feature cluster of said previous feature clusters based on a distance between said another current and previous feature clusters, said distance between said another current and previous feature clusters being the shortest distance between any of said current feature clusters and any of said previous feature clusters excluding said distance between said particular current and previous feature clusters.

6. The method of claim 1 wherein said correlating includes associating one of said current feature clusters with one of said previous feature clusters based on a distance between said one of said current feature clusters and said one of said previous feature clusters, said distance between said one of said current feature clusters and said one of said previous feature clusters being the shortest distance between said one of said current feature clusters and any of said previous feature clusters or between said one of said previous feature clusters and any of said current feature clusters.

7. The method of claim 6 wherein said correlating includes correlating a particular current feature cluster of said current feature clusters with an associated previous feature cluster of said previous feature clusters in which a distance between said particular current feature cluster and said associated previous feature clusters is the longest distance between any associated current and previous feature clusters.

8. The method of claim 7 further comprising marking said particular current feature cluster and said associated previous feature cluster as used so that said particular current feature cluster and said associated previous feature cluster are not considered when correlating another feature cluster of said current feature clusters with another feature cluster of said previous feature clusters.

9. A method for labeling feature clusters in frames of image data for optical navigation, said method comprising:

electronically capturing beacon light sources in said frames of image data as said feature clusters using an image sensor with an electronic imaging sensor array of an optical navigation system, said frames of image data including a current frame of image data and a previous frame of image data that are captured at different times;

identifying current feature clusters in said current frame of image data;

correlating said current feature clusters in said current frame of image data with previous feature clusters in said previous frame of image data based on distances between said current and said previous feature clusters such that a current feature cluster in said current frame of image data and a previous feature cluster in said previous frame of image data that both correspond to the same beacon light source are correlated with each other, including associating each current feature cluster of said current feature clusters with one of said previous feature clusters that is closest to that current feature cluster and correlating a particular current feature cluster of said current feature clusters with an associated previous feature cluster of said previous feature clusters in which a distance between said particular current feature cluster and said associated previous feature cluster is the longest distance between any associated current and previous feature clusters; and

labeling each of said current feature clusters with an identifier associated with one of said previous feature clusters that has been correlated with that current feature cluster,

wherein said identifying, said correlating and said labeling are performed by a navigation engine in one of an integrated circuit and a processor of an optical navigation system.

10. The method of claim 9 further comprising marking said particular current feature cluster and said associated previous feature cluster as used so that said particular current feature cluster and said associated previous feature cluster are not considered when correlating another current feature cluster of said current feature clusters with another previous feature cluster of said previous feature clusters.

11. A system for optical navigation, said system comprising:

an image sensor with an electronic imaging sensor array configured to capture frames of image data, said frames of image data including a current frame of image data and a previous frame of image data that are captured at different times; and

a navigation engine operatively connected to said image sensor, said navigation engine being configured to identify current feature clusters in said current frame of image data and correlate said current feature clusters in said current frame of image data with previous feature clusters in said previous frame of image data based on distances between said current and previous feature clusters such that a current feature cluster in said current frame of image data and a previous feature cluster in said previous frame of image data that both correspond to the same beacon light source are correlated with each other, said navigation engine being further configured to label each of said current feature clusters with an identifier associated with one of said previous feature clusters that has been correlated with that current feature cluster.

12. The system of claim 11 wherein said navigation engine is further configured to compute centroids of said current feature clusters in said current frame of image data, said distances between said current feature clusters and said previous feature clusters being distances between said centroids of said current feature clusters and centroids of said previous feature clusters.

13. The system of claim 11 wherein said navigation engine is configured to assign provisional identifiers to said current feature clusters and replace a provisional identifier of each of said current feature clusters with said identifier associated with one of said previous feature clusters that has been correlated with that current feature cluster.

14. The system of claim 11 wherein said navigation engine is configured to correlate a particular current feature cluster of said current feature clusters with a particular previous feature cluster of said previous feature clusters based on a distance between said particular current and previous feature clusters, said distance between said particular current and previous feature clusters being the shortest distance between any of said current feature clusters and any of said previous feature clusters.

15. The system of claim 14 wherein said navigation engine is configured to correlate another current feature cluster of said current feature clusters with another previous feature cluster of said previous feature clusters based on a distance between said another current and previous feature clusters, said distance between said another current and previous feature clusters being the shortest distance between any of said current feature clusters and any of said previous feature clusters excluding said distance between said particular current and previous feature clusters.

16. The system of claim 11 wherein said navigation engine is configured to associate one of said current feature clusters with one of said previous feature clusters based on a distance between said one of said current feature clusters and said one of said previous feature clusters, said distance between said one of said current feature clusters and said one of said previous feature clusters being the shortest distance between said one of said current feature clusters and any of said previous feature clusters or between said one of said previous feature clusters and any of said current feature clusters.

17. The system of claim 16 wherein said navigation engine is configured to correlate a particular current feature cluster of said current feature clusters with an associated feature cluster of said previous feature clusters in which a distance between said particular current and previous feature clusters is the longest distance between any associated current and previous feature clusters.

18. The system of claim 17 wherein said navigation engine is further configured to mark said particular current feature cluster and said associated previous feature cluster as used so that said particular current feature cluster and said associated previous feature cluster are not considered when correlating another feature cluster of said current feature clusters with another feature cluster of said previous feature clusters.

19. The system of claim 11 further comprising an optical filter positioned in front of said image sensor to selectively transmit light from beacon light sources to capture said beacon light sources as said current feature clusters in said current frame of image data.

Assignments (8)
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Feb 3, 2017
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
Reel/Frame 041710/0001 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Aug 29, 2016
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
Reel/Frame 039862/0129 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 23, 2016
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: PIXART IMAGING INC.
Reel/Frame 039788/0572 →
PATENT SECURITY AGREEMENT Recorded Feb 11, 2016
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 037808/0001 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENT RIGHTS (RELEASES RF 032851-0001) Recorded Feb 2, 2016
From: DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT
To: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
Reel/Frame 037689/0001 →
PATENT SECURITY AGREEMENT Recorded May 8, 2014
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT
Reel/Frame 032851/0001 →
MERGER Recorded May 7, 2013
From: AVAGO TECHNOLOGIES ECBU IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
Reel/Frame 030369/0528 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 21, 2007
From: TEOH, EDWARD KAH CHING; TAN, ZI HAO
To: AVAGO TECHNOLOGIES ECBU IP (SINGAPORE) PTE. LTD.
Reel/Frame 019322/0423 →