IP Library › Granted Patent US 9,576,218
Granted Patent B2
US 9,576,218 · App. 14/532,625 · Granted Feb 21, 2017

Selecting features from image data

Inventors: Hung Khei Huang (Irvine, CA); Bradley Scott Denney (Irvine, CA)
Assignee: CANON KABUSHIKI KAISHA
G06K9/4671
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,576,218
App. No.
14/532,625
Granted
Feb 21, 2017
Kind
B2
Abstract

SIFT features are selected from an input image. A SIFT procedure is applied to the input image to obtain candidate keypoints. For each candidate keypoint, there is calculation of a first Laplacian value (L u ) for pixels in an upper Scale Space and a second Laplacian value (L l ) for pixels in a lower Scale Space, based on the position of the candidate keypoint. A candidate keypoint is discarded if a Laplacian value L c of the keypoint position is less than or equal to either of L u or L l . In the case that the candidate keypoint is not discarded, the candidate keypoint's Laplacian strength (L s ) is calculated, based on a relative change in Laplacian value from L c to L u and from L c to L l . One or more candidate keypoints are selected as SIFT features based on the corresponding Laplacian strength.

Claims (38)

1. A method for selecting SIFT features from an input image, the method comprising:

applying a SIFT procedure to the input image to obtain candidate keypoints;

calculating, for each candidate keypoint, a first Laplacian value (Lu) for pixels in an upper Scale Space and a second Laplacian value (Ll) for pixels in a lower Scale Space, based on the position of the candidate keypoint;

discarding a candidate keypoint if a Laplacian value Lc of the keypoint position is less than or equal to either of Lu or Ll;

calculating, in the case that the candidate keypoint is not discarded, the candidate keypoint's Laplacian strength (Ls) based on a relative change in Laplacian value from Lc to Lu and from Lc to Ll; and

selecting one or more candidate keypoints as SIFT features based on the corresponding Laplacian strength.

2. The method according to claim 1 , wherein Ls is calculated at least in part from Lu and one or more of Lc/Lu and Lc/Ll.

3. The method according to claim 2 , wherein Ls is calculated by Ls=(((Lc−Ll)/Ll)+((Lc−Lu)/Lu))/2.

4. The method according to claim 2 , wherein Ls is calculated by Ls=[Lc−max(Ll, Lu)]/max(Ll, Lu).

5. The method according to claim 2 , wherein Ls is calculated by Ls=[Lc −min(Ll, Lu)]/min(Ll, Lu).

6. The method according to claim 2 , wherein Ls is calculated by Ls=Lc/max(Ll, Lu).

7. The method according to claim 1 , wherein the candidate keypoint is added to a list of keypoints sorted by descending Laplacian strength.

8. The method according to claim 7 , wherein the selection comprises selecting a number of top ranked keypoints from the list.

9. The method according to claim 8 , wherein the number of keypoints selected from the list is a specified percentage of the total number of keypoints.

10. The method according to claim 8 , wherein the number of keypoints selected from the list is a predetermined fixed maximum number of keypoints.

11. The method according to claim 10 , wherein the predetermined fixed maximum number of keypoints is based on user input.

12. The method according to claim 1 , wherein the selected keypoints are used to search for a corresponding image.

13. An apparatus for selecting SIFT features from an input image, comprising:

a computer-readable memory constructed to store computer-executable process steps; and

a processor constructed to execute the process steps stored in the memory,

wherein the process steps cause the processor to:

apply a SIFT procedure to the input image to obtain candidate keypoints;

calculate, for each candidate keypoint, a first Laplacian value (Lu) for pixels in an upper Scale Space and a second Laplacian value (Ll) for pixels in a lower Scale Space, based on the position of the candidate keypoint;

discard a candidate keypoint if a Laplacian value Lc of the keypoint position is less than or equal to either of Lu or Ll;

calculate, in the case that the candidate keypoint is not discarded, the candidate keypoint's Laplacian strength (Ls) based on a relative change in Laplacian value from Lc to Lu and from Lc to Ll; and

select one or more candidate keypoints as SIFT features based on the corresponding Laplacian strength.

14. The apparatus according to claim 13 , wherein Ls is calculated at least in part from Lu and one or more of Lc/Lu and Lc/ Ll.

15. The apparatus according to claim 14 , wherein Ls is calculated by Ls=(((Lc−Ll)/Ll)+((Lc−Lu)/Lu))/2.

16. The apparatus according to claim 14 , wherein Ls is calculated by Ls=[Lc−max(Ll, Lu)]/max(Ll, Lu).

17. The apparatus according to claim 14 , wherein Ls is calculated by Ls=[Lc−min(Ll, Lu)]/min(Ll, Lu).

18. The apparatus according to claim 14 , wherein Ls is calculated by Ls=Lc/max(Ll, Lu).

19. The apparatus according to claim 13 , wherein the candidate keypoint is added to a list of keypoints sorted by descending Laplacian strength.

20. A non-transitory computer-readable storage medium storing computer-executable process steps for causing a machine to perform a method for selecting SIFT features from an input image, the method comprising:

applying a SIFT procedure to the input image to obtain candidate keypoints;

calculating, for each candidate keypoint, a first Laplacian value (Lu) for pixels in an upper Scale Space and a second Laplacian value (Ll) for pixels in a lower Scale Space, based on the position of the candidate keypoint;

discarding a candidate keypoint if a Laplacian value Lc of the keypoint position is less than or equal to either of Lu or Ll;

calculating, in the case that the candidate keypoint is not discarded, the candidate keypoint's Laplacian strength (Ls) based on a relative change in Laplacian value from Lc to Lu and from Lc to Ll; and

selecting one or more candidate keypoints as SIFT features based on the corresponding Laplacian strength.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 4, 2014
From: HUANG, HUNG KHEI; DENNEY, BRADLEY SCOTT
To: CANON KABUSHIKI KAISHA
Reel/Frame 034101/0276 →
Continuity (1)
Related Publication 20160125260A1 · May 5, 2016