IP Library Granted Patent US 11,748,442
Granted Patent B2
US 11,748,442 · App. 17/049,460 · Granted Sep 5, 2023

Image matching device

Inventors: Toru Takahashi (Tokyo, JP); Rui Ishiyama (Tokyo, JP)
Assignee: NEC CORPORATION
G06F17/141G06F17/156G06F18/22G06V10/431G06V10/75G06F2218/14
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,748,442
App. No.
17/049,460
Granted
Sep 5, 2023
Kind
B2
Abstract

An image matching device includes a weight determination unit and a matching unit. Based on a synthesized frequency characteristic obtained by synthesizing a frequency characteristic of a first image with a frequency characteristic of a second image and an ideal synthesized frequency characteristic that is an ideal one obtained by synthesizing the frequency characteristic of the first image with the frequency characteristic of the second image, the weight determination unit determines a weight relating to frequency in performing matching of the first image and a third image. The matching unit performs matching of the first image and the third image based on the determined weight.

Claims (21)

1. An image matching device comprising:

a weight determination unit configured to determine a weight relating to frequency based on a difference between a synthesized frequency characteristic and an ideal synthesized frequency characteristic, the synthesized frequency characteristic being obtained by synthesizing a frequency characteristic of a first image with a frequency characteristic of a second image, the ideal synthesized frequency characteristic being an ideal one obtained by synthesizing the frequency characteristic of the first image with the frequency characteristic of the second image, the weight relating to frequency being used in performing matching of the first image and a third image; and

a matching unit configured to perform matching of the first image and the third image based on the determined weight.

2. The image matching device according to claim 1 , wherein the weight determination unit is configured to estimate a complex sine wave having a single period as the ideal synthesized frequency characteristic from the synthesized frequency characteristic.

3. The image matching device according to claim 2 , wherein the weight determination unit is configured to calculate a first correlation coefficient map by applying inverse Fourier transformation to the synthesized frequency characteristic, calculate a second correlation coefficient map by processing the first correlation coefficient map, and calculate the ideal synthesized frequency characteristic by applying Fourier transformation to the second correlation coefficient map.

4. The image matching device according to claim 2 , wherein the weight determination unit is configured to calculate a correlation coefficient map by applying inverse Fourier transformation to the synthesized frequency characteristic, calculate a position on real space in which a correlation coefficient is maximum from the correlation coefficient map, and calculate the ideal synthesized frequency characteristic based on the position and a previously determined equation that gives the ideal synthesized frequency characteristic.

5. The image matching device according to claim 2 , wherein the weight determination unit is configured to calculate an approximate plane that fits a phase angle of each element of the synthesized frequency characteristic, and calculate the ideal synthesized frequency characteristic based on a slope of the approximate plane and an equation that gives the ideal synthesized frequency characteristic.

6. The image matching device according to claim 2 , wherein the weight determination unit is configured to calculate an approximate phase angle gradient that represents a phase angle gradient of each element of the synthesized frequency characteristic, and calculate the ideal synthesized frequency characteristic based on the approximate phase angle gradient and an equation that gives the ideal synthesized frequency characteristic.

7. The image matching device according to claim 2 , wherein the weight determination unit is configured to calculate gradient data of each element of the synthesized frequency characteristic, and calculate the ideal synthesized frequency characteristic based on the gradient data and an equation that gives the ideal synthesized frequency characteristic.

8. The image matching device according to claim 1 , wherein the weight determination unit is configured to determine the weight based on a difference for each element between the synthesized frequency characteristic and the ideal synthesized frequency characteristic.

9. The image matching device according to claim 1 , wherein the matching unit is configured to calculate a synthesized frequency characteristic obtained by synthesizing the frequency characteristic of the first image with a frequency characteristic of the third image based on the weight.

10. The image matching device according to claim 9 , wherein the matching unit is configured to detect a peak of a correlation coefficient map obtained by applying inverse Fourier transformation to the synthesized frequency characteristic calculated based on the weight.

11. The image matching device according to claim 9 , wherein the matching unit is configured to determine a distribution shape in frequency domain of the synthesized frequency characteristic calculated based on the weight.

12. The image matching device according to claim 1 , wherein the matching unit is configured to acquire the frequency characteristic of the first image and a frequency characteristic of the third image based on the weight.

13. The image matching device according to claim 1 , wherein the synthesized frequency characteristic is a normalized cross power spectrum.

14. An image matching method comprising:

determining a weight relating to frequency based on a difference between a synthesized frequency characteristic and an ideal synthesized frequency characteristic, the synthesized frequency characteristic being obtained by synthesizing a frequency characteristic of a first image with a frequency characteristic of a second image, the ideal synthesized frequency characteristic being an ideal one obtained by synthesizing the frequency characteristic of the first image with the frequency characteristic of the second image, the weight relating to frequency being used in performing matching of the first image and a third image; and

performing matching of the first image and the third image based on the determined weight.

15. A non-transitory computer-readable recording medium having a program recorded thereon, the program comprising instructions for causing a computer to function as:

a weight determination unit configured to determine a weight relating to frequency based on a difference between a synthesized frequency characteristic and an ideal synthesized frequency characteristic, the synthesized frequency characteristic being obtained by synthesizing a frequency characteristic of a first image with a frequency characteristic of a second image, the ideal synthesized frequency characteristic being an ideal one obtained by synthesizing the frequency characteristic of the first image with the frequency characteristic of the second image, the weight relating to frequency being used in performing matching of the first image and a third image; and

a matching unit configured to perform matching of the first image and the third image based on the determined weight.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2022
From: TAKAHASHI, TORU; ISHIYAMA, RUI
To: NEC CORPORATION
Reel/Frame 061410/0390 →
Continuity (1)
Related Publication 20210256254A1 · Aug 19, 2021