IP Library Granted Patent US 12,182,196
Granted Patent B2
US 12,182,196 · App. 17/640,687 · Granted Dec 31, 2024

Image retrieval system, image retrieval method, and storage medium

Inventors: Toru Takahashi (Tokyo, JP); Rui Ishiyama (Tokyo, JP); Kengo Makino (Tokyo, JP)
Assignee: NEC CORPORATION
G06F16/583G06T7/001G06V10/22G06T2207/30108
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,182,196
App. No.
17/640,687
Granted
Dec 31, 2024
Kind
B2
Abstract

This image retrieval system comprises: a storage means for storing a plurality of registered images capturing a plurality of objects to be registered; an acquisition means for acquiring a retrieval image including a region of interest; an extraction means for extracting a feature amount from a region, in the retrieval image, other than the region of interest; a retrieval means for retrieving, from the plurality of registered images stored in the storage means, a registered image having a feature amount that matches the feature amount extracted by the extraction means; and an output means for outputting, in a manner that makes it possible to recognize a region corresponding to the region of interest in the retrieval image, all or a portion of the registered image retrieved by the retrieval means.

Claims (73)

1. An image retrieval system comprising:

at least one memory storing instructions; and

at least one processor configured to access the at least one memory and execute the instructions to:

store, in a storage, a plurality of registered images obtained by capturing a plurality of objects to be registered;

acquire a retrieval image including a region of interest;

extract a feature from a region other than the region of interest of the retrieval image;

retrieve, from the plurality of registered images stored in the storage, a registered image having a feature that matches the feature; and

output some or all of the registered images in a mode that a region corresponding to the region of interest in the retrieval image is recognizable.

2. The image retrieval system according to claim 1 , wherein

the at least one processor is further configured to execute the instructions to:

output the some or all of the registered images, by superimposing an image in which the region corresponding to the region of interest of the retrieval image is recognizable.

3. The image retrieval system according to claim 1 , wherein

the at least one processor is further configured to execute the instructions to:

output the some or all of the registered images retrieved by the retrieval means, by superimposing an image in which a region corresponding to the region from which the feature of the retrieval image has been extracted is recognizable.

4. The image retrieval system according to claim 1 , wherein

the at least one processor is further configured to execute the instructions to:

output the registered image retrieved by the retrieval means and an enlarged image of the region in the registered image, the region corresponding to the region of interest in the retrieval image.

5. The image retrieval system according to claim 1 , wherein

the at least one processor is further configured to execute the instructions to:

output the some or all of the registered images including the region corresponding to the region of interest of the retrieval image, and the retrieval image.

6. The image retrieval system according to claim 1 , wherein

the at least one processor is further configured to execute the instructions to:

store information associated with each of the plurality of registered images in the storage, and

output the information associated with the registered image.

7. The image retrieval system according to claim 1 , wherein

the at least one processor is further configured to execute the instructions to:

store, in the storage, registered images captured at a plurality of different timings in a distribution process of the objects to be registered,

retrieve, from the plurality of registered images stored in the storage, a registered image at each of the plurality of timings, the registered image having a feature that matches the feature extracted by the extraction means, and

output some or all of the registered images at the plurality of timings in a mode that a region corresponding to the region of interest in the retrieval image is recognizable.

8. The image retrieval system according to claim 1 , wherein

the at least one processor is further configured to execute the instructions to:

specify the region of interest of the retrieval image using the retrieval image.

9. The image retrieval system according to claim 8 , wherein

the at least one processor is further configured to execute the instructions to:

divide the retrieval image into partial regions; and

specify the region of interest by determining presence or absence of a defect in each of the divided partial regions.

10. The image retrieval system according to claim 1 , wherein

the at least one processor is further configured to execute the instructions to:

acquire information designating the region of interest; and

specify the region of interest of the retrieval image based on the information designating the region of interest.

11. The image retrieval system according to claim 1 , wherein

the at least one processor is further configured to execute the instructions to:

extract the feature from a region other than the region of interest, in a predetermined region including the region of interest.

12. The image retrieval system according to claim 1 , wherein

the at least one processor is further configured to execute the instructions to:

extract the feature from a predetermined region adjacent to the region of interest.

13. An image retrieval method comprising:

acquiring a retrieval image including a region of interest;

extracting a feature from a region other than the region of interest of the retrieval image;

retrieving, from a plurality of registered images obtained by capturing a plurality of objects to be registered, a registered image having a feature that matches the extracted feature; and

outputting some or all of the retrieved registered images in a mode that a region corresponding to the region of interest in the retrieval image is recognizable.

14. The image retrieval method according to claim 13 , further comprising:

outputting the some or all of the retrieved registered images, by superimposing an image in which the region corresponding to the region of interest of the retrieval image is recognizable.

15. The image retrieval method according to claim 13 , further comprising:

outputting the some or all of the retrieved registered images, by superimposing an image in which a region corresponding to the region from which the feature of the retrieval image has been extracted is recognizable.

16. The image retrieval method according to claim 13 , further comprising:

outputting the retrieved registered image and an enlarged image of the region in the retrieved registered image, the region corresponding to the region of interest in the retrieval image.

17. The image retrieval method according to claim 13 , further comprising:

outputting the some or all of the registered images including the region corresponding to the region of interest of the retrieval image, and the retrieval image.

18. The image retrieval method according to claim 13 , wherein

the image retrieval method further comprising:

storage, in a storage, information associated with each of the plurality of registered images; and

outputting the information associated with the retrieved registered image.

19. The image retrieval method according to claim 13 , wherein

the image retrieval method further comprising:

storing registered images captured at a plurality of different timings in a distribution process of the objects to be registered in a storage;

retrieving, from the plurality of registered images stored in the storage, a registered image at each of the plurality of timings, the registered image having a feature that matches the extracted feature; and

outputting some or all of the retrieved registered images at the plurality of timings in a mode that a region corresponding to the region of interest in the retrieval image is recognizable.

20. A non-transitory storage medium storing a program for causing a computer to function as:

an acquisition means configured to acquire a retrieval image including a region of interest;

an extraction means configured to extract a feature from a region other than the region of interest of the retrieval image;

a retrieval means configured to retrieve, from a plurality of registered images obtained by capturing a plurality of objects to be registered and stored in a storage means, a registered image having a feature that matches the feature extracted by the extraction means; and

an output means configured to output some or all of the registered images retrieved by the retrieval means in a mode that a region corresponding to the region of interest in the retrieval image is recognizable.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 17, 2022
From: TAKAHASHI, TORU; ISHIYAMA, RUI; MAKINO, KENGO
To: NEC CORPORATION
Reel/Frame 061809/0955 →
Continuity (1)
Related Publication 20220327157A1 · Oct 13, 2022
Cited By (1)
US 12,541,841