IP Library › Granted Patent US 12,424,003
Granted Patent B2
US 12,424,003 · App. 17/586,787 · Granted Sep 23, 2025

Collation device, non-transitory computer readable medium storing program, and collation method

Inventors: Yukari Motosugi (Kanagawa, JP); Ken Sato (Kanagawa, JP); Minoru Oshima (Kanagawa, JP)
Assignee: FUJIFILM Business Innovation Corp.
G06V20/80G06V10/255G06V10/56G06V20/95
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,424,003
App. No.
17/586,787
Granted
Sep 23, 2025
Kind
B2
Abstract

A collation device includes a processor configured to, by executing a program: (a) acquire a photographed image including a collation area provided on an object and a reference position area that serves as a reference for a position of the collation area; (b) detect the reference position area from the photographed image; (c) set a peripheral image area in the photographed image based on the reference position area and predetermined relative coordinates; and (d) detect the collation area in the peripheral image area.

Claims (57)

1. A collation device comprising:

a processor, storing a registered image in association with an identity of a registered object, the registered image acquired by irradiating the registered object with a light source at a predetermined irradiation angle, and configured to, by executing a program:

(a) receive a photographed image including a collation area provided on an object and a reference position area that serves as a reference for a position of the collation area, wherein the photographed image is acquired by photographing the object to be collated by using a mobile terminal as the collation image photographing machine, and at an elevation angle that is formed by a light source, the object, and a camera of the collation image photographing machine used to capture the object;

(b) detect the reference position area from the photographed image;

(c) acquire a peripheral image area from the photographed image based on the reference position area and predetermined relative coordinates; and

determine a color of a background area of the peripheral image area in the photographed image, wherein the color changes depending on the elevation angle, and determine whether the color is appropriate or not by comparing the color with a desired color stored in a memory, wherein the desired color is a color of a background area of the registered object, at an angle at which the registered image was acquired,

repeat processing of the (a) to (c) in a case where the color does not match the desired color using a new photographed image, which is obtained by adjusting the elevation angle, until the color matches the desired color;

(d) detect the collation area in the peripheral image area, wherein the processor is further configured to:

determine an image quality of a random pattern image of the detected collation area is good or not by evaluating a plurality of index values related to the random pattern image and determine whether or not the index values exceed a predetermined threshold,

in a case where the evaluation value of the random pattern image of the detected collation area is equal to or less than the threshold, calculate an evaluation value of an image of the detected collation area, and repeat processing of the (a) to (d) using the new photographed image, and after adjusting an elevation angle to a desired angle in a case where the evaluation value is equal to or less than a threshold, collate the random pattern image with the registered image, and return the collation result to the collation image photographing machine.

2. The collation device according to claim 1 , further comprising:

a display unit,

wherein the processor is configured to:

display a guide indicating the peripheral image area on the display unit.

3. The collation device according to claim 2 , wherein the processor is configured to:

display a guide indicating the collation area on the display unit.

4. The collation device according to claim 3 , wherein the processor is configured to:

after setting the peripheral image area, determine a color or pattern of a background area of the peripheral image area in the photographed image, and repeat processing of the (a) to (c) using the new photographed image after adjusting the elevation angle to the desired angle in a case where the pattern does not match a predetermined condition.

5. The collation device according to claim 2 , wherein the processor is configured to:

after setting the peripheral image area, determine a color or pattern of a background area of the peripheral image area in the photographed image, and repeat processing of the (a) to (c) using the new photographed image after adjusting the elevation angle to the desired angle in a case where the pattern does not match a predetermined condition.

6. The collation device according to claim 2 , wherein the processor is further configured to:

acquire data of the relative coordinates from an external server.

7. The collation device according to claim 1 , wherein the processor is configured to:

after setting the peripheral image area, determine a color or pattern of a background area of the peripheral image area in the photographed image, and repeat processing of the (a) to (c) using the new photographed image after adjusting the elevation angle to the desired angle in a case where the pattern does not match a predetermined condition.

8. The collation device according to claim 7 , wherein the processor is further configured to:

notify a user in a case where the color or pattern matches the predetermined condition.

9. The collation device according to claim 1 , wherein the processor is further configured to:

acquire data of the relative coordinates from an external server.

10. The collation device according to claim 1 , wherein the processor is further configured to:

notify a user in a case where the reference position area is detected.

11. The collation device according to claim 1 ,

wherein the collation area has a specific shape of an ellipse including a circle or a polygon, and

the processor is configured to:

detect the collation area by extracting the specific shape from the peripheral image area.

12. The collation device according to claim 1 ,

wherein the reference position area includes a QR code.

13. A non-transitory computer readable medium storing a program causing a computer processor to execute a process, wherein a registered image in association with an identity of a registered object is stored, and the registered image is acquired by irradiating the registered object with a light source at a predetermined irradiation angle, comprising:

(a) acquiring a photographed image including a collation area provided on an object and a reference position area that serves as a reference for a position of the collation area;

(b) detecting the reference position area from the photographed image;

(c) setting a peripheral image area in the photographed image based on the reference position area and predetermined relative coordinates;

repeating processing of the (a) to (c) in a case where the color does not match the desired color using a new photographed image, which is obtained by adjusting the elevation angle, until the color matches the desired color;

(d) detecting the collation area in the peripheral image area;

determining an image quality of a random pattern image of the detected collation area is good or not by evaluating a plurality of index values related to the random pattern image and determine whether or not the index values exceed a predetermined threshold, and

calculating an evaluation value of an image of the detected collation area, and

repeating processing of the (a) to (d) using a new photographed image after adjusting an elevation angle to a desired angle in a case where the evaluation value is equal to or less than the threshold and acquire a collation image of the new photographed image in which the evaluation value exceeds the threshold, wherein the elevation angle is formed by a light source, the object, and a camera used to capture the object, wherein the photographed image and the new photographed image are captured by the camera, collating the random pattern image with the registered image, and returning the collation result to the collation image photographing machine.

14. The non-transitory computer readable medium according to claim 13 , wherein the program causing the computer processor to execute the process further comprising after setting the peripheral image area, determining a color or pattern of a background area of the peripheral image area in the photographed image, and repeating processing of the (a) to (c) using the new photographed image after adjusting the elevation angle to the desired angle in a case where the pattern does not match a predetermined condition.

15. A collation method, wherein a registered image in association with an identity of a registered object is stored, and the registered image is acquired by irradiating the registered object with a light source at a predetermined irradiation angle, comprising:

(a) acquiring a photographed image including a collation area provided on an object and a reference position area that serves as a reference for a position of the collation area;

(b) detecting the reference position area from the photographed image;

(c) setting a peripheral image area in the photographed image based on the reference position area and predetermined relative coordinates;

repeating processing of the (a) to (c) in a case where the color does not match the desired color using a new photographed image, which is obtained by adjusting the elevation angle, until the color matches the desired color;

(d) detecting the collation area in the peripheral image area;

determining an image quality of a random pattern image of the detected collation area is good or not by evaluating a plurality of index values related to the random pattern image and determine whether or not the index values exceed a predetermined threshold, and

calculating an evaluation value of an image of the detected collation area, and

repeating processing of the (a) to (d) using a new photographed image after adjusting an elevation angle to a desired angle in a case where the evaluation value is equal to or less than the threshold and acquire a collation image of the new photographed image in which the evaluation value exceeds the threshold, wherein the elevation angle is formed by a light source, the object, and a camera used to capture the object, wherein the photographed image and the new photographed image are captured by the camera, collating the random pattern image with the registered image, and returning the collation result to the collation image photographing machine.

16. The collation method according to claim 15 , wherein the method further comprising:

after setting the peripheral image area, determining a color or pattern of a background area of the peripheral image area in the photographed image, and repeating processing of the (a) to (c) using the new photographed image after adjusting the elevation angle to the desired angle in a case where the pattern does not match a predetermined condition.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2022
From: MOTOSUGI, YUKARI; SATO, KEN; OSHIMA, MINORU
To: FUJIFILM BUSINESS INNOVATION CORP.
Reel/Frame 058916/0369 →
Priority Claims (1)
JP 2021-155852 · Sep 24, 2021 · national
Continuity (1)
Related Publication 20230113156A1 · Apr 13, 2023
References Cited (48)
US 5521984A · Denenberg · 1996 [cited by examiner]
US 11501517B2 · Takahashi · 2022 [cited by examiner]
US 20030123715A1 · Uchida · 2003 [cited by examiner]
US 20040234122A1 · Kochi · 2004 [cited by examiner]
US 20070242882A1 · Chiba et al. · 2007 [cited by applicant]
US 20100283883A1 · Sato · 2010 [cited by examiner]
US 20110026810A1 · Hu · 2011 [cited by examiner]
US 20110194776A1 · Nakamura · 2011 [cited by examiner]
US 20120206581A1 · Kanamori · 2012 [cited by examiner]
US 20160300107A1 · Callegari · 2016 [cited by examiner]
US 20170287147A1 · Takahashi · 2017 [cited by examiner]
US 20170323507A1 · Masuda · 2017 [cited by examiner]
US 20180089483A1 · Norimatsu · 2018 [cited by examiner]
US 20180349695A1 · Le Henaff · 2018 [cited by examiner]
US 20190012868A1 · Okada · 2019 [cited by examiner]
US 20190028659A1 · Kawata · 2019 [cited by examiner]
US 20190279377A1 · Takahashi · 2019 [cited by examiner]
US 20190347827A1 · Omori · 2019 [cited by examiner]
US 20200019810A1 · Takahashi · 2020 [cited by examiner]
US 20200057888A1 · Angelakos · 2020 [cited by examiner]
US 20200311365A1 · Cottrill · 2020 [cited by examiner]
US 20200316979A1 · Bud · 2020 [cited by examiner]
US 20200349379A1 · Ross · 2020 [cited by applicant]
US 20200380753A1 · Adachi · 2020 [cited by examiner]
US 20220349827A1 · Kondo · 2022 [cited by examiner]
US 20230071341A1 · Sugiyama · 2023 [cited by examiner]
US 20230098952A1 · Motosugi · 2023 [cited by examiner]
US 20230099580A1 · Sato · 2023 [cited by examiner]
US 20230113156A1 · Motosugi · 2023 [cited by examiner]
US 20230118236A1 · Motosugi · 2023 [cited by examiner]
US 20230377310A1 · Tanaka · 2023 [cited by examiner]
US 20240257544A1 · Takano · 2024 [cited by examiner]
US 20240257547A1 · Hattori · 2024 [cited by examiner]
US 20240371209A1 · Hayashi · 2024 [cited by examiner]
EP 2682912 · 2014 [cited by applicant]
EP 3252720 · 2017 [cited by applicant]
EP 3734506 · 2020 [cited by applicant]
JP 4865204 · 2012 [cited by applicant]
JP 2014029678 · 2014 [cited by applicant]
JP 6751521 · 2020 [cited by applicant]
JP 6813807 · 2021 [cited by applicant]
WO 2006070476 · 2006 [cited by applicant]
WO 2016035774 · 2016 [cited by applicant]
WO 2017010460 · 2017 [cited by applicant]
“Search Report of Europe Counterpart Application”, issued on Aug. 19, 2022, pp. 1-8. [cited by applicant]
“Office Action of Europe Counterpart Application”, issued on Apr. 21, 2023, p. 1-p. 4. [cited by applicant]
“Search Report of Europe Counterpart Application”, issued on Sep. 27, 2023, pp. 1-10. [cited by applicant]
“Notice of Reasons for Refusal of Japan Counterpart Application”, issued on May 27, 2025, with English translation thereof, p. 1-p. 8. [cited by applicant]
Cited By (1)
US 12,561,541