IP Library › Granted Patent US 10,192,136
Granted Patent B2
US 10,192,136 · App. 15/298,862 · Granted Jan 29, 2019

Image processing apparatus and image processing method

Inventors: Takayuki Sawada (Numazu Shizuoka, JP); Yuishi Takeno (Numazu Shizuoka, JP)
Assignee: TOSHIBA TEC KABUSHIKI KAISHA
G06K9/4671G06T7/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,192,136
App. No.
15/298,862
Granted
Jan 29, 2019
Kind
B2
Abstract

An image processing apparatus and an image processing method notify a user of an object region from which an object cannot be recognized. The image processing apparatus includes an interface and a processor. The interface receives an input image. The processor extracts a first target object region from the input image and reads first identification information from the first target object region. If the first identification information fails to be read, the processor outputs an output image which includes the first target region and information representing read failure of the first target region.

Claims (54)

1. A checkout device comprising:

a camera which captures an input image of a product;

a display device; and

a processor programmed to:

identify a first target object region in the input image,

determine whether first identification information can be extracted from the first target object region,

in response to the first identification information not being able to be extracted:

output an output image including the first target object region and information indicating that identification information cannot be extracted from the first target object region, and

control the display device to display the output image on the input image,

in response to the first identification information being able to be extracted, register a product corresponding to the first identification information, and

perform a settlement processing for each product registered in a transaction.

2. The checkout device according to claim 1 , wherein the processor is further programmed to:

identify a second target object region from the input image,

determine whether second identification information can be extracted from the second target object region, and

if the second identification information can be extracted from the second target object region;

control the display device to display the output image further including the second target object region and information indicating that identification information can be extracted from the second target object region, and

register a product corresponding to the second identification information.

3. The checkout device according to claim 1 , wherein the processor is further programmed to

determine whether a target object in the first target object region is a natural object if the first identification information cannot be extracted from the first target object region,

identify the target object in the first target object region by object recognition if the target object is determined to be the natural object, and

control the display device to display the output image if the target object is not determined to be the natural object.

4. The checkout device according to claim 3 , wherein the natural object is a vegetable or a fruit.

5. The checkout device according to claim 3 , wherein the target object is a commercial product.

6. The checkout device according to claim 5 , wherein the processor is further programmed to:

obtain product information on the target object based on the first identification information if the first identification information can be extracted from the first target object region, and

control the display device to display a product information image including at least part of the product information.

7. The checkout device according to claim 6 , wherein the product information includes a price of the target object, and the processor is programmed to perform the settlement processing with respect to the target object based on the product information.

8. The checkout device according to claim 7 , wherein the processor is programmed to not perform the settlement processing with respect to the target object if identification information cannot be extracted from at least one target object region.

9. A checkout method comprising:

receiving an input image of a product;

identifying a first target object region from the input image;

determining whether first identification information can be extracted from the first target object region;

in response to the first identification information cannot not being able to be extracted:

outputting an output image including the first target object region and

information indicating that identification information cannot be extracted from the first target object region, and

controlling a display device to display the output image on the input image;

in response to the first identification information being able to be extracted, registering a product corresponding to the first identification information; and

performing a settlement processing for each product registered in connection with one transaction.

10. The checkout method according to claim 9 , further comprising:

identifying a second target object region from the input image;

determining whether second identification information can be extracted from the second target object region; and

if the second identification information can be extracted from the second target object region:

controlling the display device to display the output image further including the second target object region and information indicating that identification information can be extracted from the second target object region, and

registering a product corresponding to the second identification information.

11. The checkout method according to claim 9 , further comprising:

determining whether a target object in the first target object region is a natural object if the first identification information cannot be extracted from the first target object region;

identifying the target object in the first target object region by object recognition if the target object is determined to be the natural object; and

controlling the display device to display the output image if the target object is not determined to be the natural object.

12. The checkout method according to claim 11 , wherein the target object is a commercial product, the method further comprising:

obtaining product information on the target object based on the first identification information if the first identification information can be extracted from the first target object region; and

control the display device to display a product information image including at least part of the product information.

13. The checkout method according to claim 12 , wherein:

the product information includes a price of the target object, and

the settlement processing with respect to the target object is performed based on the product information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 20, 2016
From: SAWADA, TAKAYUKI; TAKENO, YUISHI
To: TOSHIBA TEC KABUSHIKI KAISHA
Reel/Frame 040437/0164 →
Continuity (1)
Related Publication 20180114322A1 · Apr 26, 2018
Cited By (2)
US 12,211,281 US 12,266,183