IP Library Granted Patent US 10,510,218
Granted Patent B2
US 10,510,218 · App. 16/071,762 · Granted Dec 17, 2019

Information processing apparatus, information processing method, and non-transitory storage medium

Inventors: Dai Kinno (Tokyo, JP); Kota Iwamoto (Tokyo, JP); Shinichi Matsumoto (Tokyo, JP); Yoshihiro Itou (Tokyo, JP); Shinya Yamasaki (Tokyo, JP); Kanako Taga (Tokyo, JP)
Assignee: NEC Corporation
G07G1/0054A47F9/047G06Q20/208G07G1/00G07G1/0036G07G1/0063G07G1/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,510,218
App. No.
16/071,762
Granted
Dec 17, 2019
Kind
B2
Abstract

A checkout apparatus ( 10 ) includes an image data acquisition unit ( 11 ) that acquires data of an image; an image analysis unit ( 12 ) that recognizes a plurality of products in the image using a feature value of an exterior of each of the products registered in a feature value storage unit ( 14 ) and the data of the image; a reading necessity or non-necessity check unit ( 15 ) that extracts the product for which it is necessary to read a product code from among the recognized products, using an object-to-be-read storage unit ( 16 ) in which the product for which it is necessary to read the product code is registered in advance; and a reading unit ( 17 ) that reads the product code of the product extracted by the reading necessity or non-necessity check unit ( 15 ).

Claims (55)

1. An information processing apparatus comprising:

at least one memory configured to store one or more instructions; and

at least one processor configured to execute the one or more instructions to:

capture an image of a plurality of products with an optical imaging unit;

acquire data of the image comprising exterior features of the plurality of products;

recognize electronically the plurality of products in the image by using the data of the image;

electronically extract a product for which it is necessary to read a product code from among the recognized plurality of products;

read the product code of the extracted product with an optical reader device;

optically output information for specifying the product for which it is necessary to read the product code, wherein the information is output on a position determined based on a position of the product; and

complete a checkout process for the plurality of products using the read product code for the product for which it is necessary to read a product code and the data of the image for the plurality of products for which it is not necessary to read a product code, the checkout process including a registration process for registering a product to at least one cash register.

2. The information processing apparatus according to claim 1 ,

wherein the at least one processor is further configured to:

extract the product code from an area in the image in which the product for which it is necessary to read the product code is shown, and

read the extracted product code.

3. The information processing apparatus according to claim 1 ,

wherein the at least one processor is further configured to:

acquire data of a plurality of images captured from a plurality of directions, and

analyze the data of the plurality of images to extract the product code from the area in the image in which the product for which it is necessary to read the product code is shown.

4. The information processing apparatus according to claim 2 , wherein the at least one processor is further configured to output guidance information of a method of placing the product for which it is necessary to read the product code when the product code cannot be extracted or read.

5. The information processing apparatus according to claim 1 ,

wherein the at least one processor is further configured to project an image for specifying the product for which it is necessary to read the product code on the placement platform or the product.

6. The information processing apparatus according to claim 1 ,

wherein a product for which it is necessary to check attachment information included in the product code is registered in the at least one memory.

7. The information processing apparatus according to claim 6 ,

wherein a product group of the same kind but different volume is registered in the at least one memory.

8. An information processing method performed by a computer, the method comprising:

capturing an image of a plurality of products with an optical imaging unit;

acquiring data of the image comprising exterior features of the plurality of products;

electronically recognizing the plurality of products in the image by using the data of the image;

electronically extracting a product for which it is necessary to read a product code from among the recognized plurality of products;

reading the product code of the extracted product with an optical reader device;

optically outputting information for specifying the product for which it is necessary to read the product code, wherein the information is output on a position determined based on a position of the product; and

completing a checkout process for the plurality of products using the read product code for the product for which it is necessary to read a product code and the data of the image for the plurality of products for which it is not necessary to read a product code, the checkout process including a registration process for registering a product to at least one cash register.

9. A non-transitory storage medium storing a program causing a computer to:

capture an image of a plurality of products with an optical imaging unit;

acquire data of the image comprising exterior features of the plurality of products;

electronically recognize the plurality of products in the image by using the data of the image;

electronically extract a product for which it is necessary to read a product code from among the plurality of recognized products;

read the product code of the extracted product with an optical reader device;

optically output information for specifying the product for which it is necessary to read the product code, wherein the information is output on a position determined based on a position of the product; and

complete a checkout process for the plurality of products using the read product code for the product for which it is necessary to read a product code and the data of the image for the plurality of products for which it is not necessary to read a product code, the checkout process including a registration process for registering a product to at least one cash register.

10. The information processing apparatus according to claim 2 ,

wherein the at least one processor is further configured to:

acquire data of a plurality of images captured from a plurality of directions, and

analyze the data of the plurality of images to extract the product code from the area in the image in which the product for which it is necessary to read the product code is shown.

11. The information processing apparatus according to claim 3 ,

wherein the at least one processor is further configured to output guidance information of a method of placing the product for which it is necessary to read the product code when the product code cannot be extracted or read.

12. The information processing apparatus according to claim 10 ,

wherein the at least one processor is further configured to output guidance information of a method of placing the product for which it is necessary to read the product code when the product code cannot be extracted or read.

13. The information processing apparatus according to claim 2 ,

wherein a product for which it is necessary to check attachment information included in the product code is registered in the at least one memory.

14. The information processing apparatus according to claim 3 ,

wherein a product for which it is necessary to check attachment information included in the product code is registered in the at least one memory.

15. The information processing apparatus according to claim 4 ,

wherein a product for which it is necessary to check attachment information included in the product code is registered in the at least one memory.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 20, 2018
From: KINNO, DAI; IWAMOTO, KOTA; MATSUMOTO, SHINICHI; ITOU, YOSHIHIRO; YAMASAKI, SHINYA; TAGA, KANAKO
To: NEC CORPORATION
Reel/Frame 046416/0711 →
Priority Claims (1)
JP 2016-009602 · Jan 21, 2016 · national
Continuity (1)
Related Publication 20190026999A1 · Jan 24, 2019
Cited By (1)
US 12,555,146