IP Library › Granted Patent US 10,579,962
Granted Patent B2
US 10,579,962 · App. 15/506,299 · Granted Mar 3, 2020

Information processing apparatus, control method, and program

Inventors: Yoshihiro Itou (Tokyo, JP); Kanako Taga (Tokyo, JP); Takenobu Kitahara (Tokyo, JP)
Assignee: NEC CORPORATION
G06Q10/087B65G1/137G06K9/00671G06K9/3241
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,579,962
App. No.
15/506,299
Filed
Feb 24, 2017
Granted
Mar 3, 2020
Kind
B2
Art Unit
3687
USPC
705/28
Abstract

An information processing apparatus ( 2000 ) includes a product recognition unit ( 2020 ), a shelf label recognition unit ( 2040 ), and a determination unit ( 2060 ). The product recognition unit ( 2020 ) recognizes the number of types of products or positions of each type of products from a target image. The shelf label recognition unit ( 2040 ) recognizes the number or positions of shelf labels indicating information of the products from the target image. The determination unit ( 2060 ) determines whether or not there is an error in a relationship between the recognized number of types of products and the recognized number of shelf labels or in a relationship between the recognized positions of each type of products and the recognized positions of the shelf labels.

Claims (51)

1. An information processing apparatus comprising:

at least one memory configured to store instructions; and

at least one processor configured to execute the instructions to:

receive an image captured by a camera;

recognize a position of a first product and a second product from the image on which a plurality of products and a shelf label are imaged;

recognize the shelf label indicating information of each product from the image;

determine a pricing error based on a first distance from the first product to the shelf label and a second distance from the second product to the shelf label; and

control a display monitor to display the image including the recognized first product or the second product corresponding to a sold out error and the recognized shelf label corresponding to the pricing error, the recognizing shelf label being highlighted in the image.

2. A control method performed by a computer, the method comprising:

receiving an image captured by a camera;

recognizing a position of a first product and a second product from the image on which a plurality of products and a shelf label are imaged;

recognizing the shelf label indicating information of each product from the image;

determining a pricing error based on a first distance from the first product to the shelf label and a second distance from the second product to the shelf label; and

displaying the image including the recognized first product or the second product corresponding to a sold out error and the recognized shelf label corresponding to the pricing error, the recognized shelf label being highlighted in the image.

3. A non-transitory computer-readable storage medium storing a program causing a computer to operate as the information processing apparatus according to claim 1 .

4. An information processing apparatus comprising:

at least one memory stored instructions; and

at least one processor configured to execute the instructions to:

receive an image captured by a camera on which a plurality of products and a plurality of shelf labels are imaged;

recognize a first number of a first product and a second number of second product, among the plurality of products, from the image;

recognize a number of a shelf label, among the plurality of shelf labels from the image, each of the plurality of shelf labels indicating information corresponding to each of the plurality of products;

determine a pricing error based on a first distance from the product to the shelf label and a second distance from the second product to the shelf label; and

control a display monitor to display the image including the recognized number of the first product or the second product corresponding to a sold out error and the recognized number shelf label corresponding to the error, the recognized number of the shelf label being highlighted in the image.

5. The information processing apparatus according to claim 4 ,

wherein the at least one processor configured to:

recognize positions of each type of products, among the plurality of products;

recognize positions of the plurality of shelf labels;

determine the error based on a relationship between the recognized positions of said each type of products and the recognized positions of the shelf labels.

6. The information processing apparatus according to claim 5 ,

wherein the at least one processor configured to:

recognize each of the type of products based on similar feature values of each product.

7. The information processing apparatus according to claim 4 ,

wherein the at least one processor configured to:

display the image including a store location of a product associated with the recognized number of the first product or the second product corresponding to the sold out error and a store location of a shelf label associated with the recognized number of the shelf label corresponding to the pricing error.

8. The information processing apparatus according to claim 1 ,

wherein the at least one processor configured to:

display the image including the recognized first product or the second product corresponding to the sold out error and the recognized shelf label corresponding to the pricing error, wherein the recognized product and the recognized shelf label are highlighted in the image.

9. The information processing apparatus according to claim 1 ,

wherein the at least one processor configured to:

display the image including a store location of the recognized first product or the second product corresponding to the sold out error and a store location of the recognized shelf label corresponding to the pricing error.

10. The information processing apparatus according to claim 1 ,

wherein the at least one processor configured to:

recognize a coordinate of each of the first product and the second product on the image, by using the image recognition: and

recognize the positions of the first product and the second product based on the recognized coordinate.

11. The information processing apparatus according to claim 1 ,

wherein the at least one processor configured to display the image including an instore location of the recognized product corresponding to the sold out error and an instore location of the recognized shelf label corresponding to the pricing error.

12. The information processing apparatus according to claim 1 , wherein the at least one processor is further configured to determine the pricing error based on a result of a comparison between the first distance and the second distance.

13. The information processing apparatus according to claim 1 , wherein the at least one processor is further configured to:

determine that the first product is not provided with a corresponding shelf label based on a determination that the second distance is smaller than the first distance; and

determine the pricing error based on the determination that the first product is not provided with a corresponding shelf label.

14. The information processing apparatus according to claim 1 , wherein the first distance is from an end portion of the first product to a center of the shelf label and the second distance is from an end portion of the second product to the center of the shelf label.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED ON REEL 041366 FRAME 0489. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT OF ASSIGNORS INTEREST. Recorded Feb 25, 2020
From: ITOU, YOSHIHIRO; TAGA, KANAKO; KITAHARA, TAKENOBU
To: NEC CORPORATION
Reel/Frame 052006/0017 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 24, 2017
From: ITOU, YOSHIHIRO; TAGA, KANAKO; KITAHARA, TAKENOBU
To: NEC COR
Reel/Frame 041366/0489 →
Priority Claims (1)
JP 2014-201363 · Sep 30, 2014 · national
Continuity (1)
Related Publication 20170278056A1 · Sep 28, 2017
Cited By (1)
US 12,694,705