IP Library › Granted Patent US 11,308,516
Granted Patent B2
US 11,308,516 · App. 16/651,675 · Granted Apr 19, 2022

Information processing apparatus, information processing method, and program for identifying whether an advertisement is positioned in association with a product

Inventors: Yaeko Yonezawa (Tokyo, JP); Kaito Horita (Tokyo, JP); Akira Yajima (Tokyo, JP); Mizuto Sekine (Tokyo, JP); Yoshinori Ehara (Kanagawa, JP)
Assignee: NEC CORPORATION
G06Q30/0246G06Q10/087G06Q30/0272G06T7/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,308,516
App. No.
16/651,675
Granted
Apr 19, 2022
Kind
B2
Abstract

An image processing unit ( 110 ) acquires a position of an advertisement and a position of a product by analyzing an image in which the product and the advertisement are disposed on a shelf rack are captured. A determination unit ( 120 ) determines whether or not a relation between the position of the product and the position of the advertisement satisfies a criterion. An output unit ( 130 ) outputs information indicating a determination result obtained by the determination unit ( 120 ).

Claims (62)

1. An information processing apparatus comprising:

at least one memory storing instructions; and

at least one processor configured to execute the instructions to:

acquire an image of a shelf rack where at least one advertisement and at least one product are disposed;

analyze the image to acquire information on a position of each advertisement and a position of each product;

identify a corresponding product in the image for each advertisement based on a predetermined information defining a target product for each advertisement;

calculate a relative position between the advertisement and the corresponding product based on the position of the advertisement and the position of the corresponding product;

compare the relative position with a criterion of positional correspondence between the advertisement and the corresponding product; and

display, on a display for a store employee, information indicating whether the relative position satisfies the criterion.

2. The information processing apparatus according to claim 1 ,

wherein the at least one processor is further configured to execute the instructions to read the criterion from a storage that stores the criterion for each type of the product, each product, each type of the advertisement, or each advertisement.

3. The information processing apparatus according to claim 1 ,

wherein the criterion indicates a distance between the product and the advertisement.

4. The information processing apparatus according to claim 1 ,

wherein the shelf rack includes a plurality of tiers, and

the at least one processor is further configured to execute the instructions to determine whether or not a one-dimensional position of the product in a height direction of the image overlaps a one-dimensional position of the advertisement in the height direction of the image, or whether or not a one-dimensional position of the product in a width direction of the image overlaps a one-dimensional position of the advertisement in the width direction of the image.

5. The information processing apparatus according to claim 1 ,

wherein the at least one processor is further configured to execute the instructions to:

determine a position of a shelf label provided on the shelf rack and a type of a product as a target of the shelf label; and

determine whether or not a type of a product as a target of the advertisement coincides with a type of a product as a target of a shelf label nearest to the advertisement.

6. The information processing apparatus according to claim 1 ,

wherein the at least one processor is further configured to execute the instructions to determine whether or not the position of the advertisement satisfies a second criterion different from the criterion.

7. The information processing apparatus according to claim 1 ,

wherein the at least one processor is further configured to execute the instructions to read a period in which the advertisement is to be posted for each type of the advertisement, from a storage that stores the period, and determine whether or not date and time on which the image is captured is included in the period.

8. The information processing apparatus according to claim 1 ,

wherein the at least one processor is further configured to execute the instructions to:

generate information indicating a relation between a comparison result and sales of the product in a period in which the advertisement is posted;

output the generated information.

9. An information processing method executed by a computer, the method comprising:

acquiring an image of a shelf rack where at least one advertisement and at least one product are disposed;

analyzing the image to acquire information on a position of each advertisement and a position of each product;

identifying a corresponding product in the image for each advertisement based on a predetermined information defining a target product for each advertisement;

calculating a relative position between the advertisement and the corresponding product based on the position of the advertisement and the position of the corresponding product;

comparing the relative position with a criterion of positional correspondence between the advertisement and the corresponding product; and

displaying, on a display for a store employee, information indicating whether the relative position satisfies the criterion.

10. The information processing method executed by a computer according to claim 9 ,

wherein plural types of advertisements are provided,

the method comprising

reading the criterion from a storage unit that stores the criterion for each type of the product, each product, each type of the advertisement, or each advertisement.

11. The information processing method executed by a computer according to claim 9 ,

wherein the criterion indicates a distance between the product and the advertisement.

12. The information processing method executed by a computer according to claim 9 ,

wherein the shelf rack includes a plurality of tiers,

the method comprising:

determining whether or not a one-dimensional position of the product in a height direction of the image overlaps a one-dimensional position of the advertisement in the height direction of the image, or whether or not a one-dimensional position of the product in a width direction of the image overlaps a one-dimensional position of the advertisement in the width direction of the image.

13. The information processing method executed by a computer according to claim 9 , the method further comprising:

determining a position of a shelf label provided on the shelf rack and a type of a product as a target of the shelf label; and

determining whether or not a type of a product as a target of the advertisement coincides with a type of a product as a target of a shelf label nearest to the advertisement.

14. The information processing method executed by a computer according to claim 9 , the method further comprising:

determining whether or not the position of the advertisement satisfies a second criterion different from the criterion.

15. The information processing method executed by a computer according to claim 9 , the method further comprising:

reading a period in which the advertisement is to be posted for each type of the advertisement, from a storage unit that stores the period, and determining whether or not date and time on which the image is captured is included in the period.

16. The information processing method executed by a computer according to claim 9 , the method further comprising:

generating information indicating a relation between the comparison result and sales of the product in a period in which the advertisement is posted, and

outputting the generated information.

17. A non-transitory computer readable medium storing a program causing a computer to perform an information processing method, the method comprising:

acquiring an image of a shelf rack where at least one advertisement and at least one product are disposed;

analyzing the image to acquire information on a position of each advertisement and a position of each product;

identifying a corresponding product in the image for each advertisement based on a predetermined information defining a target product for each advertisement;

calculating a relative position between the advertisement and the corresponding product based on the position of the advertisement and the position of the corresponding product;

comparing the relative position with a criterion of positional correspondence between the advertisement and the corresponding product; and

displaying, on a display for a store employee, information indicating whether the relative position satisfies the criterion.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 30, 2020
From: YONEZAWA, YAEKO; HORITA, KAITO; YAJIMA, AKIRA; SEKINE, MIZUTO; EHARA, YOSHINORI
To: NEC CORPORATION
Reel/Frame 052256/0298 →
Priority Claims (1)
JP JP2017-191792 · Sep 29, 2017 · national
Continuity (1)
Related Publication 20200273066A1 · Aug 27, 2020