IP Library Granted Patent US 11,786,058
Granted Patent B2
US 11,786,058 · App. 17/325,824 · Granted Oct 17, 2023

Image display device, image display system, image display method, and program

Inventors: Jun Kobayashi (Tokyo, JP); Shigetsu Saito (Tokyo, JP)
Assignee: NEC CORPORATION
A47F5/0807G06Q30/02G06Q30/06G06V20/52G06V40/103A47F3/00G09G3/20G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,786,058
App. No.
17/325,824
Granted
Oct 17, 2023
Kind
B2
Abstract

An image display device includes an approach situation information acquirer that acquires approach situation information indicating approach of at least part of a customer's body to a shelf on which a plurality of items are displayed and indicating, when there is the approach, a position of the approach on the shelf at each time; an associator that associates the approach situation information with one item of the plurality of items according to the position indicated by the approach situation information; an index value calculator that calculates an index value relating to the customer's behavior on the basis of information indicating the item associated with the approach situation information; and a display unit that displays the index value calculated by the index value calculator together with an image of the item on the basis of the association made by the associator.

Claims (38)

1. An image display device comprising:

at least one memory configured to store instructions; and

at least one processor configured to execute the instructions to:

receive an image, of a shelf displaying a plurality of products, and sensing data representing movement of a customer's hand toward the shelf;

count a number of times the customer's hand moved toward a product, among the plurality of products displayed on the shelf, based on the sensing data in a predetermined period;

generate a shelf image including the number of times;

control a display to display the shelf image; and

determine a distance between the customer's hand and a sensor configured to detect a position to which the customer's hand moved.

2. The image display device according to claim 1 ,

wherein the shelf image indicates the number of times by being superimposed with a predetermined color on an area of the product in the shelf image, which is selected from among a plurality of colors which are set to a heat map in advance such that the predetermined color is changeable according to the number of times.

3. The image display device according to claim 2 ,

wherein the processor is configured to execute the instructions to:

count a second number of times the customer's hand moved toward a second product among the plurality of products displayed on the shelf; and

generate the shelf image by adding a second color corresponding to the second number of times to a second area of the shelf image including the second product.

4. The image display device according to claim 2 ,

wherein the shelf image includes a legend indicating an association between the number of times and the color.

5. The image display device according to claim 1 ,

wherein the processor is further configured to execute the instructions to:

estimate the product based on the distance.

6. The image display device according to claim 1 ,

wherein the processor is further configured to execute the instructions to:

determine a position of the customer's hand in front of the shelf.

7. The image display device according to claim 4 ,

wherein the processor is further configured to execute the instructions to:

generate the shelf image as including a highlighting of the product,

wherein the highlighting comprises at least one of stripped and dotted lines superimposed over the product.

8. An image display method comprising:

receiving an image, of a shelf displaying a plurality of products, and sensing data representing movement of a customer's hand toward the shelf;

counting a number of times the customer's hand moved toward a product, among the plurality of products displayed on the shelf, based on the sensing data in a predetermined period;

generating a shelf image including the number of times;

controlling a display to display the shelf image; and

determining a distance between the customer's hand and a sensor configured to detect a position to which the customer's hand moved.

9. A non-transitory computer readable storage medium having a program causing a computer of an image display device to:

receive an image, of a shelf displaying a plurality of products, and sensing data representing movement of a customer's hand toward the shelf;

count a number of times the customer's hand moved toward a product, among the plurality of products displayed on the shelf, based on the sensing data in a predetermined period;

generate a shelf image including the number of times;

control a display to display the shelf image; and

determine a distance between the customer's hand and a sensor configured to detect a position to which the customer's hand moved.

Continuity (3)
Continuation 16854458 · Apr 21, 2020
Continuation 16085638
Related Publication 20210267387A1 · Sep 2, 2021