IP Library Granted Patent US 11,250,570
Granted Patent B2
US 11,250,570 · App. 16/491,649 · Granted Feb 15, 2022

Display rack image processing device, image processing method, and recording medium

Inventor: Kyota Higa (Tokyo, JP)
Assignee: NEC CORPORATION
G06T7/11G06F16/583G06K9/00771G06K9/46G06Q10/087G06Q30/0201G06T7/254G06T7/90G06T2207/10024G06T2207/20081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,250,570
App. No.
16/491,649
Granted
Feb 15, 2022
Kind
B2
Abstract

A state of a display rack is evaluated accurately. An image processing device includes a detection unit configured to detect a change area related to a display rack from a captured image in which an image of the display rack is captured, a classification unit configured to classify a change related to the display rack in the change area, and an evaluation unit configured to evaluate a display state of goods, based on a classification result.

Claims (42)

1. An image processing device comprising a processor configured to:

detect a change area related to a display rack from a captured image in which an image of the display rack is captured;

classify a change related to the display rack in the change area; and

evaluate a display state of goods, based on a classification result, wherein

the captured image is a color image,

the processor detects the change area by comparing the captured image with background information indicating the image captured before the image capturing time of the captured image, and

the processor classifies the change related to the display rack in the change area, based on a previously learned model of the change related to the display rack.

2. The image processing device according to claim 1 , wherein

the processor calculates an amount of display of the goods, based on the classification result, information about the change area, and monitored area information indicating a target area where the display state of the goods is monitored in the captured image.

3. The image processing device according to claim 2 , wherein

the processor evaluates the display state of the goods, based on a transition of the amount of display over time.

4. The image processing device according to claim 1 , the processor further configured to

output information about the display state of the goods to an output device, based on an evaluation result.

5. The image processing device according to claim 1 , wherein

the processor tracks the change area between a plurality of the captured images, and

the processor classifies the change related to the display rack, based on a tracking result.

6. The image processing device according to claim 5 , wherein

the processor updates the background information, based on the captured image used when detecting the change area, and the background information, and,

when the tracking result of the change area satisfies a first predetermined condition, the processor updates an area other than an area corresponding to the change area, in the background information.

7. The image processing device according to claim 6 , wherein,

when the tracking result of the change area satisfies a second predetermined condition, the processor updates the area corresponding to the change area, in the background information.

8. The image processing device according to claim 1 , wherein,

based on the change area and rack area information indicating a rack area where the goods is displayed in the display rack, the processor determines whether or not the change area is included in a plurality of the rack areas, and,

when the change area is included in one of the rack areas, the processor classifies the change related to the display rack in the change area as a type related to a change in goods displayed on the display rack.

9. An image processing method comprising:

detecting a change area related to a display rack from a captured image in which an image of the display rack is captured;

classifying a change related to the display rack in the change area; and

evaluating a display state of goods, based on a classification result, wherein

the captured image is a color image,

the detecting comprises detecting the change area by comparing the captured image with background information indicating the image captured before the image capturing time of the captured image, and

the classifying comprises classifying the change related to the display rack in the change area, based on a previously learned model of the change related to the display rack.

10. The image processing method according to claim 9 , further comprising

calculating an amount of display of goods, based on the classification result, information about the change area, and monitored area information indicating a target area where a display state of goods is monitored in the captured image.

11. A computer-readable non-transitory recording medium recorded with a program causing a computer to execute:

detection processing of detecting a change area related to a display rack from a captured image in which an image of the display rack is captured;

classification processing of classifying a change related to the display rack in the change area; and

evaluation processing of evaluating a display state of goods, based on a classification result, wherein

the captured image is a color image,

the detection processing of detecting the change area by comparing the captured image with background information indicating the image captured before the image capturing time of the captured image, and

the classification processing of classifying the change related to the display rack in the change area, based on a previously learned model of the change related to the display rack.

12. The recording medium according to claim 11 , wherein

the evaluation processing calculates an amount of display of the goods, based on the classification result, information about the change area, and monitored area information indicating a target area where the display state of the goods is monitored in the captured image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 6, 2019
From: HIGA, KYOTA
To: NEC CORPORATION
Reel/Frame 050289/0824 →
Continuity (1)
Related Publication 20200013169A1 · Jan 9, 2020