IP Library › Granted Patent US 12,051,217
Granted Patent B2
US 12,051,217 · App. 17/381,643 · Granted Jul 30, 2024

Image processing apparatus, image processing system, and control method

Inventor: Kenta Kansai (Mishima Shizuoka, JP)
Assignee: Toshiba Tec Kabushiki Kaisha
G06T7/70G06Q10/087G06T7/90G06V20/52G06T2207/30242
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,051,217
App. No.
17/381,643
Granted
Jul 30, 2024
Kind
B2
Abstract

According to one embodiment, an image processing apparatus includes a camera controller to acquire a camera image of a display location where commodities are displayed. A communication interface is provided to communicate with an information terminal. A processor in the apparatus is configured to calculate an empty area in the camera image corresponding to a portion of the display location that is revealed when commodities are removed from the display location, detect a shortage in the number of the commodities at the display location based on the calculated empty area, and send a notification, via the communication interface, to the information terminal when the shortage in the number of the commodities at the display location is detected.

Claims (57)

1. An image processing apparatus, comprising:

a camera controller to acquire a camera image of a display location where commodities are displayed;

a communication interface configured to communicate with an information terminal; and

a processor configured to:

calculate an empty area in the camera image corresponding to a portion of the display location that is revealed when commodities are removed from the display location,

detect a shortage in the number of the commodities at the display location based on the calculated empty area, and

send a notification, via the communication interface, to the information terminal when the shortage in the number of the commodities at the display location is detected, wherein

the shortage in the number of the commodities at the display location is detected when a ratio of the calculated empty area to a total area of the display location exceeds a threshold value.

2. The image processing apparatus according to claim 1 , wherein the notification includes an estimated number of commodities necessary to restock the display location, the estimated number being based on a value of the calculated empty area.

3. The image processing apparatus according to claim 2 , wherein the notification also indicates a position for the display location within a store.

4. The image processing apparatus according to claim 1 , further comprising:

a camera connected to the camera controller, the camera being positioned to provide the camera image of the display location.

5. The image processing apparatus according to claim 4 , wherein the camera is connected to the camera controller by a dedicated cable.

6. The image processing apparatus according to claim 1 , further comprising:

an image memory to store the acquired camera image.

7. The image processing apparatus according to claim 1 , wherein

the display location includes a plurality of sub-regions, and

the processor is configured to detect the location of each sub-region of the display location based on color similarity in the captured image.

8. The image processing apparatus according to claim 1 , wherein

the display location is a display table, and

the portion of the display location that is revealed when commodities are removed is an upper surface of the display table.

9. A product stocking level monitoring system for a retail store, the system comprising:

an image capture device configured to capture a camera image of a display location at which commodities are displayed in a store; and

an image processing apparatus including:

a camera controller to acquire the camera image from the image capture device;

a communication interface configured to communicate with an information terminal; and

a processor configured to:

calculate an empty area in the camera image corresponding to a portion of the display location that is revealed when commodities are removed from the display location,

detect a shortage in the number of the commodities at the display location based on the calculated empty area, and

send a notification, via the communication interface, to the information terminal when the shortage in the number of the commodities at the display location is detected.

10. The product stocking level monitoring system according to claim 9 , wherein the notification includes an estimated number of commodities necessary to restock the display location, the estimated number being based on a value of the calculated empty area.

11. The product stocking level monitoring system according to claim 10 , wherein the notification also indicates a position in the store for the display location.

12. The product stocking level monitoring system according to claim 9 , wherein the shortage in the number of the commodities at the display location is detected when a ratio of the calculated empty area to a total area of the display location exceeds a threshold value.

13. The product stocking level monitoring system according to claim 9 , wherein

the display location includes a plurality of sub-regions, and

the processor is configured to detect the location of each sub-region of the display location based on color similarity in the captured image.

14. The product stocking level monitoring system according to claim 13 , wherein the empty area is calculated for each of the detected sub-regions in turn.

15. A method of controlling an image processing apparatus for product stocking level monitoring, the method comprising:

acquiring a camera image from an image capture device positioned to image a display location for commodities in a store;

calculating an empty area in the camera image corresponding to a portion of the display location that is revealed when commodities are removed from the display location;

detecting a shortage in the number of the commodities at the display location based on the calculated empty area; and

sending a notification, via a communication interface, to an information terminal when the shortage in the number of the commodities at the display location is detected.

16. The method according to claim 15 , wherein

the display location is a display table, and

the portion of the display location that is revealed when commodities are removed is an upper surface of the display table.

17. The method according to claim 15 , wherein the notification includes an estimated number of commodities necessary to restock the display location, the estimated number being based on a value of the calculated empty area.

18. The method according to claim 17 , wherein the notification also indicates a position in the store for the display location.

19. An image processing apparatus, comprising:

a camera controller to acquire a camera image of a display location where commodities are displayed;

a communication interface configured to communicate with an information terminal; and

a processor configured to:

calculate an empty area in the camera image corresponding to a portion of the display location that is revealed when commodities are removed from the display location,

detect a shortage in the number of the commodities at the display location based on the calculated empty area, and

send a notification, via the communication interface, to the information terminal when the shortage in the number of the commodities at the display location is detected, wherein

the display location includes a plurality of sub-regions, and

the processor is configured to detect the location of each sub-region of the display location based on color similarity in the captured image.

20. The image processing apparatus according to claim 19 , wherein the empty area is calculated for each of the detected sub-regions in turn.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 21, 2021
From: KANSAI, KENTA
To: TOSHIBA TEC KABUSHIKI KAISHA
Reel/Frame 056933/0986 →
Priority Claims (1)
JP 2020-160709 · Sep 25, 2020 · national
Continuity (1)
Related Publication 20220101550A1 · Mar 31, 2022