IP Library Granted Patent US 10,565,549
Granted Patent B2
US 10,565,549 · App. 15/683,279 · Granted Feb 18, 2020

System and method for managing retail products

Inventors: Aditya R. Cheruku (Bentonville, AR); Stephen Steel (Bentonville, AR); Hamza Farooq (Rogers, AR); Trinath Patri (Bentonville, AR)
Assignee: Walmart Apollo, LLC
G06Q10/087G06K9/00624G06K9/00771G06K9/4661G06K9/6202G06K9/78G06Q10/06315G06Q20/203G06K2209/27
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,565,549
App. No.
15/683,279
Granted
Feb 18, 2020
Kind
B2
Abstract

In some embodiments, apparatuses and methods are provided herein useful to monitoring retail products. In some embodiments, there is provided a system for monitoring retail products including: one or more shelf image capturing devices disposed within a retail shopping facility. The one or more shelf image capturing devices configured to capture shelf images of retail store shelves. The captured shelf images having an associated shelf timestamp. By one approach, a control circuit in communication with the one or more shelf image capturing devices is configured to analyze the captured shelf images by comparing brightness, contrast levels, and luminous intensity at a particular frequency between at least two shelf images of the captured shelf images to determine a rate of shelf product depletion for a particular retail product and send a shelf depletion warning regarding a particular retail item to an associate device or a central computer.

Claims (39)

1. A system comprising:

one or more shelf image capturing devices disposed within a retail shopping facility, the one or more shelf image capturing devices configured to:

capture shelf images of retail store shelves, the captured shelf images having a shelf timestamp associated therewith;

delete images with individuals obscuring a view of a particular retail store shelf; and

track a number of deleted images; and

a control circuit in communication with the one or more shelf image capturing devices, the control circuit configured to:

analyze the captured shelf images by comparing brightness, contrast levels, and luminous intensity at a particular frequency between at least two shelf images of the captured shelf images and the associated shelf timestamp;

estimate customer traffic based on the number of deleted images over a period of time;

estimate a rate of shelf product depletion for a particular retail product based in part on the estimated customer traffic and on the analysis of the captured shelf images;

determine that the particular retail product has reached a threshold based on the estimated rate of shelf product depletion; and

send a shelf depletion warning for the particular retail product to an associate device or a central computer in response to the determination that the particular retail product has reached the threshold.

2. The system of claim 1 , wherein the captured shelf images are analyzed by comparing groups of clustered pixels from the captured shelf images.

3. The system of claim 1 , further comprising one or more stock image capturing devices disposed within a stockroom of the retail shopping facility and configured to capture stock images of a stock location, the captured stock images having a stock timestamp associated therewith, wherein the control circuit is in communication with the one or more stock image capturing devices and configured to:

analyze the captured stock images by comparing the brightness, the contrast levels, and the luminous intensity at a specific frequency between at least two stock images of the captured stock images and the associated stock timestamp to determine a rate of stock depletion; and send a stock depletion warning for a particular stock item to a supply chain management server, thereby permitting a distribution center or a supplier to forecast retail restocking needs or to initiate a stock shipment.

4. The system of claim 3 , wherein the shelf depletion warning or the stock depletion warning includes at least one of the rate of shelf product depletion, the rate of stock depletion, a shelf request, a stock request, or historical rate depletion information.

5. The system of claim 1 , further comprising one or more point of sale terminals in communication with the control circuit, the one or more point of sale terminals configured to track purchases of store items and communicate the purchased store items to the control circuit.

6. The system of claim 5 , wherein the control circuit compares purchased depletion of the store items via the one or more point of sale terminals with at least one of the rate of shelf product depletion or the rate of stock depletion.

7. The system of claim 1 , wherein the one or more shelf image capturing devices and the control circuit in communication therewith permit real-time image analysis to permit the control circuit to determine rates of shelf product depletion for a plurality of retail products and instruct the associate device to restock retail products with a higher rate of the shelf product depletion than those retail products with lower rates of the shelf product depletion.

8. The system of claim 7 , wherein the control circuit is further configured to determine a profit margin for the plurality of retail products and instruct the associate device to restock retail products having a similar rate of the shelf product depletion in an order of highest profit margin to lowest profit margin.

9. The system of claim 1 , wherein the one or more shelf image capturing devices are configured to report the number of deleted images to the control circuit.

10. The system of claim 9 , wherein the control circuit is further configured to correlate the estimated customer traffic with a point-of-sale (POS) system to refine the estimation of the rate of shelf product depletion.

11. The system of claim 10 , wherein the control circuit is further configured to provide estimated depletion rate notifications to the associate device so that associates can plan shelf restocking based on anticipated depletion.

12. The system of claim 10 , wherein the control circuit is configured to prepare a report of at least one of depletion rates, depletion time, frequency of restocking, the customer traffic, or estimated depletion rates.

13. The system of claim 1 , wherein the control circuit is further configured to process the captured shelf images via image contrast enhancement or dynamic range reduction.

14. A computer-implemented method for monitoring retail products comprising:

capturing, by one or more shelf image capturing devices disposed within a retail shopping facility, shelf images of retail store shelves in the retail shopping facility, the captured shelf images having a shelf timestamp associated therewith;

deleting, by the one or more shelf image capturing devices, images with individuals obscuring a view of a particular retail store shelf;

tracking, by the one or more shelf image capturing devices, a number of deleted images;

analyzing, via a control circuit, the captured shelf images by comparing brightness, contrast levels, and luminous intensity at a particular frequency between at least two shelf images and the associated shelf timestamp;

estimating, by the control circuit, customer traffic based on the number of deleted images over a period of time;

estimating, by the control circuit, a rate of shelf product depletion for a particular retail product based in part on the estimated customer traffic and on the analysis of the captured shelf images;

determining, by the control circuit, that the particular retail product has reached a threshold based on the estimated rate of shelf product depletion; and

sending, by the control circuit, a shelf depletion warning for the particular retail product to an associate device or a central computer in response to the determination that the particular retail product has reached the threshold.

15. The method of claim 14 , further comprising capturing stock images of a stockroom, the captured stock images having a stock timestamp associated therewith, wherein the analyzing of the captured shelf images includes comparing groups of clustered pixels from a plurality of captured shelf images.

16. The method of claim 15 , further comprising analyzing the captured stock images of the stockroom by comparing the brightness, the contrast levels, and the luminous intensity at a specific frequency between at least two stock images of the captured stock images and the associated stock timestamp and determining a rate of stock depletion.

17. The method of claim 16 , further comprising sending a stock depletion warning for a particular stock item to a supply chain management server.

18. The method of claim 16 , further comprising receiving purchase information from one or more point of sale terminals.

19. The method of claim 18 , further comprising comparing verified purchase depletion of retail items with at least one of the shelf product depletion or the stock product depletion.

20. The method of claim 14 , further comprising correlating, by the control circuit, the estimated customer traffic with a point-of-sale (POS) system to refine the estimation of the rate of shelf product depletion.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 16, 2018
From: WAL-MART STORES, INC.
To: WALMART APOLLO, LLC
Reel/Frame 045959/0017 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 24, 2017
From: CHERUKU, ADITYA REDDY; STEEL, STEPHEN; FAROOQ, HAMZA; PATRI, TRINATH
To: WAL-MART STORES, INC.
Reel/Frame 043395/0845 →
Continuity (2)
Provisional Application 62378433 · Aug 23, 2016
Related Publication 20180060804A1 · Mar 1, 2018