IP Library Granted Patent US 12,123,155
Granted Patent B2
US 12,123,155 · App. 18/226,132 · Granted Oct 22, 2024

Apparatus and method of monitoring product placement within a shopping facility

Inventors: Donald R. High (Noel, MO); Shuvro Chakrobartty (Frisco, TX); Robert C. Taylor (Round Rock, TX)
Assignee: Walmart Apollo, LLC
E01H5/061A47F3/08A47F10/04A47F13/00A47L11/4011B07C5/28B07C5/3422B60L53/36B60L53/63B60P3/06B62B5/0026B62B5/0069B62B5/0076B65F3/00B66F9/063E01H5/12G01C21/206G01S1/02G01S1/70G01S1/7034G01S1/7038G01S1/72G05B19/048G05D1/0011G05D1/0016G05D1/0022G05D1/0027G05D1/0061G05D1/0088G05D1/021G05D1/0214G05D1/0219G05D1/0234G05D1/0246G05D1/0255G05D1/0276G05D1/028G05D1/0289G05D1/0291G05D1/0293G05D1/0297G05D1/04G06F3/017G06F18/214G06Q10/02G06Q10/0631G06Q10/06311G06Q10/08G06Q10/083G06Q10/087G06Q10/1095G06Q10/30G06Q30/016G06Q30/0281G06Q30/0601G06Q30/0605G06Q30/0613G06Q30/0617G06Q30/0619G06Q30/0631G06Q30/0633G06Q30/0635G06Q30/0639G06Q30/0641G06Q50/40G06T7/593G06T7/74G06V20/20G06V20/40G06V20/52G06V20/56G06V20/58G06V20/647G06V30/224G08G1/20G10L13/00G10L15/22G10L17/22H02J7/0013H02J7/0071H04B10/116H04L67/12H04L67/141H04L67/143H04N5/77H04N7/18H04N7/183H04N7/185H04N13/282H04W4/02H04W4/021H04W4/029H04W4/30H04W4/33H04W4/40H04W4/80A47F2010/005A47F2010/025A47L2201/04B07C2501/0045B07C2501/0054B07C2501/0063B60Y2410/10B62B3/1404B62B5/005B65F2210/168G01S5/16G01S5/18G01S2201/01G01S2201/02G05B19/124G05B2219/23363G05B2219/39107G06F16/90335G06F21/606G06K7/10297G06K7/10821G06K7/1413G06Q10/06315G06Q20/12G06T2207/10028G06V20/44G10L2015/223H02J7/00034H04B1/38H04L63/06H04L63/08H04L63/0846Y02W30/82Y02W90/00Y02W90/10Y04S10/50Y10S901/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,123,155
App. No.
18/226,132
Granted
Oct 22, 2024
Kind
B2
Abstract

Methods and apparatuses are provided for use in monitoring product placement within a shopping facility. Some embodiments provide an apparatus configured to determine product placement conditions within a shopping facility, comprising: a transceiver configured to wirelessly receive communications; a product monitoring control circuit coupled with the transceiver; a memory coupled with the control circuit and storing computer instructions that when executed by the control circuit cause the control circuit to: obtain a composite three-dimensional (3D) scan mapping corresponding to at least a select area of the shopping facility and based on a series of 3D scan data; evaluate the 3D scan mapping to identify multiple product depth distances; and identify, from the evaluation of the 3D scan mapping, when one or more of the multiple product depth distances is greater than a predefined depth distance threshold from the reference offset distance of the product support structure.

Claims (68)

1. A retail system configured to determine product conditions within a retail facility, comprising:

a product monitoring control circuit associated with a retail facility; and

a memory coupled with the control circuit and storing computer instructions that when executed by the control circuit cause the control circuit to:

obtain scans corresponding to at least a select area of the retail facility and based on scan data from a motorized robotic scanner unit moved relative to at least the select area of the retail facility;

access a baseline scan of at least the select area of the retail facility;

evaluate the scan data relative to the baseline scan;

determine an empty area of a product support structure relative to multiple items supported by the product support structure; and

identify when the empty area has a predefined relationship with an area threshold relative to the product support structure.

2. The retail system of claim 1 , wherein the control circuit in identifying when the empty area has the predefined relationship with the area threshold is further configured to identify, based on a 3D scan mapping, when the empty area is greater than a case threshold such that the empty area is large enough to receive at least a full case of items of a first product; and

cause one or more commands to be communicated to cause initiation of one or more actions in response to identifying that the empty area has the predefined relationship to the area threshold and the empty area is greater than the case threshold.

3. The retail system of claim 1 , wherein the control circuit is further configured to:

identify, from the scans and relative to each of multiple sets of items supported by the product support structure, whether a respective threshold number of items are present within each of the multiple sets of items, wherein each of the multiple sets of items comprises one or more of the multiple items supported by the product support structure;

identify that a threshold number of the multiple sets of items within the select area that do not have at least the respective threshold number of items; and

cause one or more commands to be communicated, in response to identifying that the threshold number of the multiple sets of items do not have at least the respective threshold number of items, to initiate one or more actions.

4. The retail system of claim 1 , further comprising:

the motorized robotic scanner unit in wireless communication with the product monitoring control circuit.

5. The retail system of claim 1 , wherein the scan data comprises point cloud measurements, and the baseline scan comprises point cloud measurements.

6. The retail system of claim 1 , wherein the control circuit is further configured to:

cause one or more movement commands to be communicated to the motorized robotic scanner unit to cause physical movement of the motorized robotic scanner unit through at least a portion of the retail facility comprising the select area.

7. The retail system of claim 1 , wherein the control circuit is further configured to:

identify that the empty area is less than a restocking area threshold; and

cause an instruction to be communicated directing movement of at least a subset of items of the multiple items still supported on the product support structure to be closer to a reference offset in response to the identifying that the empty area has the predefined relationship with the area threshold but not greater than the restocking area threshold, wherein the area threshold is a facing area threshold.

8. The retail system of claim 1 , wherein the control circuit is further configured to:

communicate commands to the motorized robotic scanner unit directing the motorized robotic scanner unit to perform at least one additional task and to capture the scan data as the motorized robotic scanner unit travels through the retail facility performing the at least one additional task, wherein the at least one additional task is different than capturing the scan data.

9. The retail system of claim 1 , wherein the control circuit is further configured to access inventory information of a first product and identify from the inventory information when there is a threshold number of items of the first product;

cause an instruction to be communicated directing a restocking of the empty area with additional items of the first product in response to both identifying that the empty area has the predefined relationship with the area threshold and identifying that there is the threshold number of items of the first product; and

prevent an instruction from being communicated regarding restocking of the empty area in response to at least one of identifying that the empty area does not have the predefined relationship with the area threshold and identifying that there is not the threshold number of items of the first product.

10. A method of determining product conditions within a retail facility, comprising:

obtaining scans corresponding to at least a select area of the retail facility and based on scan data from a motorized robotic scanner unit moved relative to at least the select area of the retail facility;

accessing a baseline scan of at least the select area;

evaluating the scans relative to the baseline scan;

determining an empty area of a product support structure relative to multiple items supported by the product support structure; and

identifying when the empty area has a predefined relationship with an area threshold relative to the product support structure.

11. The method of claim 10 ,

wherein the identifying when the empty area has the predefined relationship with the area threshold further comprises:

identifying, based on a 3D scan mapping, when the empty area is greater than a case threshold such that the empty area is large enough to receive at least a full case of items of a first product; and

causing one or more commands to be communicated to cause initiation of one or more actions in response to identifying that the empty area has the predefined relationship to the area threshold and the empty area is greater than the case threshold.

12. The method of claim 10 , further comprising:

identifying, relative to each of multiple sets of items supported by the product support structure, whether a respective threshold number of items are present within each of the multiple sets of items, wherein each of the multiple sets of items comprises one or more of the multiple items supported by the product support structure;

identifying that a threshold number of the multiple sets of items within the select area that do not have at least the respective threshold number of items; and

causing one or more commands to be communicated in response to identifying that the threshold number of the multiple sets of items do not have at least the respective threshold number of items to initiate one or more actions.

13. The method of claim 10 , further comprising:

identifying, based on the scan data, when one or more items within the select area are different than a first product; and

causing a notification to be communicated notifying the retail facility associate that at least one item of at least a second product is incorrectly placed within the select area.

14. The method of claim 10 , wherein the scan data comprises point cloud measurements, and the baseline scan comprises point cloud measurements.

15. The method of claim 10 , further comprising:

causing one or more movement commands to be communicated to the motorized robotic scanner unit to cause physical movement of the motorized robotic scanner unit through at least a portion of the retail facility comprising the select area.

16. The method of claim 10 , further comprising:

identifying that the empty area is less than a restocking area threshold; and

causing an instruction to be communicated directing movement of at least a subset of items of the multiple items still supported on the product support structure to be closer to a reference offset in response to the identifying that the empty area has the predefined relationship with the area threshold but not greater than the restocking area threshold, wherein the area threshold is a facing area threshold.

17. The method of claim 10 , further comprising:

communicating commands to the motorized robotic scanner unit directing the motorized robotic scanner unit to perform at least one additional task and to capture the scan data as the motorized robotic scanner unit travels through the retail facility performing the at least one additional task, wherein the at least one additional task is different than capturing the scan data.

18. The method of claim 17 , further comprising:

accessing inventory information of a first product;

identifying from the inventory information when there is a threshold number of items of the first product;

causing an instruction to be communicated directing a restocking of the empty area with additional items of the first product in response to both identifying that the empty area has the predefined relationship with the area threshold and identifying that there is the threshold number of items of the first product; and

preventing an instruction from being communicated regarding restocking of the empty area in response to at least one of identifying that the empty area does not have the predefined relationship with the area threshold and identifying that there is not the threshold number of items of the first product.

19. A retail facility product monitoring system, comprising:

a motorized robotic scanner unit;

a product monitoring control circuit communicatively coupled over a wireless communication network with the motorized robotic scanner unit;

a memory coupled with the product monitoring control circuit and storing computer instructions that when executed by the control circuit cause the control circuit to:

communicate one or more route commands to the motorized robotic scanner unit to cause physical movement of the motorized robotic scanner unit to move consistent with the one or more route commands through at least a portion of a retail facility comprising a select area of a product support structure and capture scan data relative to the select area;

obtain a series of scan data corresponding to at least the select area of the product support structure from the motorized robotic scanner unit;

access a baseline scan of at least the select area of the product support structure;

evaluate the scan data relative to the baseline scan and identify a difference between the scan data and the baseline scan of an empty area on the product support structure;

identify when the empty area has a predefined relationship with an area threshold; and

communicate one or more commands to initiate one or more actions in response to identifying that the empty area has the predefined relationship to the area threshold.

20. The product monitoring system of claim 19 , wherein the product monitoring control circuit in identifying when the empty area has the predefined relationship with the area threshold is configured to identify when the empty area is greater than a case threshold such that the empty area is large enough to receive at least a full case of items of a first product.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2023
From: HIGH, DONALD R.; CHAKROBARTTY, SHUVRO; TAYLOR, ROBERT C.
To: WAL-MART STORES, INC.
Reel/Frame 064409/0542 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2023
From: WAL-MART STORES, INC.
To: WALMART APOLLO, LLC
Reel/Frame 064417/0163 →