IP Library Granted Patent US 10,669,140
Granted Patent B2
US 10,669,140 · App. 15/423,812 · Granted Jun 2, 2020

Shopping facility assistance systems, devices and methods to detect and handle incorrectly placed items

Inventors: Donald R. High (Noel, MO); David C. Winkle (Bella Vista, AR); Brian G. McHale (Chadderton Oldham, GB); Michael D. Atchley (Springdale, AR)
Assignee: Walmart Apollo, LLC
B66F9/063A47F3/08A47F10/04A47F13/00A47L11/4011B07C5/28B07C5/3422B60L53/36B60L53/63B60P3/06B62B5/0026B62B5/0069B62B5/0076B65F3/00E01H5/061E01H5/12G01C21/206G01S1/70G05B19/048G05D1/0011G05D1/0016G05D1/0022G05D1/0027G05D1/0061G05D1/0088G05D1/021G05D1/028G05D1/0214G05D1/0219G05D1/0234G05D1/0246G05D1/0255G05D1/0276G05D1/0289G05D1/0291G05D1/0293G05D1/0297G05D1/04G06F3/017G06K9/00208G06K9/00671G06K9/00711G06K9/00771G06K9/00791G06K9/00805G06K9/18G06K9/3208G06K9/6256G06K9/78G06Q10/02G06Q10/0631G06Q10/06311G06Q10/083G06Q10/087G06Q10/1095G06Q10/30G06Q30/016G06Q30/0281G06Q30/0601G06Q30/0605G06Q30/0613G06Q30/0617G06Q30/0619G06Q30/0631G06Q30/0633G06Q30/0635G06Q30/0639G06Q30/0641G06Q50/28G06Q50/30G06T7/593G06T7/74G08G1/20G10L13/043G10L15/22G10L17/22H02J7/0027H04B10/116H04L67/12H04L67/141H04L67/143H04N5/77H04N7/18H04N7/183H04N7/185H04N13/282H04W4/02H04W4/021H04W4/029H04W4/30H04W4/33H04W4/40H04W4/80A47F2010/005A47F2010/025A47L2201/04B07C2501/0045B07C2501/0054B07C2501/0063B60Y2410/10B65F2210/168G05B19/124G05B2219/23363G05B2219/39107G05D2201/0203G05D2201/0216G06F16/90335G06F21/606G06K7/10297G06K7/10821G06K7/1413G06K9/00624G06K2009/00738G06Q10/06315G06Q20/12G06T2207/10028G10L2015/223H02J7/00034H04B1/38H04L63/06H04L63/08H04L63/0846Y02W30/82Y02W30/827Y02W90/20Y04S10/54Y10S901/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,669,140
App. No.
15/423,812
Granted
Jun 2, 2020
Kind
B2
Abstract

Systems and methods are provided to address incorrectly placed items. Some systems comprise: a plurality of motorized transport units that are each configured to perform multiple different tasks at a retail shopping facility; and a central computer system configured to instruct various ones of the plurality of motorized transport units to implement at least one of the multiple different tasks relative to the retail shopping facility, receive and analyze input data detected and provided by the motorized transport units while the motorized transport units perform the at least one of the tasks, and detect and categorize each item of multiple items that are incorrectly placed within the retail shopping facility according to one of multiple different predefined categories.

Claims (58)

1. A system to address incorrectly placed items, comprising:

a plurality of motorized transport units that are each configured to perform multiple different tasks at a retail shopping facility; and

a central computer system configured to instruct various ones of the plurality of motorized transport units to implement at least one of the multiple different tasks relative to the retail shopping facility, receive and analyze input data detected and provided by the motorized transport units while the motorized transport units perform the at least one of the tasks, and detect and categorize each item of multiple items that are incorrectly placed within the retail shopping facility according to one of multiple different predefined categories;

wherein the central computer system is further configured to:

determine for each of the multiple items, based on the respective categorization of each of the multiple items, a location of multiple predefined different potential locations of the retail shopping facility the categorized item is to be taken;

communicate an instruction, relative to each of the categorized items, to cause the categorized item to be taken to the determined location, comprising confirm that a first item has been at a first location where the first item was detected for more than a threshold period of time prior to communicating a first instruction to cause the first item to be taken to a determined second location relative to a first categorization of the first item.

2. The system of claim 1 , wherein the central computer system in categorizing the items is further configured to:

categorize at least a second item of the multiple items as merchandize sold by the shopping facility, categorize least a third item of the multiple items as customer property, and categorize least a fourth item of the multiple items as a recyclable waste item.

3. The system of claim 1 , wherein the central computer system in communicating the instruction communicates the instruction to a first motorized transport unit, of the plurality of motorized transport units, to retrieve the first item and transport the first item through at least a portion of the retail shopping facility to the determined second location.

4. The system of claim 1 , wherein the central computer system is further configured to receive image data captured by at least one camera fixed at a third location within the retail shopping facility, cause image processing of the image data, and detect at least the first item is incorrectly placed based on the image processing of the image data.

5. The system of claim 1 , wherein the central computer system in categorizing the first item communicates instructions to a first motorized transport unit to pick up the first item, receive a weight of the first item from the first motorized transport unit, and categorizes the first item based on the weight of the first item.

6. The system of claim 1 , wherein the central computer system is further configured to determine that a second item, of the multiple items, has not been at a third location where the second item was detected for more than a second threshold period of time, and communicate an instruction, based on the categorization of the second item and in response to determining that the first second item has not been at the third location where the second item was detected for more than the second threshold period of time, to leave the second item at the third location.

7. The system of claim 1 , wherein the central computer system is further configured to receive additional sensor data, identify based on the additional sensor data that a customer is within a first threshold distance of a second item of the multiple items; and

communicate an instruction, based on the categorization of the second item and the identification that the customer is within the first threshold distance of the second item, instructing that the second item is to be left at a third location where the second item is detected.

8. The system of claim 1 , wherein the central computer system is further configured to receive additional sensor data; and

confirm, prior to communicating the first instruction, based on the additional sensor data that a person is not within a first threshold distance of the first item.

9. A system to address incorrectly placed items, comprising:

a plurality of motorized transport units that are each configured to perform multiple different tasks at a retail shopping facility; and

a central computer system configured to instruct various ones of the plurality of motorized transport units to implement at least one of the multiple different tasks relative to the retail shopping facility, receive and analyze input data detected and provided by the motorized transport units while the motorized transport units perform the at least one of the tasks, and detect and categorize each item of multiple items that are incorrectly placed within the retail shopping facility according to one of multiple different predefined categories;

wherein the central computer system is further configured to:

determine for each of the items, based on the categorization of the items, a location of multiple predefined different potential locations of the retail shopping facility the categorized item is to be taken; and

communicate an instruction, relative to each of the categorized items, to cause the categorized item to be taken to the determined location; and

wherein the central computer system in categorizing each of the multiple items determines that a first item is not a retail item being offered for sale by the retail shopping facility, and further determines that the first item is presumed to be owned by a customer and should not be discarded; and

the central computer system, in determining the location, determines that the first item is to be taken to a lost and found location.

10. A method to address incorrectly placed items, comprising:

by a central computer system for a retail shopping facility:

tasking various ones of a plurality of motorized transport units to implement at least one of the multiple different tasks relative to the retail shopping facility;

receiving and analyzing input data detected and provided by the motorized transport units while the motorized transport units perform the at least one of the tasks;

detecting and categorizing each item of multiple items that are incorrectly placed within the retail shopping facility according to one of multiple different predefined categories;

determining for each of the items, based on the categorization of the items, a location of multiple predefined different potential locations of the retail shopping facility the categorized item is to be taken;

communicating an instruction, relative to each of the categorized items, to cause the categorized item to be taken to the determined location; and

wherein the communicating the instruction comprises confirming that a first item of the categorized items has been at a first location where the first item was detected for more than a first threshold period of time prior to communicating a first instruction to cause the first item to be taken to a determined second location relative to a first categorization of the first item.

11. The method of claim 10 , wherein the categorizing the items comprises categorizing at least a second item as merchandize sold by the shopping facility, categorizing at least a third item as customer property, and categorizing at least a fourth item a recyclable waste item.

12. The method of claim 10 , wherein the communicating the instruction comprises communicating the instruction to a first motorized transport unit, of the plurality of motorized transport units, to retrieve the first item and transport the first item through at least a portion of the retail shopping facility to the determined first location.

13. The method of claim 10 , further comprising:

receiving image data captured by at least one camera fixed at a third location within the retail shopping facility and cause image processing of the image data; and

detecting at least the first item is incorrectly placed based on the image processing of the image data.

14. The method of claim 10 , further comprising:

communicating instructions to a first motorized transport unit to pick up and weigh the first item of the multiple items;

receiving a communication, from the first motorized transport unit, comprising a weight of the first item;

wherein the categorizing each of the items comprises categorizing the first item based on the weight of the first item.

15. The method of claim 10 , further comprising:

determining that a second item, of the multiple items, has not been at a third location where the second item was detected for more than a second threshold period of time; and

communicating an instruction, based on the categorization of the second item and in response to determining that the second item has not been at the third location where the second item was detected for more than the second threshold period of time, to leave the second item at the location.

16. The method of claim 10 , further comprising:

receiving additional sensor data;

identifying based on the additional sensor data that a customer is within a first threshold distance of a second item of the multiple items; and

communicating an instruction, based on the categorization of the second item and the identification that the customer is within the first threshold distance of the second item, instructing that the first second item is to be left at a third location where the first second item is detected.

17. The method of claim 10 , further comprising:

confirming, prior to communicating the first instruction, based on the additional sensor data that a person is not within a first threshold distance of the first item.

18. A method to address incorrectly placed items, comprising:

by a central computer system for a retail shopping facility:

tasking various ones of a plurality of motorized transport units to implement at least one of the multiple different tasks relative to the retail shopping facility;

receiving and analyzing input data detected and provided by the motorized transport units while the motorized transport units perform the at least one of the tasks;

detecting and categorizing each item of multiple items that are incorrectly placed within the retail shopping facility according to one of multiple different predefined categories;

wherein the categorizing each of the multiple items comprises:

determining that a first item is not a retail item being offered for sale by the retail shopping facility and determining that the first item is presumed to be owned by a customer and should not be discarded; and

wherein the determining the location comprises determining that the first item is to be taken to a lost and found location.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 16, 2018
From: WAL-MART STORES, INC.
To: WALMART APOLLO, LLC
Reel/Frame 045950/0273 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 23, 2018
From: MCHALE, BRIAN G.
To: WAL-MART STORES, INC.
Reel/Frame 045334/0534 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 3, 2017
From: HIGH, DONALD R.; WINKLE, DAVID C.; ATCHLEY, MICHAEL D.
To: WAL-MART STORES, INC.
Reel/Frame 041172/0356 →
Cited By (1)
US 12,703,614