IP Library Granted Patent US 10,549,969
Granted Patent B2
US 10,549,969 · App. 15/061,908 · Granted Feb 4, 2020

Systems, devices and methods for monitoring modular compliance in a shopping space

Inventors: Donald R. High (Noel, MO); Michael D. Atchley (Springdale, AR); David C. Winkle (Bella Vista, AR)
Assignee: Walmart Apollo, LLC
B66F9/063A47F3/08A47F10/04A47F13/00A47L11/4011B07C5/28B07C5/3422B60L53/36B60L53/63B60P3/06B62B5/0026B62B5/0069B62B5/0076B65F3/00E01H5/061E01H5/12G01C21/206G01S1/70G01S1/72G05B19/048G05D1/0011G05D1/0016G05D1/0022G05D1/0027G05D1/0061G05D1/0088G05D1/021G05D1/028G05D1/0214G05D1/0219G05D1/0234G05D1/0246G05D1/0255G05D1/0276G05D1/0289G05D1/0291G05D1/0293G05D1/0297G05D1/04G06F3/017G06K9/00208G06K9/00671G06K9/00711G06K9/00771G06K9/00791G06K9/00805G06K9/18G06K9/3208G06K9/6256G06K9/78G06Q10/02G06Q10/0631G06Q10/06311G06Q10/083G06Q10/087G06Q10/1095G06Q10/30G06Q30/016G06Q30/0281G06Q30/0601G06Q30/0605G06Q30/0613G06Q30/0617G06Q30/0619G06Q30/0631G06Q30/0633G06Q30/0635G06Q30/0639G06Q30/0641G06Q50/28G06Q50/30G06T7/593G06T7/74G08G1/20G10L13/043G10L15/22G10L17/22H02J7/0027H04B10/116H04L67/12H04L67/141H04L67/143H04N5/77H04N7/18H04N7/183H04N7/185H04N13/282H04W4/02H04W4/021H04W4/029H04W4/30H04W4/33H04W4/40H04W4/80A47F2010/005A47F2010/025A47L2201/04B07C2501/0045B07C2501/0054B07C2501/0063B60Y2410/10B65F2210/168G05B19/124G05B2219/23363G05B2219/39107G05D2201/0203G05D2201/0216G06F16/90335G06F21/606G06K7/10297G06K7/10821G06K7/1413G06K9/00624G06K2009/00738G06Q10/06315G06Q20/12G06T2207/10028G10L2015/223H02J2007/0096H04B1/38H04L63/06H04L63/08H04L63/0846Y02W30/82Y02W30/827Y02W90/20Y04S10/54Y10S901/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,549,969
App. No.
15/061,908
Granted
Feb 4, 2020
Kind
B2
Abstract

Systems, apparatuses, and methods for modular compliance monitoring are provided. A system for monitoring modular compliance in a shopping space includes an image capture device, a baseline condition database, and a control circuit coupled to the image capture device and the baseline condition database. The control circuit being configured to obtain, from the image capture device, one or more images of a display module in the shopping space, retrieve, from the baseline condition database, a baseline condition model for a display space corresponding to the display module, and compare the one or more images of the display module in the shopping space and the baseline condition model to determine a modular compliance status for the display module.

Claims (51)

1. A method for monitoring modular compliance in a shopping space comprising:

obtaining, with a motorized transport unit performing a task in the shopping space comprising an image capture device, one or more images of a display module in the shopping space;

obtaining, with the motorized transport unit, a display module identifier associated with the display module;

retrieving, from a baseline condition database, a baseline condition model for a display space corresponding to the display module identifier, wherein the baseline condition model comprises designated display positions for a plurality of items on the display module and designated signage locations and content;

comparing, with a control circuit, the one or more images of the display module in the shopping space and the baseline condition model; and

determining, with the control circuit, a modular compliance status of the display module based on:

comparing the designated display positions of the plurality of items as specified in the baseline model and display positions of the plurality of items on the display module to determine compliance; and

comparing the designated signage locations and content as specified in the baseline model and locations and content of signages on the display module to determine compliance.

2. The method of claim 1 , wherein the baseline condition model is a three-dimensional model.

3. The method of claim 1 , wherein the baseline condition model is based on images of a standard display module different from the display module in the shopping space.

4. The method of claim 1 , further comprising:

performing image analysis on the one or more images of the display module to determine one or more of: price label content, item quantity, item expiration date, and display area cleanliness.

5. The method of claim 1 , wherein the determining of the modular compliance status is based on comparing one or more of: price label content, item quantity, item expiration date, and display area cleanliness in the one or more images of the display module with information in the baseline condition model.

6. The method of claim 1 , wherein the retrieving of the baseline condition model is based on scanning an optically readable code on the display module.

7. The method of claim 1 , further comprising:

collecting additional information relating to the display module, the additional information comprises one or more of: environmental temperature, barcode scan, radio-frequency identification (RFID) tag scan, and surrounding area condition;

wherein the determining of the modular compliance status is further based on the additional information.

8. The method of claim 1 , further comprising:

determining a follow-up task assignment based on the modular compliance status of the display module.

9. The method of claim 8 , wherein the determining of the modular compliance status of the display module comprises determining a modular compliance score and the follow-up task assignment is selected based at least on the modular compliance score.

10. A system for monitoring modular compliance in a shopping space comprising:

a motorized transport unit comprising an image capture device;

a baseline condition database; and

a control circuit coupled to the image capture device and the baseline condition database, the control circuit being configured to:

obtain, from the image capture device of the motorized transport unit performing a task in the shopping space, one or more images of a display module in the shopping space;

obtaining, with the motorized transport unit, a display module identifier associated with the display module;

retrieve, from the baseline condition database, a baseline condition model for a display space corresponding to the display module identifier, wherein the baseline condition model comprises designated display positions for a plurality of items on the display module and designated signage locations and content; and

compare the one or more images of the display module in the shopping space and the baseline condition model;

determine a modular compliance status for the display module based on:

comparing the designated display positions of the plurality of items as specified in the baseline model and display positions of the plurality of items on the display module to determine compliance; and

comparing the designated signage locations and content as specified in the baseline model and locations and content of signages on the display module to determine compliance.

11. The system of claim 10 , wherein the baseline condition model is a three-dimensional model.

12. The system of claim 10 , wherein the baseline condition model is based on images of a standard display module different from the display module in the shopping space.

13. The system of claim 10 , the control circuit is further configured to: perform image analysis on the one or more images of the display module to determine one or more of: price label content, item quantity, item expiration date, and display area cleanliness.

14. The system of claim 10 , wherein the modular compliance status is determined based on comparing one or more of: price label content, item quantity, item expiration date, and display area cleanliness in the one or more images of the display module with information in the baseline condition model.

15. The system of claim 10 , wherein the retrieving of the baseline condition model is based on scanning an optically readable code on the display module.

16. The system of claim 10 , wherein the control circuit is further configured to:

collect additional information relating to the display module, the additional information comprises one or more of: environmental temperature, barcode scan, radio-frequency identification (RFID) tag scan, and surrounding area condition;

wherein the modular compliance status is determined further based on the additional information.

17. The system of claim 10 , wherein the control circuit is further configured to: determine a follow-up task assignment based on the modular compliance status of the display module.

18. The system of claim 17 , wherein the modular compliance status comprises a modular compliance score and the follow-up task assignment is selected based at least on the modular compliance score.

19. An apparatus for monitoring modular compliance in a shopping space comprising:

a non-transitory storage medium storing a set of computer readable instructions; and

a control circuit configured to execute the set of computer readable instructions which causes the control circuit to:

obtain, with a motorized transport unit performing a task in the shopping space comprising an image capture device, one or more images of a display module in the shopping space;

obtaining, with the motorized transport unit, a display module identifier associated with the display module;

retrieve, from a baseline condition database, a baseline condition model for a display space corresponding to the display module identifier, wherein the baseline condition model comprises designated display positions for a plurality of items on the display module and designated signage locations and content;

compare the one or more images of the display module in the shopping space and the baseline condition model; and

determine a modular compliance status of the display module based on:

comparing the designated display positions of the plurality of items as specified in the baseline model and display positions of the plurality of items on the display module to determine compliance; and

comparing the designated signage locations and content as specified in the baseline model and locations and content of signages on the display module to determine compliance.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 16, 2018
From: WAL-MART STORES, INC.
To: WALMART APOLLO, LLC
Reel/Frame 045951/0585 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 15, 2016
From: HIGH, DONALD R.; ATCHLEY, MICHAEL D.; WINKLE, DAVID C.
To: WAL-MART STORES, INC.
Reel/Frame 038288/0767 →