IP Library Granted Patent US 12,073,431
Granted Patent B2
US 12,073,431 · App. 17/403,782 · Granted Aug 27, 2024

Method for tracking and maintaining promotional states of slots in inventory structures within a store

Inventors: Bradley Bogolea (San Francisco, CA); Jariullah Safi (San Francisco, CA); Lorin Vandegrift (San Francisco, CA); Shiva Reddy (San Francisco, CA); Tom Gehani (San Francisco, CA)
Assignee: Simbe Robotics, Inc.b
G06Q30/0248G06F18/22G06Q10/087G06Q20/201G06V20/52
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,073,431
App. No.
17/403,782
Granted
Aug 27, 2024
Kind
B2
Abstract

One variation of a method for tracking promotional states of slots in inventory structures within a store includes: accessing an image of an inventory structure within a store; detecting a shelf tag on the inventory structure in the image; extracting a set of features from the shelf tag detected in the image; detecting a promotional tag on the inventory structure in the image; extracting a set of features from the promotional tag detected in the image; detecting a deviation between the shelf tag and the promotional tag based on a difference between the sets of features; and, in response to detecting the deviation between the shelf tag and the promotional tag, identifying the first promotional tag as erroneous, and notifying a store associate to replace the first promotional tag with a second promotional tag at the first slot, the second promotional tag correcting the difference.

Claims (111)

1. A method for tracking promotional states of slots in inventory structures within a store comprising:

accessing an image of an inventory structure within the store, the image captured by an optical sensor located within the store;

detecting, in the image, a first set of features representing a first shelf tag on the inventory structure;

identifying a first slot, in the inventory structure, corresponding to the first shelf tag;

detecting, in the image, a second set of features representing a first promotional tag on the inventory structure;

associating the first promotional tag with the first shelf tag;

detecting a conflict between the first shelf tag and the first promotional tag based on a deviation between the first set of features and the second set of features; and

in response to detecting the conflict between the first shelf tag and the first promotional tag, generating an electronic flag to replace the first promotional tag at the first slot.

2. The method of claim 1 , further comprising:

writing the electronic flag to a global restocking list; and

distributing the global restocking list to computing devices accessible to store associates during a next scheduled restocking period in the store.

3. The method of claim 1 :

further comprising dispatching a robotic system to:

autonomously navigate along the inventory structure; and

capture a sequence of photographic images of regions of the inventory structure during a scan cycle; and

wherein accessing the image of the inventory structure comprises assembling the sequence of photographic images into the image of the inventory structure.

4. The method of claim 1 , wherein accessing the image of the inventory structure comprises accessing the image captured by a fixed camera installed within the store and defining a field of view that intersects the inventory structure.

5. The method of claim 1 , wherein generating the electronic flag to replace the first promotional tag at the first slot comprises:

generating a prompt to replace the first promotional tag with a second promotional tag at the first slot, the second promotional tag correcting the conflict; and

transmitting the prompt to a computing device accessible to a store associate.

6. The method of claim 1 :

further comprising:

retrieving a promotional tag rule for the store, the promotional tag rule specifying an arrangement of promotional tags relative to corresponding shelf tags and threshold distances between promotional tags and corresponding shelf tags; and

detecting a shelf face in the image;

further comprising:

detecting a row of shelf tags on the shelf face; and

detecting a row of promotional tags on the shelf face; and

wherein associating the first promotional tag with the first shelf tag comprises:

characterizing a first distance between and a first position of the first promotional tag, in the row of promotional tags, and the first shelf tag, in the row of shelf tags; and

linking the first promotional tag to the first shelf tag in response to the first distance and the first position fulfilling the promotional tag rule.

7. The method of claim 1 , further comprising:

identifying a first product type specified by the first shelf tag based on the first set of features;

detecting a first promotion status advertised by the first promotional tag based on the second set of features; and

temporarily updating pricing data for the first product type in a point-of-sale system associated with the store according to the first promotion status advertised by the first promotional tag.

8. The method of claim 1 :

wherein detecting the second set of features in the image comprises detecting a distribution of feature types in a first region of the image depicting the first promotional tag;

further comprising:

accessing a set of promotional tag templates;

matching the first promotional tag to a first promotional tag template, in the set of promotional tag templates, based on the distribution of feature types;

retrieving a target promotion status location and a promotion status interpreter for the first promotional tag template;

identifying a target feature, in the second set of features, located in the target promotion status location on the first promotional tag; and

interpreting a first promotion status advertised by the first promotional tag based on the target feature and the promotion status interpreter; and

wherein detecting the conflict between the first shelf tag and the first promotional tag comprises detecting the conflict in response to the first promotion status advertised by the first promotional tag exceeding a price advertised by the first shelf tag.

9. The method of claim 1 :

further comprising:

based on the first set of features, identifying a first product identifier of a first product type advertised by the first shelf tag;

retrieving a first attribute of the first product type from a product database based on the first product identifier; and

based on the second set of features, identifying a second attribute advertised by the first promotional tag; and

wherein detecting the conflict between the first shelf tag and the first promotional tag comprises detecting the conflict between the first shelf tag and the first promotional tag based on a difference between the first attribute and the second attribute.

10. The method of claim 1 , further comprising:

identifying a product type specified by the first shelf tag based on the first set of features;

interpreting a target quantity of units of the product type assigned to the first slot based on the first set of features;

extracting a third set of features from a region of the image depicting the first slot;

identifying a quantity of product units of the product type occupying the first slot based on the third set of features; and

in response to the quantity of product units differing from the target quantity by more than a threshold difference, generating a second electronic flag to restock the first slot with product units of the product type.

11. A method for tracking promotional states of slots in inventory structures within a store comprising:

accessing an image of an inventory structure within the store, the image captured by an optical sensor located within the store;

detecting a first slot in the inventory structure depicted in the image;

identifying a first product type assigned to the first slot;

accessing, from a promotion schedule, a current promotion status assigned to the first product type;

detecting, in the image, a first set of features representing a first promotional tag on the inventory structure;

interpreting a first promotion status advertised by the first promotional tag based on the first set of features;

associating the first promotional tag with the first slot;

detecting a conflict between the first promotion status and the current promotion status; and

in response to detecting the conflict, generating an electronic flag to investigate the first promotional tag at the first slot.

12. The method of claim 11 :

wherein accessing the image of the inventory structure comprises accessing the image captured by a fixed camera installed within the store and defining a field of view that intersects the inventory structure; and

further comprising

accessing a second image of the inventory structure captured by the fixed camera;

detecting a store associate in the second image; and

in response to detecting the store associate in the second image, transmitting the electronic notification to a computing device accessible to a store associate.

13. The method of claim 11 , further comprising dispatching a robotic system to:

autonomously navigate along the inventory structure; and

capture the image of the inventory structure during a first scan cycle.

14. The method of claim 11 :

wherein detecting the first set of features representing the first promotional tag comprises detecting a distribution of feature types in a first region of the image depicting the first promotional tag; and

wherein interpreting the first promotion status advertised by the first promotional tag comprises:

accessing a set of promotional tag templates;

matching the first promotional tag to a first promotional tag template, in the set of promotional tag templates, based on the distribution of feature types;

retrieving a target promotion status location and a promotion status interpreter for the first promotional tag template;

identifying a target feature, in the set of features, located in the target promotion status location on the first promotional tag; and

interpreting the first promotion status advertised by the first promotional tag based on the target feature and the promotion status interpreter.

15. The method of claim 11 :

wherein accessing the current promotion status assigned to the first product type comprises accessing a target promotion format assigned to the first product type;

wherein interpreting the first promotion status advertised by the first promotional tag comprises interpreting a first promotion format advertised by the first promotional tag; and

wherein detecting the conflict between the first promotion status and the current promotion status comprises detecting a deviation between the first promotion format and the target promotion format.

16. The method of claim 11 , further comprising, in response to detecting the conflict:

generating a print file for a replacement promotional tag based on the first promotion status, the replacement promotional tag correcting the conflict; and

queuing a printer to print the replacement promotional tag.

17. The method of claim 11 :

wherein accessing the image of the inventory structure comprises accessing the image of the inventory structure captured on a current date;

wherein retrieving the current promotion status assigned to the first product type comprises retrieving the first promotion status specifying a date range for a promotion assigned to the first product type;

wherein detecting the conflict between the first promotion status and the current promotion status comprises detecting the conflict in response to the current date falling outside of the date range for the promotion; and

wherein generating the electronic flag to investigate the first promotional tag at the first slot comprises generating an electronic notification to remove the first promotional tag from the first slot.

18. The method of claim 11 , further comprising:

scanning a digital product catalog defining a population of product types stocked in the store for current promotion statuses of the population of product types; and

compiling current promotion statuses for the population of product types, detected in the digital product catalog, into the promotion schedule.

19. A method for tracking promotional states of slots in inventory structures within a store comprising:

accessing an image of an inventory structure within the store, the image captured by an optical sensor located within the store;

detecting a set of shelf faces in the inventory structure in the image;

detecting a first set of features on a shelf tag on a first shelf face, in the set of shelf faces, in the image;

identifying a slot above the first shelf face based on a position of the shelf tag in the image;

identifying a product type assigned to the slot based on the first set of features;

retrieving, from a promotion schedule, a current promotion status associated with the product type;

detecting an absence of a promotional tag indicating the current promotion status at the slot in the image; and

in response to detecting the absence of the promotional tag, generating an electronic flag to locate the promotional tag at the slot on the inventory structure.

20. The method of claim 19 :

wherein accessing the image of the inventory structure comprises accessing the image captured by a fixed camera installed within the store and defining a field of view that intersects the inventory structure; and

wherein generating the electronic flag to locate the promotional tag at the slot comprises:

generating a prompt to install the promotional tag onto the first shelf face adjacent the first slot on the inventory structure; and

transmitting the prompt to a computing device accessible to a store associate.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded Jan 4, 2024
From: EASTWARD FUND MANAGEMENT, LLC
To: SIMBE ROBOTICS, INC.
Reel/Frame 066023/0126 →
SECURITY INTEREST Recorded May 17, 2023
From: SIMBE ROBOTICS, INC.
To: EASTWARD FUND MANAGEMENT, LLC
Reel/Frame 063669/0757 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 11, 2022
From: BOGOLEA, BRADLEY; SAFI, JARIULLAH; VANDEGRIFT, LORIN; REDDY, SHIVA; GEHANI, TOM
To: SIMBE ROBOTICS, INC.
Reel/Frame 059941/0678 →
Continuity (3)
Continuation 17169326 · Feb 5, 2021
Provisional Application 62970695 · Feb 5, 2020
Related Publication 20210374662A1 · Dec 2, 2021