IP Library Granted Patent US 12,056,660
Granted Patent B2
US 12,056,660 · App. 17/697,760 · Granted Aug 6, 2024

Tracking inventory items in a store for identification of inventory items to be re-stocked and for identification of misplaced items

Inventors: Jordan E. Fisher (San Francisco, CA); Daniel L. Fischetti (San Francisco, CA); Michael S. Suswal (San Francisco, CA); Nicholas J. Locascio (San Francisco, CA)
Assignee: STANDARD COGNITION, CORP.
G06Q10/087G06N3/04G06N3/08G06T7/70G06T7/20G06T2207/10004G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,056,660
App. No.
17/697,760
Filed
Mar 17, 2022
Granted
Aug 6, 2024
Kind
B2
Art Unit
2483
USPC
348/169
Abstract

A method for tracking inventory items is provided. The method includes using sensors to produce respective sequences of images of corresponding fields of view, the field of view of each sensor overlapping with the field of view of at least one other sensor. The method includes dividing the area of real space into cells having volume and coordinates in a real space, and identifying inventory items and their locations in three dimensions using the sequences of images produced by at least two sensors having overlapping fields of view. The method includes, in response to the identification of the inventory items: (i) matching locations in three dimensions of identified inventory items with cells in the plurality of cells, and (ii) determining, for a particular inventory item matched with a particular cell, whether a count of the particular inventory item is below a threshold for re-stocking the particular inventory item.

Claims (66)

1. A method for tracking inventory items in an area of real space, the method including:

using a plurality of sensors to produce respective sequences of images of corresponding fields of view in the real space, the field of view of each sensor overlapping with the field of view of at least one other sensor in the plurality of sensors;

dividing the area of real space into a plurality of cells having volume and coordinates in the real space;

identifying inventory items and their locations in three dimensions using the sequences of images produced by at least two sensors having overlapping fields of view in the plurality of sensors, wherein the identifying further includes:

producing a confidence score probability for a particular inventory item being a predicted inventory item,

comparing, upon determining that the confidence score probability for the particular inventory item is below a first threshold, (i) a score, obtained at a scoring time, for the particular inventory item having a location matching a particular cell and based on one or more counts of inventory events and (ii) a second threshold,

accepting the particular inventory item as the predicted inventory item when the score is above the second threshold, and

rejecting the particular inventory item as being the predicted inventory item when the score is below the second threshold; and

in response to the identification of the inventory items:

(i) matching locations in three dimensions of identified inventory items with cells in the plurality of cells, and

(ii) determining, for a particular inventory item matched with a particular cell, whether a count of the particular inventory item is below a threshold for re-stocking the particular inventory item.

2. The method of claim 1 , further including:

using the sequences of images to identify inventory events in which locations of identified inventory items are changed; and

performing, in response to an identified inventory event corresponding to the particular inventory item, the matching of the locations and the determining of whether the count is below the threshold.

3. The method of claim 1 , wherein the method further includes, upon determining that the count of the particular inventory item is below the threshold, providing a notification that the particular inventory item needs to be re-stocked.

4. The method of claim 3 , wherein the notification indicates a location at which the particular inventory item needs to be re-stocked.

5. The method of claim 1 , wherein the method further includes, upon determining that the count of the particular inventory item is below the threshold, determining that the particular inventory item needs to be ordered from a distributor.

6. The method of claim 1 , wherein the determining of whether the count of the particular inventory item is below the threshold determines whether the count of the particular inventory item at a particular inventory location, of a plurality of inventory locations, is below the threshold.

7. The method of claim 6 , wherein the inventory location corresponds to the particular cell matched with the particular inventory item.

8. The method of claim 6 , wherein the method further includes, upon determining that the count of the particular inventory item at the inventory location is below the threshold, providing a notification that the particular inventory item needs to be re-stocked.

9. The method of claim 8 , wherein the notification indicates the inventory location at which the particular inventory item needs to be re-stocked.

10. The method of claim 6 , wherein the method further includes, upon determining that the count of the particular inventory item at the inventory location is below the threshold, determining that the particular inventory item needs to be ordered from a distributor.

11. The method of claim 1 , wherein the determining of whether the count of the particular inventory item is below the threshold determines whether the count of the particular inventory item at a storage location other than an inventory location is below the threshold.

12. The method of claim 11 , wherein the method further includes, upon determining that the count of the particular inventory item at the storage location is below the threshold, providing a notification that the particular inventory item needs to be re-stocked.

13. The method of claim 12 , wherein the notification indicates the storage location at which the particular inventory item needs to be re-stocked.

14. The method of claim 1 ,

wherein the area of real space includes a plurality of inventory locations having coordinates in the real space, and

wherein the method further includes:

accessing a planogram in memory specifying a distribution of inventory items in the inventory locations in the area of real space,

maintaining data representing inventory items matched with cells in the plurality of cells, and

identifying a misplaced inventory item by comparing the data representing the inventory items matched with the cells to the distribution of the inventory items in the inventory locations, as specified in the planogram.

15. The method of claim 14 ,

wherein the planogram specifies a distribution of a particular inventory item in both a first inventory location located at a first inventory display structure and a second inventory location located at a second inventory display structure,

wherein the identifying of the misplaced inventory item identifies the particular inventory item as being the misplaced inventory item upon determining that the particular inventory item is not located at the first inventory location and the second inventory location according to the data representing the inventory items matched with the cells, and

wherein the method further includes providing a notification regarding the misplaced inventory item to a person indicating that the person is to take the misplaced inventory item from a current location to either the first inventory location or the second inventory location.

16. The method of claim 14 ,

wherein the method further includes, upon identifying the misplaced inventory item, providing a notification regarding the misplaced inventory item,

wherein the notification is provided to a person to take the misplaced inventory item from a current location to a correct location,

wherein the notification identifies the misplaced inventory item, the current location of the misplaced inventory item and the correct location for the misplaced inventory item,

wherein the notification displays a map to guide the person to the current location of the misplaced inventory item, and

wherein the map further guides the person to the correct location for the misplaced inventory item.

17. The method of claim 14 ,

wherein the method further comprises identifying an electronic shopping list of a customer and providing a notification to the customer that identifies a current location of an identified misplaced inventory item that is included in the electronic shopping list, and

wherein the notification identifies the current location of the identified misplaced inventory item, when the current location of the misplaced inventory item is closer to the customer than a correct location of the misplaced inventory item.

18. A system for tracking inventory items in an area of real space, comprising:

a plurality of sensors, wherein sensors in the plurality of sensors produce respective sequences of images of corresponding fields of view in the real space, the field of view of each sensor overlapping with the field of view of at least one other sensor in the plurality of sensors; and

a processing system coupled to the plurality of sensors, the processing system dividing the area of real space into a plurality of cells having volume and coordinates in the real space, and including logic that uses the sequences of images produced by at least two sensors having overlapping fields of view in the plurality of sensors to:

identify inventory items and their locations in three dimensions, wherein the identifying includes:

producing a confidence score probability for a particular inventory item being a predicted inventory item,

comparing, upon determining that the confidence score probability for the particular inventory item is below a first threshold, (i) a score, obtained at a scoring time, for the particular inventory item having a location matching a particular cell and based on one or more counts of inventory events and (ii) a second threshold,

accepting the particular inventory item as the predicted inventory item when the score is above the second threshold, and

rejecting the particular inventory item as being the predicted inventory item when the score is below the second threshold, and

in response to the identified inventory items:

(i) match locations in three dimensions of identified inventory items with cells in the plurality of cells, and

(ii) determine, for a particular inventory item matched with a particular cell, whether a count of the particular inventory item is below a threshold for re-stocking the particular inventory item.

19. A non-transitory computer readable storage medium impressed with computer program instructions to track inventory items in an area of real space, the instructions, when executed on a processor, implement a method comprising:

using a plurality of sensors to produce respective sequences of images of corresponding fields of view in the real space, the field of view of each sensor overlapping with the field of view of at least one other sensor in the plurality of sensors;

dividing the area of real space into a plurality of cells having volume and coordinates in the real space;

identifying inventory items and their locations in three dimensions using the sequences of images produced by at least two sensors having overlapping fields of view in the plurality of sensors, wherein the identifying further includes:

producing a confidence score probability for a particular inventory item being a predicted inventory item,

comparing, upon determining that the confidence score probability for the particular inventory item is below a first threshold, (i) a score, obtained at a scoring time, for the particular inventory item having a location matching a particular cell and based on one or more counts of inventory events and (ii) a second threshold,

accepting the particular inventory item as the predicted inventory item when the score is above the second threshold, and

rejecting the particular inventory item as being the predicted inventory item when the score is below the second threshold; and

in response to the identification of the inventory items:

(i) matching locations in three dimensions of identified inventory items with cells in the plurality of cells, and

(ii) determining, for a particular inventory item matched with a particular cell, whether a count of the particular inventory item is below a threshold for re-stocking the particular inventory item.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 17, 2022
From: FISHER, JORDAN E.; FISCHETTI, DANIEL L.; SUSWAL, MICHAEL S.; LOCASCIO, NICHOLAS J.
To: STANDARD COGNITION, CORP.
Reel/Frame 059299/0525 →
Continuity (8)
Continuation 16679035 · Nov 8, 2019
Continuation 16256355 · Jan 24, 2019
Continuation In Part 15945473 · Apr 4, 2018
Continuation In Part 15907112 · Feb 27, 2018
Continuation In Part 15847796 · Dec 19, 2017
Provisional Application 62703785 · Jul 26, 2018
Provisional Application 62542077 · Aug 7, 2017
Related Publication 20220207470A1 · Jun 30, 2022
Cited By (1)
US 12,198,179