IP Library › Granted Patent US 11,526,840
Granted Patent B2
US 11,526,840 · App. 16/390,966 · Granted Dec 13, 2022

Detecting inventory changes

Inventors: Dilip Kumar (Seattle, WA); Elie Micah Kornfield (Seattle, WA); Alexander Clark Prater (Seattle, WA); Sridhar Boyapati (Sammamish, WA); Xiaofeng Ren (Yarrow Point, WA); Chang Yuan (Seattle, WA)
Assignee: Amazon Technologies, Inc.
G06Q10/087G07G1/0036
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,526,840
App. No.
16/390,966
Granted
Dec 13, 2022
Kind
B2
Abstract

This disclosure describes a system for tracking removal or placement of items at inventory locations with a materials handling facility. In some instances, a user may remove an item from an inventory location and the inventory management system may detect that removal and update a user item list associated with the user to include an item identifier representative of the removed item. Likewise, if the user places an item at an inventory location, the inventory management system may detect that placement and update the user item list to remove an item identifier representative of the placed item.

Claims (83)

1. A computer-implemented method, comprising:

under control of one or more computing systems configured with executable instructions,

determining, based at least in part on first data collected by a first device, a presence of a user at a first location within a materials handling facility;

receiving a first image of an inventory location that is adjacent the first location;

determining, based at least in part on second data from a second device, at least one of a placement or a removal of an object at the inventory location;

receiving a second image that includes a representation of at least a portion of the first location;

determining, based at least in part on the first image and the second image, an identity of an item associated with the inventory location;

retrieving, from a data store, a user item list associated with the user, the user item list indicating at least items for which control is to be transitioned to the user; and

updating the user item list associated with the user, wherein the updating is based at least in part on the at least one of the placement or the removal of the object and the identity of the item.

2. The computer-implemented method of claim 1 , wherein the materials handling facility is at least one of a warehouse, a distribution center, a cross-docking facility, an order fulfillment facility, a packaging facility, a shipping facility, a rental facility, a library, a retail store, a wholesale store, or a museum.

3. The computer-implemented method of claim 1 , wherein the first data includes at least one of a third image, an audio data, a triangulation data, a personal identifying data, or a global positioning system data received from a portable device carried by the user.

4. The computer-implemented method of claim 1 , wherein the second device is at least one of an image capture device, a pressure sensor, a camera, an infrared sensor, a scale, a volume displacement sensor, a light curtain, a RFID reader, a barcode reader, or a QR code reader.

5. The computer-implemented method of claim 1 , wherein determining the identity of the item includes one or more of:

comparing the first image and the second image to determine the identity of the item based at least in part on a pixel comparison or an object difference determination;

determining the identity of the item based at least in part on a change in a weight at the inventory location as determined from data generated by a scale at the inventory location; or

determining the identity of the item based at least in part on a shape or dimension of a bottom of the object as determined from data generated by a pressure sensor at the inventory location.

6. The computer-implemented method of claim 1 , wherein determining at least one of the placement or the removal of the object further includes:

determining at least one of a weight of the object or a shape of the object; and

determining, based at least in part on the weight of the object or the shape of the object that the object corresponds with items stored at the inventory location.

7. The computer-implemented method of claim 6 , further comprising:

determining items included on the user item list;

wherein determining the identity of the item is further based at least in part on the items included on the user item list;

determining that a confidence score for the identity of the item placed at the inventory location exceeds a threshold; and

wherein updating the user item list includes removing, from the user item list, an item identifier for the identity of the item.

8. The computer-implemented method of claim 1 , wherein the first device is at least one of a camera, a personal identifier reader, a microphone, or a GPS receiver.

9. The computer-implemented method of claim 1 , further comprising:

determining items associated with the inventory location;

wherein determining the identity of the item is further based at least in part on the items associated with the inventory location;

determining that a confidence score for the identity of the item removed from the inventory location exceeds a threshold; and

wherein updating the user item list includes adding an item identifier for the identity of the item to the user item list.

10. A computing system; comprising:

one or more processors; and

a plurality of memories, each of the plurality of memories coupled with one or more of the one or more processors and storing program instructions that when executed by the one or more processors cause the one or more processors to at least:

determine, based at least in part on first data, a presence of a user at a first location within a materials handling facility;

determine, based at least in part on second data, at least one of a placement or a removal of an object at an inventory location that is adjacent the first location;

determine an identity of an item associated with the inventory location;

retrieve, from a data store, a user item list associated with the user, the user item list indicating at least items for which control is to be transitioned to the user; and

update the user item list associated with the user, wherein the update is based at least in part on the at least one of the placement or the removal of the object and the identity of the item.

11. The computing system of claim 10 , wherein the first data includes at least one of a third image, an audio data, a triangulation data, a personal identifying data, or a global positioning system data received from a portable device carried by the user.

12. The computing system of claim 10 , wherein the first data is received from a device that is at least one of an image capture device, a pressure sensor, a camera, an infrared sensor, a scale, a volume displacement sensor, a light curtain, a RFID reader, a barcode reader, or a QR code reader.

13. The computing system of claim 10 , wherein the program instructions that when executed by the one or more processors to cause the one or more processors to determine at least one of a placement or a removal of an object, further include instructions that when executed by the one or more processors further cause the one or more processors to at least:

determine at least one of a weight of the object or a shape of the object; and

determine, based at least in part on the weight of the object or the shape of the object, that the object corresponds with items stored at the inventory location.

14. The computing system of claim 13 , wherein the program instructions when executed by the one or more processors further cause the one or more processors to at least:

determine items included on the user item list;

determine that a confidence score of the identity of the item placed at the inventory, location exceeds a threshold; and

update the user item list to remove an item identifier for the identified item from the user item list.

15. The computing system of claim 14 , wherein the program instructions when executed by the one or more processors further cause the one or more processors to at least:

determine that the identity of the item does not correspond with the inventory location; and

send a message to an associate to remove the object from the inventory location.

16. The computing system of claim 10 , wherein the program instructions that when executed by the one or more processors to cause the one or more processors to determine at least one of the placement or the removal of the object further include instructions that when executed by the one or more processors further cause the one or more processors to at least:

determine that the object has been removed from the inventory location; and

determine that the object corresponds with items stored at the inventory location.

17. A system, comprising:

an inventory location within a materials handling facility that stores a plurality of inventory items;

a camera positioned within the materials handling facility and oriented to include the inventory location in a field of view of the camera;

a first device at the inventory location and operable to detect at least one of a placement or a removal of an object at the inventory location; and

one or more computing systems configured with executable instructions that when executed by the one or more computing systems cause the one or more computing systems to at least:

determine a presence of a user within the materials handling facility;

receive a first image of the inventory location from the camera;

determine, based at least in part on first data collected by the first device, at least one of the placement or the removal of the object at the inventory location;

receive a second image of the inventory location from the camera;

determine, based at least in part on the first image and the second image, an identity of an item associated with the inventory location;

retrieve, from a data store, a user item list associated with the user, the user item list indicating at least items for which control is to be transitioned to the user; and

update a user item list associated with the user, wherein the update is based at least in part on the at least one of the placement or the removal and the identity of the item.

18. The system of claim 17 , wherein the materials handling facility is at least one of a warehouse, a distribution center, a cross-docking facility, an order fulfillment facility, a packaging facility, a shipping facility, a rental facility, a library, a retail store, a wholesale store, or a museum.

19. The system of claim 17 , wherein the first data includes at least one of a third image, an audio data, a triangulation data, personal identifying data, or global positioning system data received from a portable device carried by the user.

20. The system of claim 17 , wherein the first device is at least one of an image capture device, a pressure sensor, a second camera, an infrared sensor, a scale, a volume displacement sensor, a light curtain, a RFID reader, a barcode reader, or a QR code reader.

21. The system of claim 17 , wherein the executable instructions that when executed by the one or more computing systems to determine at least one of the placement or the removal of the object further include instructions that when executed by the one or more computing systems further cause the one or more computing systems to at least:

determine at least one of a weight of the object or a shape of the object; and

determine, based at least in part on the weight of the object or the shape of the object that the object corresponds with items stored at the inventory location.

22. The system of claim 21 , wherein the executable instructions that when executed by the one or more computing systems further cause the one or more computing systems to at least:

determine items included on the user item list;

wherein determination of the identity of the item is further based at least in part on the items included on the user item list;

determine that a confidence score of the identity of the item placed at the inventory location exceeds a threshold; and

wherein the update of the user item list includes removal, from the user item list, of an item identifier for the identity of the item.

23. The system of claim 17 , wherein the executable instructions that when executed by the one or more computing systems to determine at least one of the placement or the removal further include instructions that when executed by the one or more computing systems further cause the one or more computing systems to at least:

determine that an object has been removed from the inventory location; and

determine that the object corresponds with items stored at the inventory location.

24. The system of claim 23 , wherein the executable instructions that when executed by the one or more computing systems further cause the one or more computing systems to at least:

determine items associated with the inventory location;

determine that a confidence score of the identity of the item removed from the inventory location exceeds a threshold; and

wherein the update of the user item list includes adding an item identifier for the identified item to the user item list.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 22, 2019
From: KUMAR, DILIP; KORNFIELD, ELIE MICAH; PRATER, ALEXANDER CLARK; BOYAPATI, SRIDHAR; REN, XIAOFENG; YUAN, CHANG
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 048959/0875 →
Continuity (2)
Continuation 13928345 · Jun 26, 2013
Related Publication 20190251499A1 · Aug 15, 2019
Cited By (1)
US 12,525,114