IP Library › Granted Patent US 10,546,204
Granted Patent B1
US 10,546,204 · App. 14/084,045 · Granted Jan 28, 2020

Item information discovery with a wearable device

Inventors: Dilip Kumar (Seattle, WA); William Spencer Worley, III (Camano Island, WA)
Assignee: Amazon Technologies, Inc.
G06K9/3241G02B27/017G06K9/00335
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,546,204
App. No.
14/084,045
Granted
Jan 28, 2020
Kind
B1
Abstract

This disclosure describes architectures and techniques to provide information to a user about items with which the user interacts. In some instances, a user may utilize a wearable device that is configured to interact with one or more components of an information discovery system to obtain information about items in the user's environment.

Claims (107)

1. A system comprising:

a wearable device worn by a user located within a materials handling facility, including:

a first wireless communication module configured to enable wireless communication with an information discovery system;

an identifier associated with a user account of the user;

a first image capture device oriented to capture a first image of the user when the user is looking toward the wearable device;

a display;

a first one or more processors; and

a first memory storing first program instructions that when executed by the first one or more processors cause the first one or more processors to at least:

maintain the wearable device in a lower power state;

receive, via the first wireless communication module and from the information discovery system, initial item information corresponding to an item;

determine, based at least in part on the first image, that the user is looking toward the wearable device;

in response to a determination that the user is looking toward the wearable device:

transition the wearable device from the lower power state to a higher power state; and

present, on the display, the initial item information; and

the information discovery system that is separate from the wearable device and remote from the user, including:

a second wireless communication module configured to enable wireless communication with the first wireless communication module of the wearable device;

a second image capture device separate from the wearable device, remote from the user, and positioned at a fixed location to remain at the fixed location within the materials handling facility, the second image capture device oriented to capture a second image of the item;

a second one or more processors; and

a second memory storing second program instructions that when executed by the second one or more processors cause the second one or more processors to at least:

 process the second image and identify the item; and

 send, via the second wireless communication module and to the first wireless communication module, the initial item information associated with the item.

2. The system of claim 1 , wherein the first image is processed using at least one of gaze tracking or head tracking to determine that an orientation of a head of the user is directed toward the wearable device.

3. The system of claim 1 , wherein the initial item information includes an identification of the item, a price of the item, or information about the item.

4. The system of claim 1 , wherein the second program instructions are further configured to cause the second one or more processors to at least:

process a third image to determine that the user is looking toward an inventory shelf within the materials handling facility;

determine the initial item information corresponding to the item positioned on the inventory shelf; and

wherein the initial item information is proactively sent via the second wireless communication module and to the first wireless communication module based at least in part on a determination that the user is looking at the item on the inventory shelf.

5. The system of claim 1 , wherein:

the first program instructions are further configured to cause the first one or more processors to at least:

in response to the determination that the user is looking toward the wearable device, determine that a first position of the user within the materials handling facility corresponds to a second position of the user when the initial item information was received by the first wireless communication module of the wearable device; and

the presentation, on the display, of the initial item information is based at least in part on a determination that the first position corresponds to the second position.

6. The system of claim 1 , wherein:

the first program instructions are further configured to cause the first one or more processors to at least:

in response to the determination that the user is looking toward the wearable device, determine whether the user is still in a same area the user was in when the initial item information was received by the wearable device; and

the presentation, on the display, of the initial item information is based at least in part on a determination that the user is still in the same area.

7. A system, comprising:

an image capture device positioned at a fixed location to remain at the fixed location within a materials handling facility;

a non-transitory computer-readable storage medium storing instructions, the instructions when executed by a processor causing the processor to at least:

receive, from the image capture device, an image of an item located within the materials handling facility;

process the image to determine that a user has selected the item while the user is located in the materials handling facility;

in response to a determination that the user has selected the item, provide initial item information associated with the item to a wearable device worn by the user, wherein the wearable device is separate from the image capture device that captured the image of the item;

subsequent to providing the initial item information, receive from the wearable device an additional item information request;

in response to the additional item information request:

determine additional item information about the item;

select an output component, other than the wearable device, that is viewable by the user; and

send the additional item information to the output component for presentation to the user.

8. The system of claim 7 , the instructions further configured to at least:

determine that an additional action is to be performed; and

perform the additional action.

9. The system of claim 8 , wherein the additional action is at least one of initiate a purchase of the item, initiate a delivery of the item to the user, initiate a delivery of the item to a destination, or associate the item with a user account.

10. The system of claim 7 , wherein the initial item information includes one or more of an identification of the item, an author of the item, a publication date of the item, a price of the item, a size of the item, a weight of the item, an expiration date of the item, or an ingredient of the item.

11. The system of claim 7 , wherein the instructions that when executed by the processor cause the processor to determine that the user has selected the item, include instructions to at least:

determine a location area of the user within a materials handling facility;

receive an image of the item selected by the user; and

identify the item based at least in part on a comparison of information obtained from the image with stored item information for items at the location area of the user.

12. The system of claim 7 , the instructions when executed by the processor further cause the processor to at least:

receive an image of the user when the user arrives at a materials handling facility;

process the image to identify the user; and

identify a user account associated with the user.

13. The system of claim 7 , wherein the wearable device is temporarily associated with the user.

14. A computer implemented method, comprising:

maintaining a wearable device in a lower power state;

obtaining, with an image capture device of the wearable device, an image of a user wearing the wearable device;

determining, based at least in part on the image, if the user is looking toward the wearable device;

in response to determining that the user is looking toward the wearable device:

transitioning the wearable device to a higher power state;

emitting from an illumination element of the wearable device a light or light pattern that is not perceivable by a human but detectable by one or more image capture devices to assist an information discovery system in identifying the wearable device;

determining, by the wearable device, if initial item information associated with an item has been received by the wearable device; and

in response to determining that initial item information has been received, presenting on a display of the wearable device, the initial item information.

15. The computer implemented method of claim 14 , further comprising:

receiving an input from the user; and

performing an additional action.

16. The computer implemented method of claim 14 , further comprising:

in response to determining, by the wearable device, that initial item information has not been received:

determining that the user has selected an item;

receiving an image of the item;

receiving initial item information about the item; and

initiating a presentation of the initial item information.

17. A system, comprising:

a wearable device worn by a user located within a materials handling facility, including:

a first wireless communication module configured to wirelessly communicate with a second wireless communication module of an information discovery system;

a display;

a first one or more processors;

a first memory storing first program instructions that when executed by the first one or more processors cause the first one or more processors to at least:

maintain the wearable device in a lower power state;

receive, via the first wireless communication module and from the information discovery system, initial item information corresponding to an item;

determine that the user is looking toward the wearable device;

in response to a determination that the user is looking toward the wearable device;

transition the wearable device from the lower power state to a higher power state; and

present, on the display, at least a portion of the initial item information received from the information discovery system; and

the information discovery system that is separate from the wearable device and remote from the user, including:

the second wireless communication module configured to wirelessly communicate with the first wireless communication module;

an image capture device separate from the wearable device, remote from the user, and positioned at a fixed location to remain at the fixed location within the materials handling facility, the image capture device positioned to capture an image of the item selected by the user from a shelf within the materials handling facility;

a computing resource configured to process the image of the item to determine an identity of the item;

a processor; and

a memory storing program instructions that when executed by the processor cause the processor to at least:

determine the initial item information corresponding to the item; and

send to the wearable device for presentation on the display of the wearable device, the initial item information.

18. The system of claim 17 , further comprising:

an output component positioned within the materials handling facility and within a viewable distance of the user; and

wherein the program instructions stored in the memory of the information discovery system further cause the processor of the information discovery system to at least:

determine that additional item information corresponding to the item is to be presented to the user; and

send additional item information to the output component for presentation to the user.

19. The system of claim 18 , wherein the output component is at least one of a display coupled to the shelf, or a projector.

20. The system of claim 17 , wherein the program instructions stored in the memory of the information discovery system, further cause the processor to at least:

determine that the user has walked away with the item selected from the shelf; and

initiate a purchase of the item by the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 22, 2014
From: KUMAR, DILIP; WORLEY, WILLIAM SPENCER, III
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 032020/0369 →
Continuity (1)
Provisional Application 61772868 · Mar 5, 2013
Cited By (1)
US 12,437,542