Item information discovery with a wearable device
This disclosure describes architectures and techniques to provide information to a user about items with which the user interacts. In some instances, a user may utilize a wearable device that is configured to interact with one or more components of an information discovery system to obtain information about items in the user's environment.
1. A system comprising:
a wearable device worn by a user located within a materials handling facility, including:
a first wireless communication module configured to enable wireless communication with an information discovery system;
an identifier associated with a user account of the user;
a first image capture device oriented to capture a first image of the user when the user is looking toward the wearable device;
a display;
a first one or more processors; and
a first memory storing first program instructions that when executed by the first one or more processors cause the first one or more processors to at least:
maintain the wearable device in a lower power state;
receive, via the first wireless communication module and from the information discovery system, initial item information corresponding to an item;
determine, based at least in part on the first image, that the user is looking toward the wearable device;
in response to a determination that the user is looking toward the wearable device:
transition the wearable device from the lower power state to a higher power state; and
present, on the display, the initial item information; and
the information discovery system that is separate from the wearable device and remote from the user, including:
a second wireless communication module configured to enable wireless communication with the first wireless communication module of the wearable device;
a second image capture device separate from the wearable device, remote from the user, and positioned at a fixed location to remain at the fixed location within the materials handling facility, the second image capture device oriented to capture a second image of the item;
a second one or more processors; and
a second memory storing second program instructions that when executed by the second one or more processors cause the second one or more processors to at least:
process the second image and identify the item; and
send, via the second wireless communication module and to the first wireless communication module, the initial item information associated with the item.
2. The system of claim 1 , wherein the first image is processed using at least one of gaze tracking or head tracking to determine that an orientation of a head of the user is directed toward the wearable device.
3. The system of claim 1 , wherein the initial item information includes an identification of the item, a price of the item, or information about the item.
4. The system of claim 1 , wherein the second program instructions are further configured to cause the second one or more processors to at least:
process a third image to determine that the user is looking toward an inventory shelf within the materials handling facility;
determine the initial item information corresponding to the item positioned on the inventory shelf; and
wherein the initial item information is proactively sent via the second wireless communication module and to the first wireless communication module based at least in part on a determination that the user is looking at the item on the inventory shelf.
5. The system of claim 1 , wherein:
the first program instructions are further configured to cause the first one or more processors to at least:
in response to the determination that the user is looking toward the wearable device, determine that a first position of the user within the materials handling facility corresponds to a second position of the user when the initial item information was received by the first wireless communication module of the wearable device; and
the presentation, on the display, of the initial item information is based at least in part on a determination that the first position corresponds to the second position.
6. The system of claim 1 , wherein:
the first program instructions are further configured to cause the first one or more processors to at least:
in response to the determination that the user is looking toward the wearable device, determine whether the user is still in a same area the user was in when the initial item information was received by the wearable device; and
the presentation, on the display, of the initial item information is based at least in part on a determination that the user is still in the same area.
7. A system, comprising:
an image capture device positioned at a fixed location to remain at the fixed location within a materials handling facility;
a non-transitory computer-readable storage medium storing instructions, the instructions when executed by a processor causing the processor to at least:
receive, from the image capture device, an image of an item located within the materials handling facility;
process the image to determine that a user has selected the item while the user is located in the materials handling facility;
in response to a determination that the user has selected the item, provide initial item information associated with the item to a wearable device worn by the user, wherein the wearable device is separate from the image capture device that captured the image of the item;
subsequent to providing the initial item information, receive from the wearable device an additional item information request;
in response to the additional item information request:
determine additional item information about the item;
select an output component, other than the wearable device, that is viewable by the user; and
send the additional item information to the output component for presentation to the user.
8. The system of claim 7 , the instructions further configured to at least:
determine that an additional action is to be performed; and
perform the additional action.
9. The system of claim 8 , wherein the additional action is at least one of initiate a purchase of the item, initiate a delivery of the item to the user, initiate a delivery of the item to a destination, or associate the item with a user account.
10. The system of claim 7 , wherein the initial item information includes one or more of an identification of the item, an author of the item, a publication date of the item, a price of the item, a size of the item, a weight of the item, an expiration date of the item, or an ingredient of the item.
11. The system of claim 7 , wherein the instructions that when executed by the processor cause the processor to determine that the user has selected the item, include instructions to at least:
determine a location area of the user within a materials handling facility;
receive an image of the item selected by the user; and
identify the item based at least in part on a comparison of information obtained from the image with stored item information for items at the location area of the user.
12. The system of claim 7 , the instructions when executed by the processor further cause the processor to at least:
receive an image of the user when the user arrives at a materials handling facility;
process the image to identify the user; and
identify a user account associated with the user.
13. The system of claim 7 , wherein the wearable device is temporarily associated with the user.
14. A computer implemented method, comprising:
maintaining a wearable device in a lower power state;
obtaining, with an image capture device of the wearable device, an image of a user wearing the wearable device;
determining, based at least in part on the image, if the user is looking toward the wearable device;
in response to determining that the user is looking toward the wearable device:
transitioning the wearable device to a higher power state;
emitting from an illumination element of the wearable device a light or light pattern that is not perceivable by a human but detectable by one or more image capture devices to assist an information discovery system in identifying the wearable device;
determining, by the wearable device, if initial item information associated with an item has been received by the wearable device; and
in response to determining that initial item information has been received, presenting on a display of the wearable device, the initial item information.
15. The computer implemented method of claim 14 , further comprising:
receiving an input from the user; and
performing an additional action.
16. The computer implemented method of claim 14 , further comprising:
in response to determining, by the wearable device, that initial item information has not been received:
determining that the user has selected an item;
receiving an image of the item;
receiving initial item information about the item; and
initiating a presentation of the initial item information.
17. A system, comprising:
a wearable device worn by a user located within a materials handling facility, including:
a first wireless communication module configured to wirelessly communicate with a second wireless communication module of an information discovery system;
a display;
a first one or more processors;
a first memory storing first program instructions that when executed by the first one or more processors cause the first one or more processors to at least:
maintain the wearable device in a lower power state;
receive, via the first wireless communication module and from the information discovery system, initial item information corresponding to an item;
determine that the user is looking toward the wearable device;
in response to a determination that the user is looking toward the wearable device;
transition the wearable device from the lower power state to a higher power state; and
present, on the display, at least a portion of the initial item information received from the information discovery system; and
the information discovery system that is separate from the wearable device and remote from the user, including:
the second wireless communication module configured to wirelessly communicate with the first wireless communication module;
an image capture device separate from the wearable device, remote from the user, and positioned at a fixed location to remain at the fixed location within the materials handling facility, the image capture device positioned to capture an image of the item selected by the user from a shelf within the materials handling facility;
a computing resource configured to process the image of the item to determine an identity of the item;
a processor; and
a memory storing program instructions that when executed by the processor cause the processor to at least:
determine the initial item information corresponding to the item; and
send to the wearable device for presentation on the display of the wearable device, the initial item information.
18. The system of claim 17 , further comprising:
an output component positioned within the materials handling facility and within a viewable distance of the user; and
wherein the program instructions stored in the memory of the information discovery system further cause the processor of the information discovery system to at least:
determine that additional item information corresponding to the item is to be presented to the user; and
send additional item information to the output component for presentation to the user.
19. The system of claim 18 , wherein the output component is at least one of a display coupled to the shelf, or a projector.
20. The system of claim 17 , wherein the program instructions stored in the memory of the information discovery system, further cause the processor to at least:
determine that the user has walked away with the item selected from the shelf; and
initiate a purchase of the item by the user.