Speech-based inventory management system and method

1. A method, comprising:

receiving, at an electronic device, first weight sensor data representing a first weight determined by a first weight sensor of a shelf within a storage unit, the first weight sensor data being sent by the storage unit;

receiving a first timestamp indicating a first time that the first weight sensor data was determined by the first weight sensor;

receiving a device identifier associated with the storage unit;

determining that the device identifier is associated with a storage unit profile on the electronic device;

determining that the first weight equals zero indicating that no object is detected by the first weight sensor;

receiving item information associated with the first weight sensor as indicated by the storage unit profile, the item information indicating that:

the first weight sensor is associated with a first location within the storage unit;

a name of a first physical item associated with the first location; and

a second weight of the first physical item determined at a previous time prior to the first time, the second weight corresponding to a most recent weight of the first physical item;

determining a first weight difference by subtracting the second weight from the first weight;

determining that the first weight difference equals the second weight, indicating that the first physical item was moved from the first location;

receiving, from the storage unit, second weight sensor data representing a third weight determined by the first weight sensor;

determining that the third weight is greater than zero indicating that a mass was detected by the first weight sensor;

receiving a second timestamp indicating a second time that the second weight sensor data was determined by the first weight sensor;

determining a first amount of time that elapsed between the first time and the second time;

determining that the first amount of time is greater than a predefined temporal threshold value;

determining that, based on the first amount of time being greater than the predefined temporal threshold value and that the third weight is non-zero, that the first physical item was removed from the storage unit and then placed within the storage unit at the first location;

determining second weight difference by subtracting the third weight from the second weight;

storing second data representing the second weight difference and third data representing the third weight to the storage unit profile such that a current weight of the first physical item is updated as being the second weight, and an item usage amount is updated according to the second weight difference; and

executing a command to control a further component based on association of the second data and the item usage amount with the storage unit profile.

2. The method of claim 1 , further comprising:

generating first text data representing a response that requests confirmation that the first physical item was placed back in the storage unit at the first location;

sending the first text data to a remote device, the remote device generating and sending first audio data representing the first text data to the storage unit; and

receiving, from the remote device, confirmation information indicating that the first physical item was placed back in the storage unit at the first location, the confirmation information being determined by the remote device based on second audio data representing an utterance received by a microphone of the storage unit.

3. The method of claim 1 , further comprising:

determining an initial weight of the first physical item as stored by the storage unit profile;

determining a third weight difference between the third weight and the initial weight;

determining that the third weight difference is greater than a predefined replenishment threshold value indicating that the first physical item needs to be replaced;

generating a request for a response that asks whether a replacement for the first physical item should be ordered;

generating first text data representing the response;

sending the first text data to a remote device, the remote device being capable of generating and sending first audio data representing the first text data to the storage unit, and the remote device also being capable of determining that second audio data representing an utterance received by a microphone of the storage unit indicates that the replacement is to be ordered;

determining a mailing address associated with the storage unit profile; and

sending an order request to an item fulfillment system for the replacement such that the replacement is able to be sent to the mailing address.

4. The method of claim 1 , further comprising:

receiving, at the electronic device, third weight sensor data representing a fourth weight determined by the first weight sensor;

receiving a third timestamp indicating a third time that the third weight sensor data was determined by the first weight sensor;

determining that the fourth weight corresponds to a non-zero weight indicating that another object is detected by the first weight sensor;

determining a second amount of time that elapsed between the second time and the third time;

determining that the second amount of time is greater than the predefined temporal threshold value;

sending a second request for the second weight to an inventory management system;

receiving the second weight from the inventory management system;

determining that an additional magnitude of a third weight difference by subtracting the third weight from the second weight;

determining that the additional magnitude is greater than a predefined weight threshold value;

determining that a second physical item was placed at the first location based on the second amount of time being greater than the predefined temporal threshold value, the third weight difference being greater than the predefined weight threshold value, and the fourth weight being non-zero;

generating first text data representing an audio message asking whether the first physical item was placed at the first location;

sending the first text data to a remote device, the remote device being capable of generating and sending first audio data representing the first text data to the storage unit such that the first audio data is played by a speaker of the storage unit, the remote device further being capable of determining that second audio data representing an utterance received by a microphone of the storage unit indicates that the first physical item was not placed at the first location; and

storing, for the storage unit profile, updated item information for the first location that indicates that the first physical item is no longer associated with the first location, the second physical item is now associated with the first location, and that the second physical item has an initial weight equal to the fourth weight.

5. A method, comprising:

receiving first sensor data representing a first weight determined by a first sensor of a first device;

determining a user profile used for inventory management is associated with the first device;

storing the first sensor data;

receiving first information indicating that the first sensor corresponds to a first location of the first device, and that a first physical item is associated with the first location;

receiving second sensor data representing a second weight determined by the first sensor;

determining that the first physical item is located at the first location, based at least in part on a first weight difference being less than a first weight threshold, the first weight difference representing the second weight subtracted from the first weight;

causing an indication to be associated with the user profile, the indication indicating that the first physical item has the second weight;

in response to the second weight being less than a second weight threshold, generating first text data representing a first message asking whether a replacement of the first physical item is to be ordered;

sending the first text data to a device associated with the user profile; and

causing a second physical item, corresponding to the first physical item, to be sent.

6. The method of claim 5 , further comprising:

receiving second text data representing an utterance, the utterance indicating that the first physical item is located at the first location; and

storing, for the user profile, the second text data indicating that the first physical item is located at the first location.

7. The method of claim 5 , further comprising:

receiving second text data representing a second message to confirm an object associated with the first location;

generating first audio data representing the second text data;

sending the first audio data to the first device;

receiving second audio data from the first device;

generating third text data representing the second audio data; and

determining, based on a similarity value between the second text data and the third text data being greater than a similarity threshold value, that the first physical item is located at the first location.

8. The method of claim 5 , further comprising:

receiving, prior to determining that the first device is associated with the user profile, first temporal information indicating a first time that the first sensor data was determined;

receiving, prior to determining that the first physical item is located at the first location, second temporal information indicating a second time that the second sensor data was determined; and

determining, based at least in part on a temporal difference of the first time and the second time being greater than a temporal threshold value, that the first physical item was moved from the first location at the first time and returned to the first location at the second time.

9. The method of claim 5 , further comprising:

receiving input data;

determining the input data indicates that the second physical item is to be sent;

determining a shipping address associated with the user profile; and

sending, to a fulfillment system, at least the shipping address and a request for the second physical item to be sent.

10. The method of claim 5 , further comprising:

receiving, prior to receiving the second sensor data, second text data representing a name of the first physical item; and

storing an association between the name, the second weight, and the first location with the first physical item.

11. The method of claim 5 , further comprising:

receiving third sensor data representing a third weight determined by the first sensor;

determining, based at least in part on a second weight difference between the second weight and the third weight being greater than the first weight threshold, that a second physical item is located at the first location, the second weight difference representing the third weight subtracted from the first weight; and

storing the third sensor data indicating that the second physical item is now located at the first location.

12. The method of claim 11 , further comprising:

receiving second text data representing a second message to confirm a first name of an object associated with the first location;

generating first audio data representing the second text data;

sending the first audio data to the first device;

receiving, from the first device, second audio data representing an utterance;

generating third text data representing the second audio data;

determining, using the third text data, a second name of the second physical item; and

storing supplemental information indicating that the first location is now associated with the second physical item having the second name, as well as having an initial weight corresponding to the third weight.

13. A system, comprising:

communication circuitry;

at least one processor; and

at least one memory including instructions operable to be executed by the at least one processor to perform a set of actions, configuring the at least one processor to:

receive first sensor data representing a first weight determined by a first sensor of a first device;

determine a user profile used for inventory management is associated with the first device;

store the first sensor data;

receive first information indicating that the first sensor corresponds to a first location of the first device, and that a first physical item is associated with the first location;

receive second sensor data representing a second weight determined by the first sensor;

determine that the first physical item is located at the first location, based at least in part on a first weight difference being less than a first weight threshold, the first weight difference representing the second weight subtracted from the first weight;

cause an indication to be associated with the user profile, the indication indicating that the first physical item has the second weight;

in response to the second weight being less than a second weight threshold, generate first text data representing a first message asking whether a replacement of the first physical item is to be ordered;

send the first text data to a device associated with the user profile; and

cause a second physical item, corresponding to the first physical item, to be sent.

14. The system of claim 13 , wherein the at least one processor is further configured to:

receive second text data representing an utterance, the utterance indicating that the first physical item is located at the first location; and

store, for the user profile, the second text data indicating that the first physical item is located at the first location.

15. The system of claim 13 , wherein the at least one processor is further configured to:

receive, prior to determining that the first device is associated with the user profile, first temporal information indicating a first time that the first sensor data was determined;

receive, prior to determining that the first physical item is located at the first location, second temporal information indicating a second time that the second sensor data was determined; and

determine, based at least in part on a temporal difference of the first time and the second time being greater than a temporal threshold value, that the first physical item was moved from the first location at the first time and returned to the first location at the second time.

16. The system of claim 13 , wherein the at least one processor is further configured to:

receive input data;

determine the input data indicates that the second physical item is to be sent;

determine a shipping address associated with the user profile; and

send, to a fulfillment system, at least the shipping address and a request for the second physical item to be sent.

17. The system of claim 13 , wherein the at least one processor is further configured to:

receive, prior to receiving the second sensor data, second text data representing a name of the first physical item; and

store an associate of the name, the second weight, and the first location with the first physical item.

18. The system of claim 13 , wherein the at least one processor is further configured to:

receive third sensor data representing a third weight determined by the first sensor;

determine, based at least in part on a second weight difference between the second weight and the third weight being greater than the first weight threshold, that a second physical item is located at the first location, the second weight difference representing the third weight subtracted from the first weight; and

store the third sensor data indicating that the second physical item is now located at the first location.