Methods and systems for disambiguating user input based on detection of ensembles of items
Systems and methods are described for disambiguating user input based on a physical location of items in a vicinity of a user. The system determines that a query received from a user contains an ambiguity. In response, the system identifies several items in the physical vicinity of the user. Then, the system analyzes the identified plurality of items to determine whether the plurality of items forms a first ensemble of items or a second ensemble of items. If the plurality of items forms a first ensemble of items, the system performs a search using the search query and a first keyword related to the first ensemble of items. If the plurality of items forms a second ensemble of items, the system performs a search using the search query and a second keyword related to the second ensemble of items. The system then outputs results of the performed search.
1. A method comprising:
receiving a user interface input;
in response to determining that the user interface input is ambiguous:
accessing a plurality of ensemble templates, wherein each ensemble template comprises a list of physical items and a descriptive keyword;
detecting, using a sensor, a set of physical items in a physical vicinity of a user associated with the user interface input;
in response to determining that the set of physical items in the physical vicinity of the user matches a list of physical items of a particular ensemble template of the plurality of ensemble templates:
modifying the user interface input with a descriptive keyword of the particular ensemble template; and
generating an output based on the modified user interface input.
2. The method of claim 1 , wherein the detecting, using the sensor, the set of physical items in the physical vicinity of the user associated with the user interface input comprises:
identifying a first item and a second item;
calculating a distance between the first item and the second item; and
in response to determining that the distance meets a vicinity threshold, adding the first item and the second item to the set of physical items.
3. The method of claim 1 , wherein the sensor is at least one of:
an Internet of Things sensor, a radio frequency identification (RFID) sensor, a video camera, an infrared sensor, and a near-field communication sensor.
4. The method of claim 1 , wherein the determining that the set of physical items in the physical vicinity of the user matches the list of physical items of the particular ensemble template comprises:
calculating a number of items of the set of physical items in the physical vicinity of the user that match at least one item of the list of physical items of the particular ensemble template; and
in response to determining that the number of items exceeds a match threshold, determining that the set of physical items matches the list of physical items of the particular ensemble template.
5. The method of claim 1 , wherein the list of physical items comprises a plurality of clothing items worn by the user.
6. The method of claim 1 , wherein the list of physical items comprises a plurality of furniture items.
7. The method of claim 1 , wherein the list of physical items comprises a plurality of food items.
8. A system comprising:
control circuitry configured to:
receive a user interface input;
in response to determining that the user interface input is ambiguous:
access a plurality of ensemble templates, wherein each ensemble template comprises a list of physical items and a descriptive keyword;
a sensor configured to:
detect a set of physical items in a physical vicinity of a user associated with the user interface input; and
wherein the control circuitry is further configured to:
in response to determining that the set of physical items in the physical vicinity of the user matches a list of physical items of a particular ensemble template of the plurality of ensemble templates:
modify the user interface input with a descriptive keyword of the particular ensemble template; and
generate an output based on the modified user interface input.
9. The system of claim 8 , wherein the sensor is further configured to detect the set of physical items in the physical vicinity of the user associated with the user interface input by:
identifying a first item and a second item;
calculating a distance between the first item and the second item; and
in response to determining that the distance meets a vicinity threshold, adding the first item and the second item to the set of physical items.
10. The system of claim 8 , wherein the sensor is at least one of:
an Internet of Things sensor, a radio frequency identification (RFID) sensor, a video camera, an infrared sensor, and a near-field communication sensor.
11. The system of claim 8 , wherein the control circuitry is further configured to determine that the set of physical items in the physical vicinity of the user matches the list of physical items of the particular ensemble template by:
calculating a number of items of the set of physical items in the physical vicinity of the user that match at least one item of the list of physical items of the particular ensemble template; and
in response to determining that the number of items exceeds a match threshold, determining that the set of physical items matches the list of physical items of the particular ensemble template.
12. The system of claim 8 , wherein the list of physical items comprises a plurality of clothing items worn by the user.
13. The system of claim 8 , wherein the list of physical items comprises a plurality of furniture items.
14. The system of claim 8 , wherein the list of physical items comprises a plurality of food items.
15. A non-transitory computer readable medium comprising instructions that when executed by control circuitry causes the control circuitry to:
receive a user interface input;
in response to determining that the user interface input is ambiguous:
access a plurality of ensemble templates, wherein each ensemble template comprises a list of physical items and a descriptive keyword; and
detect, using a sensor, a set of physical items in a physical vicinity of a user associated with the user interface input;
in response to determining that the set of physical items in the physical vicinity of the user matches a list of physical items of a particular ensemble template of the plurality of ensemble templates:
modify the user interface input with a descriptive keyword of the particular ensemble template; and
generate an output based on the modified user interface input.
16. The non-transitory computer readable medium of claim 15 , wherein the instructions that cause the sensor to detect the set of physical items in the physical vicinity of the user associated with the user interface input further cause the sensor to:
identify a first item and a second item;
calculate a distance between the first item and the second item; and
in response to determining that the distance meets a vicinity threshold, add the first item and the second item to the set of physical items.
17. The non-transitory computer readable medium of claim 15 , wherein the sensor is at least one of:
an Internet of Things sensor, a radio frequency identification (RFID) sensor, a video camera, an infrared sensor, and a near-field communication sensor.
18. The non-transitory computer readable medium of claim 15 , wherein the instructions that cause the control circuitry to determine that the set of physical items in the physical vicinity of the user matches the list of physical items of the particular ensemble template further cause the control circuitry to:
calculate a number of items of the set of physical items in the physical vicinity of the user that match at least one item of the list of physical items of the particular ensemble template; and
in response to determining that the number of items exceeds a match threshold, determine that the set of physical items matches the list of physical items of the particular ensemble template.
19. The non-transitory computer readable medium of claim 15 , wherein the list of physical items comprises a plurality of clothing items worn by the user.
20. The non-transitory computer readable medium of claim 15 , wherein the list of physical items comprises a plurality of furniture items.