Methods and systems for disambiguating user input based on detection of ensembles of items
Systems and methods are described for disambiguating user input based on a physical location of items in a vicinity of a user. The system determines that a query received from a user contains an ambiguity. In response, the system identifies several items in the physical vicinity of the user. Then, the system analyzes the identified plurality of items to determine whether the plurality of items forms a first ensemble of items or a second ensemble of items. If the plurality of items forms a first ensemble of items, the system performs a search using the search query and a first keyword related to the first ensemble of items. If the plurality of items forms a second ensemble of items, the system performs a search using the search query and a second keyword related to the second ensemble of items. The system then outputs results of the performed search.
1. A method for disambiguating user input based on a physical location of items in a vicinity of a user, the method comprising:
accessing a list of ensemble templates, each ensemble template identifying a plurality of physical items and a descriptive keyword;
receiving a search query from the user;
determining that the search query received from the user comprises a portion with multiple possible meanings;
in response to determining that the search query comprises the portion with multiple possible meanings:
detecting, using a sensor, a set of items in a physical vicinity of the user;
determining whether the set of items matches a plurality of physical items identified by first ensemble template of the list of ensemble templates; and
in response to determining that the set of items matches the plurality of physical items identified by the first ensemble template:
adding a descriptive keyword identified by the first ensemble template to the search query received from the user to generate a modified search query;
performing a search based on the modified search query; and
generating for display the results of the performed search.
2. The method of claim 1 , further comprising:
in response to determining that the search query comprises the portion with multiple possible meanings:
determining whether the set of items matches a plurality of physical items identified by a second ensemble template of the list of ensemble templates; and
in response to determining that the set of items matches the plurality of physical items identified by the second ensemble template of the list of ensemble templates:
adding a descriptive keyword identified by the second ensemble template to the search query received from the user to generate the modified search query.
3. The method of claim 1 , wherein detecting the set of items in the physical vicinity of the user comprises:
identifying a first item and a second item;
calculating distance between the first item and the second item;
determining whether the distance corresponds to a vicinity threshold; and
in response to determining that the distance corresponds to the vicinity threshold, adding the first item and the second item to the set of items.
4. The method of claim 1 , wherein determining whether the set of items matches the plurality of physical items identified by the first ensemble template comprises:
calculating the number of items of the set of items that match at least one item of the plurality of physical items identified by the first ensemble template; and
in response to determining that the number exceeds a match threshold, determining that the set of items matches the plurality of physical items of the first ensemble template.
5. The method of claim 1 , wherein the set of items comprises a first plurality of clothing items worn by the user.
6. The method of claim 5 , wherein the first ensemble template identifies a second plurality of clothing items and identifies a dress code keyword, the method further comprising:
in response to determining that the set of items matches the plurality of physical items identified by the first ensemble template of the list of ensemble templates, adding the dress code keyword to the search query received from the user to generate the modified search query.
7. The method of claim 1 , wherein the set of items comprises a first plurality of furniture items.
8. The method of claim 7 , wherein the first ensemble template identifies a second plurality of furniture items and identifies a furniture arrangement keyword, the method further comprising:
in response to determining that the set of items matches the plurality of physical items identified by the first ensemble template of the list of ensemble templates, adding the furniture arrangement keyword to the search query received from the user to generate the modified search query.
9. The method of claim 1 , wherein the set of items comprises a first plurality of food items.
10. The method of claim 9 , wherein the first ensemble template identifies a second plurality of food items and identifies a recipe keyword, the method further comprising:
in response to determining that the set of items matches the plurality of physical items identified by the first ensemble template of the list of ensemble templates, adding the recipe keyword to the search query received from the user to generate the modified search query.
11. A system for disambiguating user input based on a physical location of items in a vicinity of a user, the system comprising:
control circuitry configured to:
access a list of ensemble templates, each ensemble template identifying a plurality of physical items and a descriptive keyword;
receive a search query from the user;
determine that the search query received from the user comprises a portion with multiple possible meanings;
in response to determining that the search query comprises the portion with multiple possible meanings:
detect, using a sensor, a set of items in a physical vicinity of the user;
determine whether the set of items matches a plurality of physical items identified by first ensemble template of the list of ensemble templates; and
in response to determining that the set of items matches the plurality of physical items identified by the first ensemble template:
add a descriptive keyword identified by the first ensemble template to the search query received from the user to generate a modified search query;
perform a search based on the modified search query; and
generate for display results of the performed search.
12. The system of claim 11 , wherein the control circuitry is further configured to:
in response to determining that the search query comprises the portion with multiple possible meanings:
determine whether the set of items matches a plurality of physical items identified by a second ensemble template of the list of ensemble templates; and
in response to determining that the set of items matches the plurality of physical items identified by the second ensemble template of the list of ensemble templates:
add a descriptive keyword identified by the second ensemble template to the search query received from the user to generate the modified search query.
13. The system of claim 11 , wherein the control circuitry is further configured to detect the set of items in the physical vicinity of the user by:
identifying a first item and a second item;
calculating distance between the first item and the second item;
determining whether the distance corresponds to a vicinity threshold; and
in response to determining that the distance corresponds to the vicinity threshold, adding the first item and the second item to the set of items.
14. The system of claim 11 , wherein the control circuitry is further configured to determine whether the set of items matches the plurality of physical items identified by the first ensemble template by:
calculating the number of items of the set of items that match at least one item of the plurality of physical items identified by the first ensemble template; and
in response to determining that the number exceeds a match threshold, determining that the set of items matches the plurality of physical items of the first ensemble template.
15. The system of claim 11 , wherein the set of items comprises a first plurality of clothing items worn by the user.
16. The system of claim 15 , wherein the first ensemble template identifies a second plurality of clothing items and identifies a dress code keyword, wherein the control circuitry is further configured to:
in response to determining that the set of items matches the plurality of physical items identified by the first ensemble template of the list of ensemble templates, add the dress code keyword to the search query received from the user to generate the modified search query.
17. The system of claim 11 , wherein the set of items comprises a first plurality of furniture items.
18. The system of claim 17 , wherein the first ensemble template identifies a second plurality of furniture items and identifies a furniture arrangement keyword, wherein the control circuitry is further configured to:
in response to determining that the set of items matches the plurality of physical items identified by the first ensemble template of the list of ensemble templates, add the furniture arrangement keyword to the search query received from the user to generate the modified search query.
19. The system of claim 11 , wherein the set of items comprises a first plurality of food items.
20. The system of claim 19 , wherein the first ensemble template identifies a second plurality of food items and identifies a recipe keyword, wherein the control circuitry is further configured to:
in response to determining that the set of items matches the plurality of physical items identified by the first ensemble template of the list of ensemble templates, add the recipe keyword to the search query received from the user to generate the modified search query.