Generating structured queries from images
Images of items often include a significant amount of information that can be used in categorizing the item (e.g., as a book, a phone, or an accessory) or in identifying attributes of the item (e.g., the item's color or style). A user provides a search query for listings of items. Images of items in listings previously selected by users providing the same search query are analyzed to identify the category or attributes of the depicted items. The identified category or attributes are added to the user's search query. Listings matching the modified search query are provided to the user.
1. A system comprising:
a memory having instructions embodied thereon; and
one or more processors configured by the instructions to perform operations comprising:
accessing a listing that includes an image and a seller-provided attribute;
applying an image classifier to the image, the image classifier trained to identify an attribute associated with the image; and
based on the applying, automatically identifying the attribute associated with the image;
comparing the automatically identified attribute to the seller-provided attribute;
determining the seller-provided attribute conflicts with the automatically identified attribute, the automatically identified attribute and the seller-provided attribute corresponding to a size, a brand, a color, a category, or a style; and
upon determining the seller-provided attribute conflicts with the automatically identified attribute, automatically replacing or providing an option to replace the seller-provided attribute with the automatically identified attribute for the listing.
2. The system of claim 1 , wherein the processing comprises determining an identifier for the attribute of the image.
3. The system of claim 2 , further comprising, upon determining the seller-provided attribute conflicts with the attribute, flagging the listing as misleading.
4. The system of claim 1 , further comprising, upon determining the seller-provided attribute conflicts with the attribute, communicating an alert for the listing to an administrator for review.
5. The system of claim 1 , wherein the attribute or seller-provided attribute includes at least one of a size, a brand, or a style.
6. The system of claim 1 , wherein the seller-provided attribute is based on text associated with the listing.
7. The system of claim 1 , further comprising training the image classifier to identify the attribute associated with the image based on attributes associated with images of other listings.
8. A method comprising:
accessing a listing that includes an image and a seller-provided attribute;
applying an image classifier to the image, the image classifier trained to identify an attribute associated with the image;
based on the applying, automatically identifying the attribute associated with the image;
comparing the automatically identified attribute to the seller-provided attribute;
determining the seller-provided attribute conflicts with the automatically identified attribute, the automatically identified attribute and the seller-provided attribute corresponding to a size, a brand, a color, a category, or a style; and
upon determining the seller-provided attribute conflicts with the automatically identified attribute, automatically replacing or providing an option to replace the seller-provided attribute with the automatically identified attribute for the listing.
9. The system of claim 8 , wherein the attribute or seller-provided attribute includes at least one of a size, a brand, or a style.
10. The system of claim 8 , wherein the seller-provided attribute is based on text associated with the listing.
11. The system of claim 8 , further comprising training the image classifier to identify the attribute associated with the image based on attributes associated with images of other listings.
12. A machine-readable medium having instructions embodied thereon, the instructions executable by one or more processors of a machine to perform operations comprising:
accessing a listing that includes an image and a seller-provided attribute;
automatically determining an attribute of the image;
comparing the automatically identified attribute to the seller-provided attribute;
determining the seller-provided attribute conflicts with the automatically identified attribute, the automatically identified attribute and the seller-provided attribute corresponding to a size, a brand, a color, a category, or a style;
flagging the listing as misleading; and
upon determining the seller-provided attribute conflicts with the automatically identified attribute, automatically replacing or providing an option to replace the seller-provided attribute with the automatically identified attribute for the listing.
13. The system of claim 12 , wherein the attribute or seller-provided attribute includes at least one of a size, a brand, or a style.
14. The system of claim 12 , wherein the seller-provided attribute is based on text associated with the listing.
15. The system of claim 12 , further comprising training the image classifier to identify the attribute associated with the image based on attributes associated with images of other listings.
16. The system of claim 12 , further comprising communicating an alert for the listing to an administrator for review.