Automatic guided capturing and presentation of images
Disclosed are embodiments for facilitating automatic-guided image capturing and presentation. In some embodiments, the method includes capturing an image of an item, removing a background of the image frame, performing manual mask editing, generating an item listing based on the manually edited mask, inferring item information from the image frame and applying the inferred item information to an item listing.
1. A method, comprising:
causing display of guidance to position a mobile device in a direction from an item such that the item is included within a bounded area of a user interface of the mobile device;
classifying, based on a color histogram of a first image, a first portion of pixels in the first image as background pixels, the first image captured by the mobile device;
modifying the first image to generate a second image representing the item, the modifying based on a color histogram of the first image;
causing display of the second image on an electronic display of the mobile device;
classifying a second portion of pixels in the second image as background pixels, the classifying based on received data indicative of a user input on the displayed second image;
modifying, based on the classifying, the second image to generate a third image representing the item;
generating an item listing for the item based on information determined from the third image, the generating including automatically filling at least part of the item listing; and
causing display of the third image included in the item listing.
2. The method of claim 1 , wherein the third image and the item listing are further caused to be displayed in an augmented reality environment of an online store, wherein the item is presented on a virtual shelf or a virtual clothing rack of the online store.
3. The method of claim 1 , wherein the user input on the displayed second image is a scribble.
4. The method of claim 1 , wherein causing display of the second image further comprises causing display of a binary mask of the second image, and wherein the receiving of the data defining the user input further comprises receiving input defining one or more changes to the binary mask.
5. The method of claim 1 , wherein the information determined from the third image includes one or more of a color of the item, a style of the item, a category of the item, or a brand name of the item.
6. The method of claim 1 , further comprising:
causing display of the item listing as a form to enable completion of the form, the form including the information determined from the third image.
7. The method of claim 1 , wherein automatically filling at least part of the item listing is based on inferring information from the first image.
8. A system, comprising:
hardware processing circuitry;
one or more hardware memories storing instructions that when executed configure cause the hardware processing circuitry to perform operations comprising:
causing display of guidance to position a mobile device in a direction from an item such that the item is included within a bounded area of a user interface of the mobile device;
classifying, based on a color histogram of a first image, a first portion of pixels in the first image as background pixels, the first image captured by the mobile device;
modifying the first image to generate a second image representing the item, the modifying based on a color histogram of the first image;
causing display of the second image on an electronic display of the mobile device;
classifying a second portion of pixels in the second image as background pixels, the classifying based on received data indicative of a user input on the displayed second image;
modifying, based on the classifying, the second image to generate a third image representing the item;
generating an item listing for the item based on information determined from the third image, the generating including automatically filling at least part of the item listing; and
causing display of the third image included in the item listing.
9. The system of claim 8 , wherein the third image and the item listing are further caused to be displayed in an augmented reality environment of an online store, wherein the item is presented on a virtual shelf or a virtual clothing rack of the online store.
10. The system of claim 8 , wherein the user input on the displayed second image is a scribble.
11. The system of claim 8 , wherein causing display of the second image further comprises causing display of a binary mask of the second image, and wherein the receiving of the data defining the user input further comprises receiving input defining one or more changes to the binary mask.
12. The system of claim 8 , wherein the information determined from the third image includes one or more of a color of the item, a style of the item, a category of the item, or a brand name of the item.
13. The system of claim 8 , further comprising:
causing display of the item listing as a form to enable completion of the form, the form including the information determined from the third image.
14. The system of claim 8 , wherein automatically filling at least part of the item listing is based on inferring information from the first image.
15. A non-transitory computer readable storage medium comprising instructions that when executed configure hardware processing circuitry to perform operations comprising:
causing display of guidance to position a mobile device in a direction from an item such that the item is included within a bounded area of a user interface of the mobile device;
classifying, based on a color histogram of a first image, a first portion of pixels in the first image as background pixels, the first image captured by the mobile device;
modifying the first image to generate a second image representing the item, the modifying based on a color histogram of the first image;
causing display of the second image on an electronic display of the mobile device;
classifying a second portion of pixels in the second image as background pixels, the classifying based on received data indicative of a user input on the displayed second image;
modifying, based on the classifying, the second image to generate a third image representing the item;
generating an item listing for the item based on information determined from the third image, the generating including automatically filling at least part of the item listing; and
causing display of the third image included in the item listing.
16. The non-transitory computer readable storage medium of claim 15 , wherein the third image and the item listing are further caused to be displayed in an augmented reality environment of an online store, wherein the item is presented on a virtual shelf or a virtual clothing rack of the online store.
17. The non-transitory computer readable storage medium of claim 15 , wherein the user input on the displayed second image is a scribble.
18. The non-transitory computer readable storage medium of claim 15 , wherein causing display of the second image further comprises causing display of a binary mask of the second image, and wherein the receiving of the data defining the user input further comprises receiving input defining one or more changes to the binary mask.
19. The non-transitory computer readable storage medium of claim 15 , wherein the information determined from the third image includes one or more of a color of the item, a style of the item, a category of the item, or a brand name of the item.
20. The non-transitory computer readable storage medium of claim 15 , wherein automatically filling at least part of the item listing is based on inferring information from the first image.