Processing user selectable product images and facilitating visualization-assisted virtual dressing
A technique for combining first and second images respectively depicting first and second subject matter to facilitate virtual presentation. The first image is processed to identify portions or regions of the first subject matter and determine an estimated depth location of each portion or region. A composite image is generated that depicts the second subject matter overlayed, inserted or otherwise combined with the first subject matter. One or more of the portions or regions of the first subject matter are added, removed, enhanced or modified in the composite image in order to generate a realistic appearance of the first subject matter combined with the second subject matter. The composite image is caused to be displayed as a virtual presentation.
1. A system comprising:
one or more processors; and
one or more non-transitory computer-readable media storing computing instructions that, when executed on the one or more processors, cause the one or more processors to perform operations comprising:
processing a first digital image by identifying each portion of a first subject matter in the first digital image;
processing a second digital image by at least:
interpolating shapes for hidden areas of a second subject matter in the second digital image, wherein the shapes for the hidden areas compromise one or more regions in the second digital image obstructed by one or more objects in the second digital image;
filling in the one or more regions with color or texture in the second digital image located near the one or more regions in the second digital image; and
overlaying at least one first region of the one or more regions, as filled in, with another portion of the second subject matter that is not hidden in the second digital image;
generating a composite image that depicts the first subject matter combined with the second subject matter having the one or more regions filled in and having the at least one first region overlaid; and
causing the composite image to be displayed as a virtual presentation.
2. The system of claim 1 , wherein identifying each portion of the first subject matter in the first digital image comprises identifying a respective estimated depth location of each portion of the first subject matter.
3. The system of claim 1 , wherein:
interpolating the shapes for the hidden areas of the second subject matter in the second digital image comprises using shape-estimation; and
filling in the one or more regions comprises using shape in-painting.
4. The system of claim 1 , wherein processing the second digital image further comprises inserting or otherwise combining at least one second region of the one or more regions, as filled in, with another portion of the second subject matter that is not hidden in the second digital image.
5. The system of claim 1 , wherein the computing instructions, when executed by the one or more processors, further cause the one or more processors to perform operations comprising:
adding, removing, enhancing, or modifying one or more portions of the first subject matter in the composite image to generate a realistic appearance of the first subject matter combined with the second subject matter; and
identifying the one or more regions in the second digital image and adding, removing, enhancing or modifying one or more of the one or more regions in the second subject matter in the composite image in order to generate the realistic appearance of the first subject matter combined with the second subject matter.
6. The system of claim 1 , wherein processing the first digital image further comprises:
identifying a respective estimated depth location of each portion of the first subject matter; and
generating a volume map of the first subject matter indicating a respective three-dimensional volume or a respective distance or a respective depth of each portion of the first subject matter.
7. The system of claim 6 , wherein identifying the respective estimated depth location of each portion of the first subject matter comprises creating a 3D estimation, a 3D volume, a 3D mesh extraction, or 3D surface coordinates of the first subject matter.
8. The system of claim 1 , wherein processing the second digital image further comprises processing the second subject matter to create a 3D estimation or a 3D volume of the second subject matter.
9. The system of claim 1 , wherein the first digital image and the second digital image each comprise one or more of a respective image, a respective video, a respective stereoscopic image, or a respective three-dimensional representation of the first subject matter or the second subject matter.
10. The system of claim 1 , wherein the composite image is displayed as the virtual presentation on a device selected from the group consisting of a smartphone, a tablet, a smart-watch, a magic mirror device, a laptop computer, a desktop computer, the device having an imager or a camera, a vehicular device or a vehicular unit, a gaming device, a gaming console, a wearable device, a Virtual Reality (VR) device or a VR helmet or VR glasses or VR headgear, an Augmented Reality (AR) device or an AR helmet or AR glasses or AR headgear, an Internet of Things (IoT) device or an IoT appliance, an Internet-connected device or an Internet-connected appliance, and a wireless-connected device or a wireless-connected appliance.
11. A method being implemented via execution of computing instructions configured to run on one or more processors and stored at one or more non-transitory computer-readable media, the method comprising:
processing a first digital image by identifying each portion of a first subject matter in the first digital image;
processing a second digital image by at least:
interpolating shapes for hidden areas of a second subject matter in the second digital image, wherein the shapes for the hidden areas compromise one or more regions in the second digital image obstructed by one or more objects in the second digital image;
filling in the one or more regions with color or texture in the second digital image located near the one or more regions in the second digital image; and
overlaying at least one first region of the one or more regions, as filled in, with another portion of the second subject matter that is not hidden in the second digital image;
generating a composite image that depicts the first subject matter combined with the second subject matter having the one or more regions filled in and having the at least one first region overlaid; and
causing the composite image to be displayed as a virtual presentation.
12. The method of claim 11 , wherein identifying each portion of the first subject matter in the first digital image comprises a respective estimated depth location of each portion of the first subject matter.
13. The method of claim 11 , wherein:
interpolating the shapes for the hidden areas of the second subject matter in the second digital image comprises using shape-estimation; and
filling in the one or more regions comprises using shape in-painting.
14. The method of claim 11 , wherein processing the second digital image further comprises inserting or otherwise combining at least one second region of the one or more regions, as filled in, with another portion of the second subject matter that is not hidden in the second digital image.
15. The method of claim 11 , further comprising:
adding, removing, enhancing, or modifying one or more portions of the first subject matter in the composite image to generate a realistic appearance of the first subject matter combined with the second subject matter; and
identifying the one or more regions in the second digital image and adding, removing, enhancing or modifying one or more of the one or more regions in the second subject matter in the composite image in order to generate the realistic appearance of the first subject matter combined with the second subject matter.
16. The method of claim 11 , wherein processing the first digital image comprises:
identifying a respective estimated depth location of each portion of the first subject matter; and
generating a volume map of the first subject matter indicating a respective three-dimensional volume or a respective distance or a respective depth of each portion of the first subject matter.
17. The method of claim 16 , wherein identifying the respective estimated depth location of each portion of the first subject matter comprises creating a 3D estimation, a 3D volume, a 3D mesh extraction, or 3D surface coordinates of the first subject matter.
18. The method of claim 11 , wherein processing the second digital image further comprises processing the second subject matter to create a 3D estimation or a 3D volume of the second subject matter.
19. The method of claim 11 , wherein the first digital image and the second digital image each comprise one or more of a respective image, a respective video, a respective stereoscopic image, or a respective three-dimensional representation of the first subject matter or the second subject matter.
20. The method of claim 11 , wherein the composite image is displayed as the virtual presentation on a device selected from the group consisting of a smartphone, a tablet, a smart-watch, a magic mirror device, a laptop computer, a desktop computer, the device having an imager or a camera, a vehicular device or a vehicular unit, a gaming device, a gaming console, a wearable device, a Virtual Reality (VR) device or a VR helmet or VR glasses or VR headgear, an Augmented Reality (AR) device or an AR helmet or AR glasses or AR headgear, an Internet of Things (IoT) device or an IoT appliance, an Internet-connected device or an Internet-connected appliance, and a wireless-connected device or a wireless-connected appliance.