IP Library Granted Patent US 12,450,804
Granted Patent B2
US 12,450,804 · App. 18/587,452 · Granted Oct 21, 2025

Processing user selectable product images and facilitating visualization-assisted virtual dressing

Inventors: Alon Kristal (Tel Aviv, IL); Nir Appleboim (Tel Aviv, IL); Yael Wiesel (Ramat Gan, IL); Israel Harry Zimmerman (Los Angeles, CA)
Assignee: WALMART APOLLO, LLC
G06T11/60G06Q30/0643G06F3/0482G06N20/00G06N20/20G06T3/40G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,450,804
App. No.
18/587,452
Granted
Oct 21, 2025
Kind
B2
Abstract

A system including one or more processors and one or more non-transitory computer-readable media storing computing instructions that, when executed on the one or more processors, cause the one or more processors to perform operations: identifying a first subject matter in a first digital image; defining shapes for one or more regions in a second digital image of a second subject matter, wherein the one or more regions comprise at least one hidden area of the second subject matter that is obstructed by one or more objects; overlaying at least a first region of the one or more regions in the second digital image with another portion of the second subject matter; generating a composite image that depicts the first subject matter combined with the second subject matter having the at least the first region overlaid; and causing the composite image to be displayed. Other embodiments are described.

Claims (54)

1. A system comprising:

one or more processors; and

one or more non-transitory computer-readable media storing computing instructions that, when executed on the one or more processors, cause the one or more processors to perform operations comprising:

identifying a first subject matter in a first digital image;

defining shapes for one or more regions in a second digital image of a second subject matter, wherein the one or more regions comprise at least one hidden area of the second subject matter that is obstructed by one or more objects;

overlaying at least a first region of the one or more regions in the second digital image with another portion of the second subject matter that is not hidden in the second digital image;

generating a composite image that depicts the first subject matter combined with the second subject matter having the at least the first region overlaid; and

causing the composite image to be displayed.

2. The system of claim 1 , wherein identifying the first subject matter in the first digital image comprises identifying a respective estimated depth location of each portion of the first subject matter.

3. The system of claim 2 , wherein the operations further comprise:

processing the first digital image by at least:

identifying the respective estimated depth location of each portion of the first subject matter; and

generating a volume map of the first subject matter indicating a respective three-dimensional volume or a respective distance or a respective depth of each portion of the first subject matter.

4. The system of claim 3 , wherein identifying the respective estimated depth location of each portion of the first subject matter comprises creating a 3D estimation, a 3D volume, a 3D mesh extraction, or 3D surface coordinates of the first subject matter.

5. The system of claim 4 , wherein the operations further comprise:

adding, removing, enhancing, or modifying one or more portions of the first subject matter in the composite image to generate a gravitationally realistic appearance of the first subject matter combined with the second subject matter.

6. The system of claim 1 , wherein:

defining the shapes further comprises:

interpolating, using shape-estimation, the shapes for the one or more regions in the second digital image of the second subject matter; and

overlying the at least the first region further comprises:

filling in the one or more regions based on the shapes.

7. The system of claim 1 , wherein overlying the at least the first region further comprises:

processing the second digital image by at least inserting or combining at least one region of the one or more regions with another portion of the second subject matter that is not hidden in the second digital image.

8. The system of claim 7 , wherein processing the second digital image further comprises processing the second subject matter to create a 3D estimation or a 3D volume of the second subject matter.

9. The system of claim 8 , wherein the operations further comprise:

identifying the one or more regions in the second digital image; and

adding, removing, enhancing or modifying one or more of the one or more regions in the second subject matter in the composite image in order to generate a gravitationally realistic appearance of the first subject matter combined with the second subject matter.

10. The system of claim 1 , wherein the composite image is displayed as a virtual presentation on a device selected from the group consisting of a smartphone, a tablet, a smart-watch, a magic mirror device, a laptop computer, a desktop computer, the device having an imager or a camera, a vehicular device or a vehicular unit, a gaming device, a gaming console, a wearable device, a Virtual Reality (VR) device or a VR helmet or VR glasses or VR headgear, an Augmented Reality (AR) device or an AR helmet or AR glasses or AR headgear, an Internet of Things (IoT) device or an IoT appliance, an Internet-connected device or an Internet-connected appliance, or a wireless-connected device or a wireless-connected appliance.

11. A method implemented via execution of computing instructions configured to run on one or more processors and stored at one or more non-transitory media, the method comprising:

identifying a first subject matter in a first digital image;

defining shapes for one or more regions in a second digital image of a second subject matter, wherein the one or more regions comprise at least one hidden area of the second subject matter that is obstructed by one or more objects;

overlaying at least a first region of the one or more regions in the second digital image with another portion of the second subject matter that is not hidden in the second digital image;

generating a composite image that depicts the first subject matter combined with the second subject matter having the at least the first region overlaid; and

causing the composite image to be displayed as a virtual presentation.

12. The method of claim 11 , wherein identifying the first subject matter in the first digital image comprises identifying a respective estimated depth location of each portion of the first subject matter.

13. The method of claim 11 further comprising:

processing the first digital image by at least:

identifying the respective estimated depth location of each portion of the first subject matter; and

generating a volume map of the first subject matter indicating a respective three-dimensional volume or a respective distance or a respective depth of each portion of the first subject matter.

14. The method of claim 13 , wherein identifying the respective estimated depth location of each portion of the first subject matter comprises creating a 3D estimation, a 3D volume, a 3D mesh extraction, or 3D surface coordinates of the first subject matter.

15. The method of claim 14 further comprising:

adding, removing, enhancing, or modifying one or more portions of the first subject matter in the composite image to generate a gravitationally realistic appearance of the first subject matter combined with the second subject matter.

16. The method of claim 11 , wherein:

defining the shapes further comprises:

interpolating, using shape-estimation, the shapes for the one or more regions in the second digital image of the second subject matter; and

overlying the at least the first region further comprises:

filling in the one or more regions based on the shapes.

17. The method of claim 11 , wherein overlying the at least the first region further comprises:

processing the second digital image by at least inserting or combining at least one region of the one or more regions with another portion of the second subject matter that is not hidden in the second digital image.

18. The method of claim 17 , wherein processing the second digital image further comprises processing the second subject matter to create a 3D estimation or a 3D volume of the second subject matter.

19. The method of claim 18 further comprising:

identifying the one or more regions in the second digital image; and

adding, removing, enhancing or modifying one or more of the one or more regions in the second subject matter in the composite image in order to generate a gravitationally realistic appearance of the first subject matter combined with the second subject matter.

20. The method of claim 11 , wherein the composite image is displayed as a virtual presentation on a device selected from the group consisting of a smartphone, a tablet, a smart-watch, a magic mirror device, a laptop computer, a desktop computer, the device having an imager or a camera, a vehicular device or a vehicular unit, a gaming device, a gaming console, a wearable device, a Virtual Reality (VR) device or a VR helmet or VR glasses or VR headgear, an Augmented Reality (AR) device or an AR helmet or AR glasses or AR headgear, an Internet of Things (IoT) device or an IoT appliance, an Internet-connected device or an Internet-connected appliance, or a wireless-connected device or a wireless-connected appliance.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2025
From: KRISTAL, ALON; APPLEBOIM, NIR; WIESEL, YAEL; ZIMMERMAN, ISRAEL HARRY
To: ZEEKIT ONLINE SHOPPING LTD.
Reel/Frame 070879/0900 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2025
From: ZEEKIT ONLINE SHOPPING LTD.
To: WALMART INC.
Reel/Frame 070879/0956 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2025
From: WALMART INC.
To: WALMART APOLLO, LLC
Reel/Frame 070880/0321 →
Continuity (7)
Continuation 17862374 · Jul 11, 2022
Continuation 16914968 · Jun 29, 2020
Continuation 16657121 · Oct 18, 2019
Continuation 16279558 · Feb 19, 2019
Continuation 15263034 · Sep 12, 2016
Provisional Application 62372813 · Aug 10, 2016
Related Publication 20240203009A1 · Jun 20, 2024
References Cited (44)
US 5960411A · Hartman et al. · 1999 [cited by applicant]
US 6307568B1 · Rom · 2001 [cited by applicant]
US 6556222B1 · Narayanaswami · 2003 [cited by applicant]
US 9470911B2 · Forte et al. · 2016 [cited by applicant]
US 10290136B2 · Kristal et al. · 2019 [cited by applicant]
US 10474670B1 · Hoover · 2019 [cited by applicant]
US 10489955B2 · Kristal et al. · 2019 [cited by applicant]
US 11386601B2 · Kristal et al. · 2022 [cited by applicant]
US 20020126132A1 · Karatoassos et al. · 2002 [cited by applicant]
US 20090002397A1 · Forlines et al. · 2009 [cited by applicant]
US 20090300676A1 · Harter, Jr. · 2009 [cited by applicant]
US 20100111370A1 · Black et al. · 2010 [cited by applicant]
US 20100201682A1 · Quan et al. · 2010 [cited by applicant]
US 20100231583A1 · Furukawa · 2010 [cited by examiner]
US 20100262616A1 · Eskolin et al. · 2010 [cited by applicant]
US 20110078055A1 · Faribault et al. · 2011 [cited by applicant]
US 20110234615A1 · Hanson · 2011 [cited by examiner]
US 20120306918A1 · Suzuki et al. · 2012 [cited by applicant]
US 20130050260A1 · Reitan · 2013 [cited by examiner]
US 20130215116A1 · Siddique et al. · 2013 [cited by applicant]
US 20140176565A1 · Adeyoola et al. · 2014 [cited by applicant]
US 20140188670A1 · Ajala · 2014 [cited by applicant]
US 20140226900A1 · Saban et al. · 2014 [cited by applicant]
US 20140314313A1 · Kennedy et al. · 2014 [cited by applicant]
US 20140359483A1 · Forutanpour et al. · 2014 [cited by applicant]
US 20150279113A1 · Knorr et al. · 2015 [cited by applicant]
US 20150302036A1 · Kumar et al. · 2015 [cited by applicant]
US 20150339348A1 · Joo et al. · 2015 [cited by applicant]
US 20150348273A1 · Chapiro · 2015 [cited by examiner]
US 20160042233A1 · Sen et al. · 2016 [cited by applicant]
US 20160165989A1 · Glasgow et al. · 2016 [cited by applicant]
US 20180047192A1 · Kristal et al. · 2018 [cited by applicant]
US 20200118318A1 · Kristal et al. · 2020 [cited by applicant]
US 20210090209A1 · Appleboim et al. · 2021 [cited by applicant]
Guillemot et al—Image-Inpainting-Overview-and-Recent-Advances—2014—IEEE (Year: 2014). [cited by examiner]
Wang et al—Representing_moving_images_with_layers—1994—IEEE (Year: 1994). [cited by examiner]
Oliveira, et al—Selective hole-filling for depth-image based rendering—2015—IEEE (Year: 2015). [cited by examiner]
Wikipedia, “Polyvore” Feb. 2007 (4 pages) Feb. 2007. [cited by applicant]
McKinsey, R., “Israeli Start-Ups Make Online Shopping Easier,” The Times of Israel, http://www.timesofisrael.com/shoes-style-and-startups/, Feb. 18, 2014 (4 pages) Feb. 18, 2014. [cited by applicant]
Goldenberg, R., “The Google of Fashion,” Globes Israel's Business Arena, http://www.globes.co.il/en/article-the-google-of-fashion-1000951381, Jul. 3, 2014 (4 pages) Jul. 3, 2014. [cited by applicant]
Wolf, J., “Meet the Top Ten Israeli Companies Revolutionizing Fashion Tech,” Nocamels Israeli Innovation News, http://nocamels.com/2015/02/israel-fashion-tech/, Feb. 2015 (34 pages) Feb. 2015. [cited by applicant]
Pajevic, J., “How to Blend an Image into a Background Using Photoshop_Creating a Webstore,” Mar. 30, 2016, http://www.creatingawebstore.com (12 pages) Mar. 30, 2016. [cited by applicant]
Rogge, L., et al., “Garment Replacement in Monocular Video Sequences,” 2014, ACM (Year: 2014) (10 pages) 2014. [cited by applicant]
Adriano Oliviera, Guilherme Fickel, Marcelo Walter, Cl'audio Jung, “Selective Hole-Filling for Depth-Image Based Rendering”, 2015, ieee (yEAR: 2015) 2015. [cited by applicant]