IP Library › Granted Patent US 12,711,628
Granted Patent B2
US 12,711,628 · App. 18/615,637 · Granted Aug 18, 2026

Systems and methods for extracting patches from digital images

Inventors: Qian Li (Sunnyvale, CA); Samrat Kokkula (Santa Clara, CA); Abon Chaudhuri (Sunnyvale, CA); Ashley Kim (San Francisco, CA); Alessandro Magnani (Menlo Park, CA)
Assignee: Walmart Apollo, LLC
G06V40/10G06F18/2321G06N7/01G06T7/11G06T7/194G06T11/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,711,628
App. No.
18/615,637
Filed
Mar 25, 2024
Granted
Aug 18, 2026
Kind
B2
Art Unit
2673
USPC
382/100
Abstract

A system including one or more processors and one or more non-transitory computer-readable media storing computing instructions that, when executed on the one or more processors, cause the one or more processors to perform operations: analyzing a respective foreground of one or more related digital images to identify a respective skin region in the respective foreground of the one or more related digital images; when the respective skin region is not identified, analyzing the respective foreground of the one or more related digital images to identify a respective head region in the respective foreground; extracting one or more patches from respective non-head region remainders of the respective foreground; and coordinating displaying a patch of the one or more patches on an electronic display based on one or more scores for the one or more patches. Other embodiments are described herein.

Claims (58)

1 . A system comprising:

one or more processors; and

one or more non-transitory computer-readable media storing computing instructions that, when executed on the one or more processors, cause the one or more processors to perform operations comprising:

analyzing a respective foreground of one or more related digital images to identify a respective skin region in the respective foreground of the one or more related digital images;

when the respective skin region is not identified, analyzing the respective foreground of the one or more related digital images to identify a respective head region in the respective foreground of the one or more related digital images;

extracting one or more patches from respective non-head region remainders of the respective foreground of the one or more related digital images; and

coordinating displaying a patch of the one or more patches on an electronic display based on one or more scores for the one or more patches.

2 . The system of claim 1 , wherein the one or more scores for the one or more patches indicate one or more probabilities of the one or more patches being representative of an item in the one or more related digital images.

3 . The system of claim 1 , wherein the operations further comprise:

when the respective head region is identified, clustering a non-head remainder of the respective foreground of the one or more related digital images into one or more clusters; and

determining the one or more scores for the one or more patches of the one or more related digital images.

4 . The system of claim 1 , wherein extracting the one or more patches further comprises:

creating one or more matrices from the one or more related digital images; and

extracting the one or more patches from the respective foreground of the one or more related digital images using the one or more matrices.

5 . The system of claim 4 , wherein each matrix of the one or more matrices comprises:

respective matrix dimensions matching image dimensions of a corresponding digital image of the one or more related digital images; and

a respective entry for each respective pixel in the corresponding digital image of the one or more related digital images.

6 . The system of claim 5 , wherein the respective entry for each respective pixel identifies each respective pixel as at least one of:

a background pixel when the respective pixel is not in the foreground;

a skin pixel when the respective pixel is in the respective skin region; or

a clustered pixel when the respective pixel is grouped into one or more clusters, wherein, when the respective head region is identified, the one or more clusters are formed by clustering a non-head remainder of the respective foreground of the one or more related digital images.

7 . The system of claim 1 , wherein the operations further comprise:

before analyzing the respective foreground of the one or more related digital images, resizing the one or more related digital images to a common size.

8 . The system of claim 1 , wherein the operations further comprise:

before analyzing the respective foreground of the one or more related digital images, identifying, using an image segmentation algorithm, the respective foreground of the one or more related digital images.

9 . The system of claim 1 , wherein analyzing the respective foreground of the one or more related digital images further comprises:

determining, by one or more colorimetric properties, the respective skin region in the one or more related digital images; and

identifying pixels within a predetermined color range labeled as the respective skin region.

10 . The system of claim 1 , wherein the operations further comprise:

when the respective skin region is identified, clustering, using a Gaussian mixture model, a non-skin remainder of the respective foreground of the one or more related digital images into one or more clusters.

11 . A method implemented via execution of computing instructions configured to run at one or more processors and configured to be stored at non-transitory computer-readable media, the method comprising:

analyzing a respective foreground of one or more related digital images to identify a respective skin region in the respective foreground of the one or more related digital images;

when the respective skin region is not identified, analyzing the respective foreground of the one or more related digital images to identify a respective head region in the respective foreground of the one or more related digital images;

extracting one or more patches from respective non-head region remainders of the respective foreground of the one or more related digital images; and

coordinating displaying a patch of the one or more patches on an electronic display based on one or more scores for the one or more patches.

12 . The method of claim 11 , wherein the one or more scores for the one or more patches indicate one or more probabilities of the one or more patches being representative of an item in the one or more related digital images.

13 . The method of claim 11 further comprising:

when the respective head region is identified, clustering a non-head remainder of the respective foreground of the one or more related digital images into one or more clusters; and

determining the one or more scores for the one or more patches of the one or more related digital images.

14 . The method of claim 11 , wherein extracting the one or more patches further comprises:

creating one or more matrices from the one or more related digital images; and

extracting the one or more patches from the respective foreground of the one or more related digital images using the one or more matrices.

15 . The method of claim 14 , wherein each matrix of the one or more matrices comprises:

respective matrix dimensions matching image dimensions of a corresponding digital image of the one or more related digital images; and

a respective entry for each respective pixel in the corresponding digital image of the one or more related digital images.

16 . The method of claim 15 , wherein the respective entry for each respective pixel identifies each respective pixel as at least one of:

a background pixel when the respective pixel is not in the foreground;

a skin pixel when the respective pixel is in the respective skin region; or

a clustered pixel when the respective pixel is grouped into one or more clusters, wherein, when the respective head region is identified, the one or more clusters are formed by clustering a non-head remainder of the respective foreground of the one or more related digital images.

17 . The method of claim 11 further comprising:

before analyzing the respective foreground of the one or more related digital images, resizing the one or more related digital images to a common size.

18 . The method of claim 11 further comprising:

before analyzing the respective foreground of the one or more related digital images, identifying, using an image segmentation algorithm, the respective foreground of the one or more related digital images.

19 . The method of claim 11 , wherein analyzing the respective foreground of the one or more related digital images further comprises:

determining, by one or more colorimetric properties, the respective skin region in the one or more related digital images; and

identifying pixels within a predetermined color range labeled as the respective skin region.

20 . The method of claim 11 further comprising:

when the respective skin region is identified, clustering, using a Gaussian mixture model, a non-skin remainder of the respective foreground of the one or more related digital images into one or more clusters.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 23, 2024
From: LI, QIAN; KOKKULA, SAMRAT; CHAUDHURI, ABON; KIM, ASHLEY; MAGNANI, ALESSANDRO
To: WALMART APOLLO, LLC
Reel/Frame 067193/0857 →
Continuity (2)
Continuation 17368691 · Jul 6, 2021
Related Publication 20240233432A1 · Jul 11, 2024
References Cited (9)
US 10096122B1 · Agrawal et al. · 2018 [cited by applicant]
US 11941905B2 · Li · 2024 [cited by examiner]
US 20140314313A1 · Kennedy et al. · 2014 [cited by applicant]
US 20150106235A1 · Gershon et al. · 2015 [cited by applicant]
US 20190294916A1 · Zhang · 2019 [cited by applicant]
KR 102110893 · 2020 [cited by applicant]
Kalantidis, Y., et al. “Getting the Look: Clothing Recognition and Segmentation for Automatic Product Suggestions in Everyday Photos,” Conference in Proceedings of International Conference on Multimedia Retrieval (ICMR)… [cited by applicant]
Rother, C., et al., “GrabCut: Interactive Foreground Extracting Using Interated Graph Cuts,” ACM Transactions on Graphics, Aug. 2004, 7 pgs. Aug. 2004. [cited by applicant]
Hernandez-Vela, A., et al., “GrabCut-Based Human Segmentation in Video Sequences,” Sensors 2012, 12, 15376-16393; doi:10.3390/s121115376, 19 pgs. 2012. [cited by applicant]