IP Library Granted Patent US 12,062,224
Granted Patent B2
US 12,062,224 · App. 17/581,035 · Granted Aug 13, 2024

Method of identifying similars in clothing images

Inventors: Bharat Vijay (Fremont, CA); Jayanth Vijayaraghavan (Palo Alto, CA); Arvind Prabhakar (Bengaluru, IN); Ayyar Arun Balavenkatasubramanian (Chennai, IN); Srihari Padmanaban Venkatesan (Chennai, IN)
Assignee: UNISENSE TECH, INC.
G06V10/761G06T11/60G06V10/245G06V10/255G06V10/56G06V20/20G06T2200/24G06T2210/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,062,224
App. No.
17/581,035
Granted
Aug 13, 2024
Kind
B2
Abstract

Described herein is a system and computer implemented method for finding similars for a selected clothing image amongst a set of clothing images in an electronic catalog in an online store serving online customers. An object detection model is applied to extract the clothing section within the clothing images to create a preprocessed image. A first machine learning model is applied on the preprocessed image(s) to convert the colors and textures of said preprocessed image into a first set of vector representations. A second machine learning model is applied on the preprocessed image(s) to convert the shapes of said preprocessed image into a second set of vector representations. Operations of mapping nearest vectors, matching attributes, sorting and ranking are performed, and thereafter similar images are displayed to the online customer.

Claims (44)

1. A system for identifying similars for a selected image amongst a set of clothing images in an electronic catalog, comprising:

a processor; and

a memory containing instructions, when executed by the processor, configure the system to:

apply an object detection model to extract a clothing section within said clothing images to create a preprocessed image;

apply a first machine learning model on said preprocessed image(s) to convert colors and textures of said preprocessed image into a first set of vector representations and thereafter store said first set of vector representations in a vector database;

apply a second machine learning model on said preprocessed image(s) to convert shapes of said preprocessed image into a second set of vector representations and thereafter store said second set of vector representations in said vector database;

map and identify a set of n nearest vectors of said first set of vectors with the vector of said selected image from said vector database;

map and identify a set of m nearest vectors of said second set of vectors with the vector of said selected image from said vector database;

identify a set of n images corresponding to said set of n nearest vectors;

identify a set of m images corresponding to said set of m nearest vectors;

apply an attribute extraction model to identify clothing attributes of said selected image;

apply an attribute extraction model to identify clothing attributes of each image in each set of said identified sets of n and m images;

match attributes between said identified clothing attributes of said selected image and said identified clothing attributes of each image in each set of said identified sets of n and m images;

sort and rank, based on said match, each image of said identified set of n images and each image of said identified set of m images; and

display on a user interface said sorted and ranked sets of n and m images.

2. The system of claim 1 , wherein said clothing attributes comprises one or more of design of collar, shape of collar, shape of sleeve, and text and numbering content of said preprocessed image.

3. The system of claim 1 , wherein said first machine learning model is a Bootstrap Your Own Latent (BYOL) model.

4. The system of claim 3 , wherein said BYOL model is trained to create different views of the same image utilizing a random cropping augmentation technique.

5. The system of claim 3 , wherein said BYOL model is trained to create different views of the same image utilizing a left-right flip augmentation technique.

6. The system of claim 3 , wherein said BYOL model is trained to create different views of the same image utilizing one or more of a color jittering and color dropping augmentation technique.

7. The system of claim 1 , wherein said second machine learning model is a non-parametric instance-level discrimination model.

8. The method of claim 1 , wherein the system is further configured to:

select images common to said sorted and ranked sets of n and m images; and

display said selected common images on said user interface.

9. A method for identifying similars for a selected clothing image amongst a set of clothing images in an electronic catalog, comprising:

applying a object detection model to extract a clothing section within said clothing images to create a preprocessed image;

applying a first machine learning model on said preprocessed image(s) to convert colors and textures of said preprocessed image into a first set of vector representations and thereafter store said first set of vector representations in a vector database;

applying a second machine learning model on said preprocessed image(s) to convert shapes of said preprocessed image into a second set of vector representations and thereafter store said second set of vector representations in said vector database;

applying a non-parametric instance-level discrimination model to generate a second set of vector representation of clothing images in the electronic catalog to determine a second set of similar images;

mapping and identifying a set of n nearest vectors of said first set of vectors with the vector of said selected image from said vector database;

mapping and identifying a set of m nearest vectors of said second set of vectors with the vector of said selected image from said vector database;

identifying a set of n images corresponding to said set of n nearest vectors;

identifying a set of m images corresponding to said set of m nearest vectors;

applying an attribute extraction model to identify clothing attributes of said selected image;

applying an attribute extraction model to identify clothing attributes of each image in each set of said identified sets of n and m images;

matching attributes between said identified clothing attributes of said selected image and said identified clothing attributes of each image in each set of said identified sets of n and m images;

sorting and ranking, based on said match, each image of said identified set of n images and each image of said identified set of m images; and

displaying on a user interface said sorted and ranked sets of n and m images.

10. The method of claim 9 , wherein said clothing attributes comprises one or more of design of collar, shape of collar, shape of sleeve, and text and numbering content of said preprocessed image.

11. The method of claim 9 , wherein said first machine learning model is a Bootstrap Your Own Latent (BYOL) model.

12. The method of claim 11 , wherein said BYOL model is trained to create different views of the same image utilizing a random cropping augmentation technique.

13. The method of claim 11 , wherein said BYOL model is trained to create different views of the same image utilizing a left-right flip augmentation technique.

14. The method of claim 11 , wherein said BYOL model is trained to create different views of the same image utilizing one or more of a color jittering and color dropping augmentation technique.

15. The method of claim 9 , wherein said second machine learning model is a non-parametric instance-level discrimination model.

Assignments (2)
CHANGE OF NAME Recorded May 23, 2024
From: CURIOSEARCH DBA MATERIALL
To: UNISENSE TECH, INC.
Reel/Frame 067528/0117 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 25, 2022
From: VIJAY, BHARAT; VIJAYARAGHAVAN, JAYANTH; PRABHAKAR, ARVIND; BALAVENKATASUBRAMANIAN, AYYAR ARUN; VENKATESAN, SRIHARI PADMANABAN
To: CURIOSEARCH DBA MATERIALL
Reel/Frame 058759/0495 →
Continuity (1)
Related Publication 20230237768A1 · Jul 27, 2023