IP Library Granted Patent US 12,200,403
Granted Patent B2
US 12,200,403 · App. 17/992,753 · Granted Jan 14, 2025

Method and system for virtual fitting based on video meeting program

Inventors: Rok Kyu Lee (Gyeonggi-do, KR); Hyug Jae Lee (Gyeonggi-do, KR); Ha Eun Ahn (Gyeonggi-do, KR); Byum Hyuk Koo (Gyeonggi-do, KR)
Assignee: NHN CORPORATION
H04N7/157H04N7/147
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,200,403
App. No.
17/992,753
Granted
Jan 14, 2025
Kind
B2
Abstract

A method for virtual fitting based on a video meeting program includes: acquiring a other-participant picture of another user attending a video meeting; acquiring a garment characteristic parameter value specifying the shape of a garment that another user in the acquired other-participant picture wears; determining a clothing category, into which the garment that another user wears is classified, based on the garment characteristic parameter value; determining a dress code for the video meeting based on the clothing category; detecting a candidate fitting garment based on the dress code and the garment characteristic parameter value; determining a virtual fitting garment that is a garment image intended to be virtually put on a user attending the video image based on the candidate fitting garment; creating a virtual fitting picture in which the user in a main-participant picture of the user virtually wears the virtual fitting garment; and providing the virtual fitting picture.

Claims (38)

1. A method for performing virtual fitting for a user based on a video meeting program by a fitting application executed by at least one processor of a terminal, the method comprising:

acquiring at least one other-participant picture of another user attending a video meeting through the video meeting program;

acquiring a garment characteristic parameter value specifying a shape of a garment worn by the another user in the acquired other-participant picture;

determining one clothing category, into which the garment worn by the another user is classified, among a plurality of clothing categories based on the acquired garment characteristic parameter value;

determining a dress code for the video meeting based on the determined clothing category;

detecting at least one candidate fitting garment based on the determined dress code and the acquired garment characteristic parameter value;

determining a virtual fitting garment which is a garment image intended to be virtually put on the user attending the video meeting through the video meeting program based on the detected candidate fitting garment;

creating a virtual fitting picture in which a main-participant picture of the user provided in the video meeting program is modified such that the user virtually wears the determined virtual fitting garment; and

outputting the created virtual fitting picture,

wherein the determining of the virtual fitting garment includes determining, as the virtual fitting garment, a candidate fitting garment having a lowest computing amount for processing virtual wearing to the user among the at least one candidate fitting garment, wherein a computing amount for the virtual wearing comprises at least one of a data processing amount and a data processing time for processing the virtual wearing to the user.

2. The method of claim 1 , wherein the garment characteristic parameter value includes a data value of each of garment characteristic parameters including at least one of a color, a kind of a pattern, a kind of a neckline, and a sleeve length of a predetermined garment.

3. The method of claim 1 , wherein the determining of the dress code includes determining the dress code based on an appearance frequency of each of the clothing categories.

4. The method of claim 1 , wherein the detecting of the candidate fitting garment includes detecting, as the candidate fitting garment, at least one garment image of a plurality of garment images, which is classified and stored as the one clothing category matched with the determined dress code.

5. The method of claim 2 , wherein the detecting of the candidate fitting garment includes:

creating an integrated characteristic parameter value integrating most appearing data values of the garment characteristic parameters in the at least one garment characteristic parameter value;

comparing the created integrated characteristic parameter value with garment characteristic parameter values of a plurality of garment images pre-stored in a database, respectively; and

determining, as the candidate fitting garment, at least one garment image having a garment characteristic parameter value satisfying a predetermined concordance ratio to the integrated characteristic parameter value.

6. The method of claim 5 , wherein the detecting of the candidate fitting garment includes detecting at least one garment image, which has a garment characteristic parameter value satisfying a predetermined concordance ratio to the integrated characteristic parameter value of a plurality of garment images classified and stored as a clothing category matched with the dress code, as the candidate fitting garment.

7. The method of claim 1 , wherein the determining of the virtual fitting garment includes determining the virtual fitting garment based on a user input of selecting one of the at least one candidate fitting garment.

8. The method of claim 7 , wherein the determining of the virtual fitting garment further includes:

providing a parameter adjustment interface changing the garment characteristic parameter value of the one of the at least one candidate fitting garment selected based on the user input;

changing the garment characteristic parameter value of the one of the at least one candidate fitting garment selected based on the user input based on the provided parameter adjustment interface; and

determining a candidate fitting garment having the changed garment characteristic parameter value as the virtual fitting garment.

9. The method of claim 5 , wherein the determining of the virtual fitting garment includes determining a candidate fitting garment, which has a garment characteristic parameter value having a highest concordance ratio to the integrated characteristic parameter value of the at least one candidate fitting garment, as the virtual fitting garment.

10. The method of claim 1 , wherein the outputting of the created virtual fitting picture includes outputting the created virtual fitting picture to at least one terminal of at least one other user attending the video meeting through the video meeting program and the terminal of the user by transmitting the created virtual fitting picture through the video meeting program.

11. A system for performing virtual fitting for a user based on a video meeting program, the system comprising:

one or more displays configured to output a virtual fitting picture;

one or more memories; and

one or more processors,

wherein at least one application stored in the one or more memories and performing the virtual fitting based on the video meeting program by being executed by the one or more processors is configured to:

acquire at least one other-participant picture of another user attending a video meeting through the video meeting program,

acquire a garment characteristic parameter value specifying a shape of a garment worn by the another user in the acquired other-participant picture,

determine one clothing category, into which the garment worn by the another user is classified, among a plurality of clothing categories based on the acquired garment characteristic parameter value,

determine a dress code for the video meeting on the basis of the determined clothing category,

detect at least one candidate fitting garment based on the determined dress code and the acquired garment characteristic parameter value,

determine a virtual fitting garment which is a garment image intended to be virtually put on the user attending the video meeting through the video meeting program based on the detected candidate fitting garment by determining, as the virtual fitting garment, a candidate fitting garment having a lowest computing amount for processing virtual wearing to the user among the at least one candidate fitting garment, wherein a computing amount for the virtual wearing comprises at least one of a data processing amount and a data processing time for processing the virtual wearing to the user,

create the virtual fitting picture in which a main-participant picture of the user provided in the video meeting program is modified such that the user virtually wears the determined virtual fitting garment, and

output the created virtual fitting picture.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 13, 2024
From: LEE, ROK KYU; LEE, HYUG JAE; AHN, HA EUN; KOO, BYUM HYUK
To: NHN CLOUD CORPORATION
Reel/Frame 067394/0958 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 17, 2024
From: NHN CLOUD CORPORATION
To: NHN CORPORATION
Reel/Frame 067142/0315 →
Priority Claims (1)
KR 10-2021-0162203 · Nov 23, 2021 · national
Continuity (1)
Related Publication 20230164297A1 · May 25, 2023
References Cited (9)
US 7564476B1 · Coughlan · 2009 [cited by examiner]
US 10904488B1 · Weisz · 2021 [cited by examiner]
US 20170302709A1 · Jones · 2017 [cited by examiner]
US 20210142539A1 · Ayush · 2021 [cited by examiner]
KR 1020200037241 · 2020 [cited by applicant]
KR 1020200092265 · 2020 [cited by applicant]
KR 1020200141251 · 2020 [cited by applicant]
KR 1020210083551 · 2021 [cited by applicant]
Office Action dated Oct. 21, 2022 for Korean Patent Application No. 10-2021-0162203 and its English translation by Google Translate. [cited by applicant]