IP Library › Granted Patent US 11,734,866
Granted Patent B2
US 11,734,866 · App. 17/447,509 · Granted Aug 22, 2023

Controlling interactive fashion based on voice

Inventors: Itamar Berger (Hod Hasharon, IL); Gal Dudovitch (Tel Aviv, IL); Gal Sasson (Kibbutz Ayyelet Hashahar, IL); Ma'ayan Shuvi (Tel Aviv, IL); Matan Zohar (Rishon LeZion, IL)
Assignee: SNAP INC.
G06T11/60G06T7/11G06T11/40G06V20/20G10L15/22G10L15/26G06T2207/30196G06V2201/09H04L51/42
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,734,866
App. No.
17/447,509
Granted
Aug 22, 2023
Kind
B2
Abstract

Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item by the person depicted in the image; receiving voice input associated with the person depicted in the image; in response to receiving the voice input, generating one or more augmented reality elements representing the voice input; and applying the one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person.

Claims (65)

1. A method comprising:

receiving, by one or more processors of a client device, an image that includes a depiction of a person wearing a fashion item;

generating, by the one or more processors, a segmentation of the fashion item worn by the person depicted in the image;

receiving voice input associated with the person depicted in the image;

in response to receiving the voice input, generating one or more augmented reality elements representing the voice input; and

applying the one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person.

2. The method of claim 1 , wherein the fashion item comprises a shirt, and wherein the voice input is received by a microphone of the client device from the person wearing the fashion item or a user of the client device.

3. The method of claim 1 , further comprising:

transcribing the voice input to generate a transcription of the voice input comprising one or more words, wherein the one or more augmented reality elements comprise the transcription of the voice input.

4. The method of claim 1 , further comprising:

generating text for display on the fashion item;

selecting one or more words for the text based on the voice input; and

adding the selected one or more words to the one or more augmented reality elements.

5. The method of claim 1 , further comprising:

determining an emotion based on characteristics of the voice input;

selecting one or more words associated with the emotion; and

generating the one or more augmented reality elements to include the selected one or more words for display on the fashion item.

6. The method of claim 1 , further comprising:

determining an emotion based on characteristics of the voice input;

selecting a graphical element associated with the emotion; and

generating the one or more augmented reality elements to include the selected graphical element for display on the fashion item.

7. The method of claim 1 , further comprising:

adding an avatar or emoji to the fashion item worn by the person depicted in the image; and

adjusting an expression of the avatar or emoji based on the voice input.

8. The method of claim 7 , further comprising:

determining an emotion based on characteristics of the voice input; and

adjusting the expression of the avatar or emoji to represent the emotion.

9. The method of claim 1 , further comprising:

detecting a logo or emblem on the fashion item; and

modifying the logo or emblem in response to applying the one or more augmented reality elements.

10. The method of claim 1 , wherein generating the one or more augmented reality elements comprises:

determining a color or pattern associated with the voice input; and

populating a graphic having a shape and size of the segmentation with the color or pattern associated with the voice input.

11. The method of claim 1 , wherein the fashion item worn by the person comprises a first type of fashion item, and wherein generating the one or more augmented reality elements comprises:

determining that the voice input comprises a command to change a fashion item type of the fashion item worn by the person depicted in the image from the first type of fashion item to a second type of fashion item; and

obtaining an augmented reality fashion item comprising the second type of fashion item.

12. The method of claim 11 , further comprising:

replacing the fashion item worn by the person depicted in the image with the augmented reality fashion item.

13. The method of claim 12 , wherein the fashion item comprises a shirt, and wherein the augmented reality fashion item comprises a jacket.

14. The method of claim 12 , wherein the fashion item comprises a skirt, and wherein the augmented reality fashion item comprises a dress.

15. The method of claim 12 , wherein the fashion item comprises shorts, and wherein the augmented reality fashion item comprises pants.

16. The method of claim 12 , further comprising:

overlaying the augmented reality fashion item on top of the fashion item worn by the person depicted in the image.

17. The method of claim 1 , further comprising:

determining a pitch or frequency associated with the voice input;

selecting a region on the fashion item based on the pitch or frequency associated with the voice input; and

applying the one or more augmented reality elements on the selected region.

18. The method of claim 1 , further comprising:

determining an acoustic direction associated with the voice input;

selecting a region on the fashion item that is on a path of the acoustic direction associated with the voice input; and

applying the one or more augmented reality elements on the selected region.

19. A system comprising:

a processor of a client device; and

a memory component having instructions stored thereon that, when executed by the processor, cause the processor to perform operations comprising:

receiving an image that includes a depiction of a person wearing a fashion item;

generating a segmentation of the fashion item by the person depicted in the image;

receiving voice input associated with the person depicted in the image;

in response to receiving the voice input, generating one or more augmented reality elements representing the voice input; and

applying the one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person.

20. A non-transitory computer-readable storage medium having stored thereon instructions that, when executed by a processor of a client device, cause the processor to perform operations comprising:

receiving an image that includes a depiction of a person wearing a fashion item;

generating a segmentation of the fashion item worn by the person depicted in the image;

receiving voice input associated with the person depicted in the image;

in response to receiving the voice input, generating one or more augmented reality elements representing the voice input; and

applying the one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 29, 2023
From: BERGER, ITAMAR; DUDOVITCH, GAL; SASSON, GAL; SHUVI, MA'AYAN; ZOHAR, MATAN
To: SNAP INC.
Reel/Frame 063143/0210 →
Continuity (1)
Related Publication 20230078483A1 · Mar 16, 2023
Cited By (4)
US 12,198,664 US 12,412,347 US 12,462,507 US 12,670,643