Granted Patent B2

US 11,798,201 · App. 17/249,859 · Granted Oct 24, 2023

Inventors: Dylan Shane Eirinberg (Venice, CA); Kyle Goodrich (Venice, CA); Andrew James McPhee (Culver City, CA); Daniel Moreno (Los Angeles, CA)

Assignee: Snap Inc.

G06T11/00A47G1/02G06F3/017G06F3/0482G06Q30/0643G06F3/04847

Abstract

Claims (70)

1. A method comprising:

capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user;

selecting, by the electronic mirroring device, a first whole-body outfit in response to capturing the video feed;

displaying, by the electronic mirroring device, a representation of the user wearing the first whole-body outfit;

detecting, by the electronic mirroring device, a hand gesture performed by the user in the video feed;

in response to detecting the hand gesture, transitioning, by the electronic mirroring device, the representation of the user from wearing the first whole-body outfit to wearing a second whole-body outfit, the transitioning comprising generating an animation depicting the first whole-body outfit sliding off of the user towards a direction of the hand gesture and simultaneously sliding the second whole-body outfit towards the user along the direction of the hand gesture until the second whole-body outfit overlays the user;

generating light around an entire border of the electronic mirroring device to illuminate the entire border of the electronic mirroring device in response to detecting a given user within view of the camera;

causing the generated light to generate light in a first color associated with the first user;

after causing the generated light to generate light in the first color, detecting a second user within view of the camera of the electronic mirroring device; and

transitioning the generated light from the first color to the second color in response to detecting the second user within view of the camera.

2. The method of claim 1 , further comprising:

activating a plurality of light emitting diodes (LEDs) that are integrated as part of a screen of the electronic mirroring device and that are disposed around the entire border of the electronic mirroring device to generate the light.

3. The method of claim 1 , further comprising:

displaying a slider on the electronic mirroring device relative to a position of the user within the video feed;

detecting movement of a body part of the user within the video feed; and

moving the slider based on detecting movement of the body part.

4. The method of claim 1 , further comprising:

receiving input that activates a front-facing camera of the electronic mirroring device, and in response to receiving the input that activates the front-facing camera, setting a set of pixels around the entire border of the electronic mirroring device to a specified brightness and color to mimic a function of a plurality of light emitting diodes.

5. The method of claim 1 , further comprising:

detecting that a body part of the user points towards one of first, second and third options presented on a display of the electronic mirroring device by drawing, a virtual line that extends from the body part and runs parallel to the body part and determining that the virtual line intersects a display position of the one of the first, second and third options presented on the display; and

as a direction of the body part changes, updating a direction of the virtual line to remain parallel to the body part.

6. The method of claim 5 , the body part comprising a finger of the user, further comprising:

detecting a real-world outfit being worn by the user depicted in the video feed;

generating an augmented reality element based on the real-world outfit being worn by the user; and

displaying the augmented reality element as the first whole-body outfit.

7. The method of claim 5 , further comprising:

modifying a size of the first option that is presented on the display relative to the second and third options to indicate that the first option has been identified based on an intersection between the virtual line extending from the body part and the display position of the first option.

8. The method of claim 7 , further comprising:

determining that the body part has remained pointing at and in a direction that the virtual line continues to intersect the display position of the first option for a threshold period of time; and

in response to determining that the body part has remained pointing at and in the direction that the virtual line continues to intersect the display position of the first option for the threshold period of time, activating a function associated with the first option.

9. The method of claim 1 , further comprising applying a neural network to the video feed depicting the user to segment and distinguish portions of the depiction of the user relating to clothing from body parts of the user, wherein transitioning the representation of the user from wearing the first whole-body outfit to wearing the second whole-body outfit comprises deleting pixels of the first whole-body outfit based on applying the neural network, the deleting of the pixels comprising automatically blending pixels of the first whole-body outfit that extend beyond a body of the user with a background of the video feed, wherein the pixels that overlap body parts of the user are converted to a green or black color to delete the pixels.

10. The method of claim 1 , further comprising:

detecting a real-world outfit being worn by the user depicted in the video feed;

determining one or more attributes of the real-world outfit; and

searching a plurality of virtual whole-body outfits based on the one or more attributes of the real-world outfit.

11. The method of claim 1 , wherein detecting the hand gesture comprises:

determining that a palm of a hand of the user is facing a left or right side of the electronic mirroring device; and

determining that the hand has been moved towards a direction to which the palm of the hand is facing.

12. The method of claim 1 , further comprising displaying a name or identifier of the first whole-body outfit together with the representation of the user wearing the first whole-body outfit.

13. The method of claim 1 , further comprising:

detecting a real-world outfit being worn by the user depicted in the video feed;

removing one or more portions of the real-world outfit from being displayed in the video feed; and

replacing the removed one or more portions of the real-world outfit with the first whole-body outfit.

14. The method of claim 1 , further comprising:

adjusting a style, color or pattern of the first whole-body outfit to generate an adjusted first whole-body outfit;

receiving input from the user selecting an option to save the adjusted first whole-body outfit; and

requesting additional input from the user comprising a name or identifier of the adjusted first whole-body outfit to enable the user to search for the adjusted first whole-body outfit at a later time.

15. The method of claim 1 , wherein the electronic mirroring device comprises a mobile device fixed on a camera stand, and wherein the camera is a front-facing camera that is on a same side as a display of the electronic mirroring device.

16. The method of claim 1 , wherein the electronic mirroring device comprises an eyewear device through which a user views a static mirror.

17. A system comprising:

at least one processor of an electronic mirroring device configured to perform operations comprising:

capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user;

selecting, by the electronic mirroring device, a first whole-body outfit in response to capturing the video feed;

displaying, by the electronic mirroring device, a representation of the user wearing the first whole-body outfit;

detecting, by the electronic mirroring device, a hand gesture performed by the user in the video feed;

in response to detecting the hand gesture, transitioning, by the electronic mirroring device, the representation of the user from wearing the first whole-body outfit to wearing a second whole-body outfit, the transitioning comprising generating an animation depicting the first whole-body outfit sliding off of the user towards a direction of the hand gesture and simultaneously sliding the second whole-body outfit towards the user along the direction of the hand gesture until the second whole-body outfit overlays the user;

generating light around an entire border of the electronic mirroring device to illuminate the entire border of the electronic mirroring device in response to detecting a given user within view of the camera;

causing the generated light to generate light in a first color associated with the first user;

after causing the generated light to generate light in the first color, detecting a second user within view of the camera of the electronic mirroring device; and

transitioning the generated light from the first color to the second color in response to detecting the second user within view of the camera.

18. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user;

selecting, by the electronic mirroring device, a first whole-body outfit in response to capturing the video feed;

displaying, by the electronic mirroring device, a representation of the user wearing the first whole-body outfit;

detecting, by the electronic mirroring device, a hand gesture performed by the user in the video feed;

in response to detecting the hand gesture, transitioning, by the electronic mirroring device, the representation of the user from wearing the first whole-body outfit to wearing a second whole-body outfit, the transitioning comprising generating an animation depicting the first whole-body outfit sliding off of the user towards a direction of the hand gesture and simultaneously sliding the second whole-body outfit towards the user along the direction of the hand gesture until the second whole-body outfit overlays the user;

generating light around an entire border of the electronic mirroring device to illuminate the entire border of the electronic mirroring device in response to detecting a given user within view of the camera;

causing the generated light to generate light in a first color associated with the first user;

after causing the generated light to generate light in the first color, detecting a second user within view of the camera of the electronic mirroring device; and

transitioning the generated light from the first color to the second color in response to detecting the second user within view of the camera.

Assignments (1)

Continuity (1)

Cited By (9)

US 12,405,672 US 12,518,490 US 12,573,100 US 12,626,455 US 12,632,984 US 12,656,876 US 12,657,753 US 12,693,770 US 12,710,807