IP Library › Granted Patent US 11,809,633
Granted Patent B2
US 11,809,633 · App. 17/249,857 · Granted Nov 7, 2023

Mirroring device with pointing based navigation

Inventors: Dylan Shane Eirinberg (Venice, CA); Kyle Goodrich (Venice, CA); Andrew James McPhee (Culver City, CA); Daniel Moreno (Los Angeles, CA)
Assignee: Snap Inc.
G06F3/017G06F3/011G06F3/0482G06F3/04815G06T7/20G06V40/107G06T2207/10016G06T2207/30196G06T2207/30241
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,809,633
App. No.
17/249,857
Granted
Nov 7, 2023
Kind
B2
Abstract

Systems and methods are provided for performing operations comprising: capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user; identifying a finger of a hand of the user in the video feed; determining a direction within the video feed to which the finger is pointing; and accessing a first menu option based on the direction within the video feed to which the finger is pointing.

Claims (61)

1. A method comprising:

capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user;

identifying a finger of a hand of the user in the video feed;

determining a direction within the video feed to which the finger is pointing;

determining that a virtual line, corresponding to the direction, intersects a first corner region of the video feed; and

in response to determining that the virtual line intersects the first virtual corner, activating a first menu option.

2. The method of claim 1 , further comprising:

displaying one or more menu options on the video feed that depicts the user, wherein accessing the first menu option comprises selecting the first menu option from the one or more menu options that are displayed.

3. The method of claim 2 , further comprising:

generating a virtual line that extends from a point on the finger and is parallel to the finger;

determining that the virtual line intersects a display position of at least a portion of the first menu option; and

in response to determining that the virtual line intersects the display position of at least the portion of the first menu option, accessing the first menu option.

4. The method of claim 3 , further comprising visually distinguishing the first menu option from other options of the one or more menu options as a result of accessing the first menu option.

5. The method of claim 3 , further comprising:

detecting movement of the finger within the video feed;

updating the virtual line based on detecting movement of the finger; and

determining that the updated virtual line intersects a display position of at least a portion of a second menu option of the one or more menu options.

6. The method of claim 5 , further comprising:

in response to determining that the virtual line intersects the display position of at least the portion of the second menu option, accessing the second menu option; and

visually distinguishing the second menu option instead of the first menu option as a result of accessing the second menu option after accessing the first menu option.

7. The method of claim 1 , further comprising:

generating a virtual line that extends from a point on the finger and is parallel to the finger;

determining that the virtual line intersects a first virtual bounding region of the video feed; and

in response to determining that the virtual line intersects the first virtual bounding region, activating the first menu option.

8. The method of claim 7 , further comprising:

detecting movement of the finger within the video feed;

updating the virtual line based on detecting movement of the finger;

determining that the updated virtual line intersects a second virtual bounding region of the video feed; and

in response to determining that the virtual line intersects the second virtual bounding region, activating a second menu option.

9. The method of claim 8 , wherein:

activating the first menu option comprises applying a first filter only to a first portion of the video feed bounded by the first virtual bounding region; and

activating the second menu option comprises applying the first filter only to a second portion of the video feed bounded by the second virtual bounding region.

10. The method of claim 1 , further comprising:

accessing the first menu option, displayed within the first corner region, based on the direction within the video feed to which the finger is pointing.

11. The method of claim 1 , further comprising:

determining movement of the finger within the video feed;

in response to determining that the finger has been moved, determining a trajectory of the movement of the finger; and

accessing a second menu option based on the trajectory of the movement of the finger.

12. The method of claim 11 , further comprising animating a transition from accessing the first menu option to accessing the second menu option based on a degree of the movement of the finger.

13. The method of claim 12 , wherein animating the transition comprises:

applying a first visual effect associated with the first menu option to a first display region of the video feed concurrently with applying a second visual effect associated with the second menu option to a second display region of the video feed, wherein a size of the first display region to which the first visual effect is applied relative to a size of the second display region to which the second visual effect is applied is determined based on the degree of the movement of the finger.

14. The method of claim 1 , wherein the electronic mirroring device comprises a stationary device in which a size of a display has a height that is greater than a height of the user, and wherein the camera is a front-facing camera that is on a same side as the display of the electronic mirroring device.

15. The method of claim 1 , wherein the electronic mirroring device comprises a mobile device fixed on a camera stand, and wherein the camera is a front-facing camera that is on a same side as a display of the electronic mirroring device.

16. The method of claim 1 , wherein the electronic mirroring device comprises an eyewear device through which a user views a static mirror.

17. The method of claim 1 , further comprising:

displaying a three-dimensional carousel of menu options; and

turning the three-dimensional carousel based on detecting movement of the hand within the video feed.

18. The method of claim 17 , wherein a direction in which the three-dimensional carousel is turned corresponds to a direction of the detected movement of the hand.

19. A system comprising:

a processor of an electronic mirroring device configured to perform operations comprising:

capturing, by the electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user;

identifying a finger of a hand of the user in the video feed;

determining a direction within the video feed to which the finger is pointing;

determining that a virtual line, corresponding to the direction, intersects a first corner region of the video feed; and

in response to determining that the virtual line intersects the first virtual corner, activating a first menu option.

20. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user;

identifying a finger of a hand of the user in the video feed;

determining a direction within the video feed to which the finger is pointing;

determining that a virtual line, corresponding to the direction, intersects a first corner region of the video feed; and

in response to determining that the virtual line intersects the first virtual corner, activating a first menu option.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 22, 2023
From: EIRINBERG, DYLAN SHANE; GOODRICH, KYLE; MCPHEE, ANDREW JAMES; MORENO, DANIEL
To: SNAP INC.
Reel/Frame 064025/0990 →
Continuity (1)
Related Publication 20220300081A1 · Sep 22, 2022
Cited By (1)
US 12,707,141