Granted Patent B2

US 12,436,601 · App. 18/321,124 · Granted Oct 7, 2025

Inventors: Rony Abovitz (Dania Beach, FL); Brian T. Schowengerdt (Seattle, WA); Mathew D. Watson (Bellevue, WA)

Assignee: Magic Leap, Inc.

G06F3/011A61B34/10A63F13/00A63F13/213A63F13/428G01B11/303G02B6/10G02B6/34G02B27/0101G02B27/017G02B27/0172G02B27/42G02B27/4205G02B27/4227G06F3/005G06F3/013G06F3/017G06F3/0304G06F3/04815G06F3/04842G06F3/04845G06F3/0485G06F3/0487G06F3/04883G06F16/7837G06F18/22G06Q30/0643G06T7/60G06T19/006G06V10/758G06V20/10G06V20/20G06V20/40G06V20/653G06V40/28G16H40/00G16H40/20G16H40/67H04B10/25891A61B2034/101G02B2027/0105G02B2027/0127G02B2027/014G02B2027/0178G02B2027/0185G02B2027/0187G06T2200/04G06T2200/24G06T2207/10004G06T2207/30196G06T2210/41G06T2219/024G06V40/113

Abstract

Claims (32)

1. A method for generating a virtual user interface, comprising:

detecting a first gesture involving a hand of a user;

rendering, in real-time and in response to detecting the first gesture involving the hand of the user, a first virtual user interface related to the hand of the user, the first virtual interface including a first level menu item comprising a high level navigation menu item, icon or field, rendered and appearing on each of a plurality of first portions of the hand of the user;

detecting, at each said first portion, a second gesture involving the hand of the user;

rendering, in real-time and in response to detecting the second gesture involving the hand of the user, a second virtual user interface related to the hand of the user, said second virtual user interface including a plurality of discrete second level menu items, each appearing to be on or attached to an associated first level menu item at an associated first portion,

and

wherein the second virtual user interface comprises each said second level menu item expanding from and related to an associated first level menu item.

2. The method of claim 1 , wherein the first gesture is selected from the group consisting of:

the user opening the hand;

the user displaying an open palm of the hand; and

the user holding up the hand.

3. The method of claim 1 wherein each said first portion of the hand is a finger of the hand.

4. The method of claim 3 , wherein the finger of the hand is not a thumb of the hand such that the first virtual user interface is configured so that the thumb of the hand acts as a pointer for the first virtual user interface and the second gesture comprises the thumb pointing to the first virtual user interface.

5. The method of claim 1 , wherein the first virtual user interface is a higher level navigation menu item compared to the second virtual user interface.

6. The method of claim 1 , wherein the second gesture is the user spreading at least two fingers of the hand apart from each other.

7. The method of claim 6 , wherein the second gesture is the user spreading all four fingers of the hand apart from each other.

8. The method of claim 1 , wherein each of said second level menu items is rendered such that it appears to be on or attached to a finger of the hand of the user.

9. The method of claim 8 , wherein the finger of the hand is not a thumb of the hand such that the second virtual user interface is configured so that the thumb of the hand acts as a pointer for the second virtual user interface.

10. The method of claim 1 , wherein the second virtual user interface is a lower level navigation menu item compared to the first virtual user interface.

11. The method of claim 1 , further comprising:

detecting a third gesture involving the hand of the user; and

rendering, in real-time and in response to detecting the third gesture involving the hand of the user, a third virtual user interface related to the hand of the user,

wherein the third virtual user interface comprises a plurality of third level menu items arranged in an arc and moving relative to the hand of the user.

12. The method of claim 11 , wherein the third gesture is the user making a circling motion in a palm of the hand with a finger from a second hand.

13. The method of claim 12 , wherein the third virtual user interface is rendered such that:

the plurality of third level menu items move in a first direction relative to the hand of the user when the circling motion is clockwise, and

the plurality of third level menu items move in a second direction relative to the hand of the user when the circling motion is counter-clockwise.

14. The method of claim 13 , wherein the second direction is opposite of the first direction.

15. The method of claim 11 , wherein the third virtual user interface comprises a circle rendered on a palm of the hand of the user.

16. The method of claim 11 , wherein the plurality of third level menu items is rendered at least partially on fingers of the hand of the user.

17. The method of claim 16 , wherein a first menu item of the plurality of third level menu items is rendered such that it has a larger size compared to an associated second level menu item of the plurality of second level menu items, and

wherein each said first portion is rendered on a finger of the hand of the user.

Assignments (3)

Continuity (9)

References Cited (400)