IP Library Granted Patent US 12704936
Granted Patent B2
US 12704936 · App. 18/435,799 · Granted Aug 11, 2026

User interface elements for facilitating direct-touch and indirect hand interactions with a user interface presented within an artificial-reality environment, and systems and methods of use thereof

Inventors: Anastasia Victor-Faichney (San Francisco, CA); Qi Xiong (San Carlos, CA); Jennifer Morrow (Sunnyvale, CA); Miguel Angel Maya Hernández (Bellevue, WA); John Nicholas Jitkoff (Seattle, WA); Ahad Habib Basravi (Oakland, CA); Irvi Stefo (Brooklyn, NY)
Assignee: Meta Platforms Technologies, LLC
G06F3/04815G06F3/0482G06T17/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12704936
App. No.
18/435,799
Granted
Aug 11, 2026
Kind
B2
Abstract

An example method of presenting, via an artificial-reality headset, a user interface that includes a selectable user interface element is described. The method includes that while a representation of a hand of a user is within an indirect-control threshold distance of the user interface, a focus selector is projected within the user interface based on a position of the representation of the hand of the user. The example method also includes that upon determining that the representation of the hand of the user has moved within a direct-touch threshold distance of the user interface, ceasing to display the focus selector within the user interface and allowing the representation of the hand of the user to interact directly with the selectable user interface element.

Claims (47)

1 . A method, comprising:

presenting, via an artificial-reality headset, a user interface that includes a selectable user interface element;

while a representation of a hand of a user is within an indirect-control threshold distance of the user interface, projecting a focus selector within the user interface based on a position of the representation of the hand of the user, wherein, while the hand of the user is within the indirect-control threshold distance of the user interface, the selectable user interface element is configured for interaction by the focus selector; and

upon determining that the representation of the hand of the user has moved within a direct-touch threshold distance of the user interface, ceasing to display the focus selector within the user interface and altering the selectable user interface element to be directly interacted by the representation of the hand of the user.

2 . The method of claim 1 , further comprising:

in conjunction with projecting the focus selector within the user interface based on a position of the representation of the hand of the user:

presenting a directional element associated with the focus selector near the representation of the hand of the user; and

before the representation of the hand of the user has moved within the direct-touch threshold distance, altering a visual characteristic associated with the focus selector.

3 . The method of claim 2 , wherein a visual characteristic of the directional element is altered in conjunction with the altering of the visual characteristic of the focus selector.

4 . The method of claim 1 , further comprising:

determining that direct-touch contact has occurred between the representation of the hand of the user and the selectable user interface element; and

in accordance with the determining that the direct-touch contact has occurred between the representation of the hand of the user and the selectable user interface element:

adjusting a visual characteristic of the selectable user interface element such that a visual glow is presented behind the selectable user interface element.

5 . The method of claim 1 , wherein a position of the representation of the hand of the user is not based on user interactions with a touch-screen display.

6 . The method of claim 1 , wherein the direct interaction by the representation of the hand of the user is performed while no handheld controllers or other mechanical or electronic devices are in physical contact with a hand or a wrist of the user.

7 . A non-transitory, computer-readable storage medium storing one or more programs wherein the one or more programs are that, when executed by an extended-reality headset causes the artificial-reality headset to:

present, via the artificial-reality headset, a user interface that includes a selectable user interface element;

while a representation of a hand of a user is within an indirect-control threshold distance of the user interface, project a focus selector within the user interface based on a position of the representation of the hand of the user, wherein, while the hand of the user is within the indirect-control threshold distance of the user interface, the selectable user interface element is configured for interaction by the focus selector; and

upon determining that the representation of the hand of the user has moved within a direct-touch threshold distance of the user interface, cease to display the focus selector within the user interface and alter the selectable user interface element to be directly interacted by the representation of the hand of the user.

8 . The non-transitory computer readable storage medium of claim 7 , wherein the one or more programs are further configured to cause the artificial-reality headset to:

in conjunction with projecting the focus selector within the user interface based on a position of the representation of the hand of the user:

present a directional element associated with the focus selector near the representation of the hand of the user; and

before the representation of the hand of the user has moved within the direct-touch threshold distance, alter a visual characteristic associated with the focus selector.

9 . The non-transitory computer readable storage medium of claim 8 , wherein a visual characteristic of the directional element is altered in conjunction with the altering of the visual characteristic of the focus selector.

10 . The non-transitory computer readable storage medium of claim 7 , wherein the one or more programs are further configured to cause the artificial-reality headset to:

determine that direct-touch contact has occurred between the representation of the hand of the user and the selectable user interface element; and

in accordance with the determining that the direct-touch contact has occurred between the representation of the hand of the user and the selectable user interface element:

adjust a visual characteristic of the selectable user interface element such that a visual glow is presented behind the selectable user interface element.

11 . The non-transitory computer readable storage medium of claim 7 , wherein a position of the representation of the hand of the user is not based on user interactions with a touch-screen display.

12 . The non-transitory computer readable storage medium of claim 7 , wherein the direct interaction by the representation of the hand of the user is performed while no handheld controllers or other mechanical or electronic devices are in physical contact with a hand or a wrist of the user.

13 . An artificial-reality headset, comprising:

one or more processors; and

memory storing one or more programs that, when executed by one or more processors, cause the artificial-reality headset to:

present, via an artificial-reality headset, a user interface that includes a selectable user interface element;

while a representation of a hand of a user is within an indirect-control threshold distance of the user interface, projecting a focus selector within the user interface based on a position of the representation of the hand of the user, wherein, while the hand of the user is within the indirect-control threshold distance of the user interface, the selectable user interface element is configured for interaction by the focus selector; and

upon determining that the representation of the hand of the user has moved within a direct-touch threshold distance of the user interface, cease to display the focus selector within the user interface and alter the selectable user interface element to be directly interacted by the representation of the hand of the user.

14 . The artificial-reality headset of claim 13 , wherein the one or more programs that, when executed further cause the artificial-reality headset to:

in conjunction with projecting the focus selector within the user interface based on a position of the representation of the hand of the user:

present a directional element associated with the focus selector near the representation of the hand of the user; and

before the representation of the hand of the user has moved within the direct-touch threshold distance, alter a visual characteristic associated with the focus selector.

15 . The non-transitory computer readable storage medium of claim 14 , wherein a visual characteristic of the directional element is altered in conjunction with the altering of the visual characteristic of the focus selector.

16 . The artificial-reality headset of claim 13 , wherein the one or more programs that, when executed further cause the artificial-reality headset to:

determine that direct-touch contact has occurred between the representation of the hand of the user and the selectable user interface element; and

in accordance with the determining that the direct-touch contact has occurred between the representation of the hand of the user and the selectable user interface element:

adjust a visual characteristic of the selectable user interface element such that a visual glow is presented behind the selectable user interface element.

17 . The artificial-reality headset of claim 13 , wherein a position of the representation of the hand of the user is not based on user interactions with a touch-screen display.

18 . The artificial-reality headset of claim 13 , wherein the direct interaction by the representation of the hand of the user is performed while no handheld controllers or other mechanical or electronic devices are in physical contact with a hand or a wrist of the user.