Granted Patent B2

US 12,400,414 · App. 18/166,144 · Granted Aug 26, 2025

Inventors: Anastasia Victor-Faichney (San Francisco, CA); Matthew Alan Insley (Seattle, WA); Samuel Matthew Levatich (Seattle, WA); Ahad Habib Basravi (Oakland, CA); Matthew Luther (Los Gatos, CA); Andrew C. Johnson (Somerville, MA); Matthaeus Krenn (Sunnyvale, CA); Difei Wang (Folsom, CA); Irvi Stefo (Brooklyn, NY); Norah Riley Smith (Oakland, CA)

Assignee: Meta Platforms Technologies, LLC

G06T19/20G06F3/014G06T2219/2016

Abstract

Claims (40)

1. A computer implemented method for facilitating system user interface (UI) interactions in an artificial reality (XR) environment, the computer implemented method comprising:

rendering the system UI as a 3D virtual element in the XR environment, wherein the system UI comprises a set of UI elements arranged on a surface of the system UI;

tracking a position of a hand of a user and a pre-defined stable point on the user,

wherein the pre-defined stable point is a point offset from a defined body point on the user, and

wherein a direction and amount of the offset are based on a determination of a relative position of the system UI with respect to an eye level of the user; and

identifying, based on the tracking, that the hand has grasped a portion of the system UI and, in response, rotating the position of the system UI around the grasped portion of the system UI such that a line, between the pre-defined stable point and the surface of the system UI, is moved, to be perpendicular or at a predefined angle from perpendicular to the surface of the system UI, as the user moves the system UI via the grasped portion.

2. The computer implemented method of claim 1 , wherein the pre-defined stable point on the user is a point where a base of the user's head meets the user's neck.

3. The computer implemented method of claim 1 , wherein the defined body point is where a base of the user's head meets the user's neck.

4. The computer implemented method of claim 1 , wherein the position of the system UI is rotated around the grasped portion of the system UI such that a speed of rotation of the position of the system UI is less than a threshold speed.

5. The computer implemented method of claim 1 , further comprising:

determining that the system UI is moved, via the grasped portion, more than or equal to a threshold amount; and

wherein the rotating the position of the system UI is further in response to the determination that the system UI is moved more than or equal to the threshold amount.

6. The computer implemented method of claim 1 , wherein the rotation includes rotating the system UI to have the line be at the predefined angle from perpendicular to the surface of the system UI, wherein the predefined angle is selected based on a determination that the position of the system UI is less than a threshold height, and wherein the threshold height is relative to the eye level of the user.

7. A non-transitory computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to perform a process for facilitating system user interface (UI) interactions in an artificial reality (XR) environment, the process comprising:

rendering the system UI as a 3D virtual element in the XR environment, wherein the system UI comprises a set of UI elements arranged on a surface of the system UI;

tracking a position of a hand of a user and a pre-defined stable point on the user,

wherein the pre-defined stable point is a point offset from a defined body point on the user, and

wherein a direction and amount of the offset are based on a determination of a relative position of the system UI with respect to an eye level of the user; and

identifying, based on the tracking, that the hand has grasped a portion of the system UI and, in response, rotating the position of the system UI around the grasped portion of the system UI such that a line, between the pre-defined stable point and the surface of the system UI, is moved, to be perpendicular or at a predefined angle from perpendicular to the surface of the system UI, as the user moves the system UI via the grasped portion.

8. The non-transitory computer-readable storage medium of claim 7 , wherein the pre-defined stable point on the user is a point where a base of the user's head meets the user's neck.

9. The non-transitory computer-readable storage medium of claim 7 , wherein the defined body point is where a base of the user's head meets the user's neck.

10. The non-transitory computer-readable storage medium of claim 7 , wherein the position of the system UI is rotated around the grasped portion of the system UI such that a speed of rotation of the position of the system UI is less than a threshold speed.

11. The non-transitory computer-readable storage medium of claim 7 , wherein the process further comprises:

determining that the system UI is moved, via the grasped portion, more than or equal to a threshold amount; and

wherein the rotating the position of the system UI is further in response to the determination that the system UI is moved more than or equal to the threshold amount.

12. A computing system for interacting with a system user interface (UI) in an artificial reality (XR) environment, the computing system comprising:

one or more processors; and

one or more memories storing instructions that, when executed by the one or more processors, cause the computing system to perform a process comprising:

rendering the system UI as a 3D virtual element in the XR environment, wherein the system UI comprises a set of UI elements arranged on a surface of the system UI;

tracking a position of a hand of a user and a pre-defined stable point on the user,

wherein the pre-defined stable point is a point offset from a defined body point on the user, and

wherein a direction and amount of the offset are based on a determination of a relative position of the system UI with respect to an eye level of the user; and

identifying, based on the tracking, that the hand has grasped a portion of the system UI and, in response, rotating the position of the system UI such that a line, between the pre-defined stable point and the surface of the system UI, is moved, to be perpendicular or at a predefined angle from perpendicular to the surface of the system UI, as the user moves the system UI.

13. The computing system of claim 12 , wherein the pre-defined stable point on the user is a point where a base of the user's head meets the user's neck.

14. The computing system of claim 12 , wherein the defined body point is where a base of the user's head meets the user's neck.

15. The computing system of claim 12 , wherein the position of the system UI is rotated around the grasped portion of the system UI such that a speed of rotation of the position of the system UI is less than a threshold speed.

16. The computing system of claim 12 , wherein the process further comprises:

determining that the system UI is moved, via the grasped portion, more than or equal to a threshold amount; and

wherein the rotating the position of the system UI is further in response to the determination that the system UI is moved more than or equal to the threshold amount.

17. The computing system of claim 12 , wherein the rotation includes rotating the system UI to have the line be at the predefined angle from perpendicular to the surface of the system UI, wherein the process further comprises selecting the predefined angle based on a determination that the position of the system UI is less than a threshold height, and wherein the threshold height is relative to the eye level of the user.

Assignments (1)

Continuity (1)

References Cited (235)

Cited By (1)

US 1,127,826