IP Library › Granted Patent US 12,443,269
Granted Patent B2
US 12,443,269 · App. 18/535,940 · Granted Oct 14, 2025

Controlling locomotion within an artificial-reality application using hand gestures, and methods and systems of use thereof

Inventor: Brandon Furtwangler (Issaquah, WA)
Assignee: Meta Platforms Technologies, LLC
G06F3/011G06F3/017G06T19/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,443,269
App. No.
18/535,940
Granted
Oct 14, 2025
Kind
B2
Abstract

Systems and methods are provided for adjusting a representation of a user's position within an artificial-reality application using a hand gesture. One example method includes, while displaying, via a head-wearable device worn by a user, a representation of a user's position within an artificial-reality environment, in response to receiving an indication that a positional-control activation hand gesture has been performed, displaying a positional-control user interface (UI) overlaid on a portion of the artificial-reality environment, the positional-control UI including a positional-control UI element configured to perform a positional-control action. The example method further includes, while displaying the positional-control UI, in response to receiving an indication that the positional-control UI element has been selected, via a positional-control input hand gesture, causing a change in the representation of the user's position within the artificial-reality environment based on the positional-control action, and displaying a changed representation of the user's position within the artificial-reality environment.

Claims (73)

1. A non-transitory, computer-readable storage medium including instructions that, when executed by one or more processors of a head-wearable device, cause the head-wearable device to:

while displaying a representation of a user's position within an artificial-reality environment:

in response to receiving an indication that a first positional-control activation hand gesture has been performed, display a first positional-control user interface (UI) overlaid on a portion of the artificial-reality environment, the first positional-control UI including a first positional-control UI element configured to perform a first positional-control action;

while displaying the first positional-control UI:

in response to receiving an indication that the first positional-control UI element has been selected, via a positional-control input hand gesture, (i) cause a change in the representation of the user's position within the artificial-reality environment based on the first positional-control action, and (ii) display a changed representation of the user's position within the artificial-reality environment, and

in response to receiving an indication that a second positional-control activation hand gesture has been performed, (i) cease to display the first positional-control UI, and (ii) display a second positional-control UI, in place of the first positional-control UI, overlaid on the portion of the artificial-reality environment, a second positional-control UI including a second positional-control UI element configured to perform a second positional-control action; and

while displaying the second positional-control UI:

in response to receiving an indication that the second positional-control UI element has been selected, (i) cause a change in the representation of the user's position within the artificial-reality environment based on the second positional-control action, and (ii) display a changed representation of the user's position within the artificial-reality environment.

2. The non-transitory, computer-readable storage medium of claim 1 , wherein the positional-control input hand gesture is a first positional-control input hand gesture, and the instructions, when executed by the one or more processors of the head-wearable device, further cause the head-wearable device to:

while displaying the first positional-control UI:

in response to receiving an indication that a third positional-control UI element has been selected, via a second positional-control input hand gesture, (i) cause another change in the representation of the user's position within the artificial-reality environment based on a third positional-control action, and (ii) display another changed representation of the user's position within the artificial-reality environment.

3. The non-transitory, computer-readable storage medium of claim 1 , wherein:

the first positional-control action is a perspective change; and

causing the change in the representation of the user's position within the artificial-reality environment based on the first positional-control action includes instantaneously causing a variable sinistral or variable dextral change in a perspective of the representation of the user's position within the artificial-reality environment.

4. The non-transitory, computer-readable storage medium of claim 1 , wherein:

the first positional-control action is an instant position change; and

causing the change in the representation of the user's position within the artificial-reality environment based on the first positional-control action includes instantaneously causing a variable position change to the representation of the user's position within the artificial-reality environment such that the user's position is adjusted by the variable position change.

5. The non-transitory, computer-readable storage medium of claim 1 , wherein:

the first positional-control action is a continuous position change; and

causing the change in the representation of the user's position within the artificial-reality environment based on the first positional-control action includes continuously causing a predetermined constant position change to the representation of the user's position within the artificial-reality environment such that the user's position is continuously adjusted by the predetermined constant position change.

6. The non-transitory, computer-readable storage medium of claim 1 , wherein the positional-control input hand gesture is maintained and the first positional-control action is based on movement of a user's hand while the positional-control input hand gesture is maintained.

7. The non-transitory, computer-readable storage medium of claim 1 , wherein the instructions, when executed by the one or more processors of the head-wearable device, further cause the head-wearable device to:

display a navigation UI element overlaid on another portion of the artificial-reality environment adjacent to the first positional-control UI, wherein the navigation UI element is configured to display a representation of the user's hand movements with respect to the first positional-control UI.

8. The non-transitory, computer-readable storage medium of claim 1 , wherein the first positional-control UI is displayed at an initial position within the artificial-reality environment based on where a representation of the user's hand is within the artificial-reality environment when the positional-control input hand gesture is detected.

9. The non-transitory, computer-readable storage medium of claim 8 , wherein the first positional-control UI is associated with a UI boundary, and the instructions, when executed by the one or more processors of the head-wearable device, further cause the head-wearable device to:

in response to detecting that a relative position the representation of the user's hand within the artificial-reality environment moves outside of the UI boundary:

perform the first positional-control action, and

continue to display the first positional-control UI.

10. The non-transitory, computer-readable storage medium of claim 1 , wherein the instructions, when executed by the one or more processors of the head-wearable device, further cause the head-wearable device to:

display at least one additional positional-control UI element adjacent to the first positional-control UI, the at least one additional positional-control UI element configured to perform an additional positional-control action.

11. A method of adjusting a representation of a user's position within an artificial-reality application using a hand gesture, comprising:

while displaying, via a head-wearable device worn by a user, a representation of a user's position within an artificial-reality environment:

in response to receiving an indication that a first positional-control activation hand gesture has been performed, display a first positional-control user interface (UI) overlaid on a portion of the artificial-reality environment, the first positional-control UI including a first positional-control UI element configured to perform a first positional-control action;

while displaying the first positional-control UI:

in response to receiving an indication that the first positional-control UI element has been selected, via a positional-control input hand gesture, (i) cause a change in the representation of the user's position within the artificial-reality environment based on the first positional-control action, and (ii) display a changed representation of the user's position within the artificial-reality environment, and

in response to receiving an indication that a second positional-control activation hand gesture has been performed, (i) cease to display the first positional-control UI, and (ii) display a second positional-control UI, in place of the first positional-control UI, overlaid on the portion of the artificial-reality environment, a second positional-control UI including a second positional-control UI element configured to perform a second positional-control action; and

while displaying the second positional-control UI:

in response to receiving an indication that the second positional-control UI element has been selected, (i) cause a change in the representation of the user's position within the artificial-reality environment based on the second positional-control action, and (ii) display a changed representation of the user's position within the artificial-reality environment.

12. The method of claim 11 , wherein the positional-control input hand gesture is a first positional-control input hand gesture, and the method further comprises:

while displaying the first positional-control UI:

in response to receiving an indication that a third positional-control UI element has been selected, via a second positional-control input hand gesture, (i) cause another change in the representation of the user's position within the artificial-reality environment based on a third positional-control action, and (ii) display another changed representation of the user's position within the artificial-reality environment.

13. The method of claim 11 , wherein:

the first positional-control action is a perspective change; and

causing the change in the representation of the user's position within the artificial-reality environment based on the first positional-control action includes instantaneously causing a variable sinistral or variable dextral change in a perspective of the representation of the user's position within the artificial-reality environment.

14. The method of claim 11 , wherein:

the first positional-control action is an instant position change; and

causing the change in the representation of the user's position within the artificial-reality environment based on the first positional-control action includes instantaneously causing a variable position change to the representation of the user's position within the artificial-reality environment such that the user's position is adjusted by the variable position change.

15. The method of claim 11 , wherein:

the first positional-control action is a continuous position change; and

causing the change in the representation of the user's position within the artificial-reality environment based on the first positional-control action includes continuously causing a predetermined constant position change to the representation of the user's position within the artificial-reality environment such that the user's position is continuously adjusted by the predetermined constant position change.

16. A head-wearable device for adjusting a representation of a user's position within an artificial-reality application using a hand gesture, the head-wearable device comprising:

a display;

one or more processors; and

memory including one or more instructions that, when executed by the one or more processors, cause the head-wearable device to:

while displaying a representation of a user's position within an artificial-reality environment:

in response to receiving an indication that a first positional-control activation hand gesture has been performed, display a first positional-control user interface (UI) overlaid on a portion of the artificial-reality environment, the first positional-control UI including a first positional-control UI element configured to perform a first positional-control action;

while displaying the first positional-control UI:

in response to receiving an indication that the first positional-control UI element has been selected, via a positional-control input hand gesture, (i) cause a change in the representation of the user's position within the artificial-reality environment based on the first positional-control action, and (ii) display a changed representation of the user's position within the artificial-reality environment, and

in response to receiving an indication that a second positional-control activation hand gesture has been performed, (i) cease to display the first positional-control UI, and (ii) display a second positional-control UI, in place of the first positional-control UI, overlaid on the portion of the artificial-reality environment, a second positional-control UI including a second positional-control UI element configured to perform a second positional-control action; and

while displaying the second positional-control UI:

in response to receiving an indication that the second positional-control UI element has been selected, (i) cause a change in the representation of the user's position within the artificial-reality environment based on the second positional-control action, and (ii) display a changed representation of the user's position within the artificial-reality environment.

17. The head-wearable device of claim 16 , wherein the positional-control input hand gesture is a first positional-control input hand gesture, and the instructions, when executed by the one or more processors of the head-wearable device, further cause the head-wearable device to:

while displaying the first positional-control UI:

in response to receiving an indication that a third positional-control UI element has been selected, via a second positional-control input hand gesture, (i) cause another change in the representation of the user's position within the artificial-reality environment based on a third positional-control action, and (ii) display another changed representation of the user's position within the artificial-reality environment.

18. The head-wearable device of claim 16 , wherein:

the first positional-control action is a perspective change; and

causing the change in the representation of the user's position within the artificial-reality environment based on the first positional-control action includes instantaneously causing a variable sinistral or variable dextral change in a perspective of the representation of the user's position within the artificial-reality environment.

19. The head-wearable device of claim 16 , wherein:

the first positional-control action is an instant position change; and

causing the change in the representation of the user's position within the artificial-reality environment based on the first positional-control action includes instantaneously causing a variable position change to the representation of the user's position within the artificial-reality environment such that the user's position is adjusted by the variable position change.

20. The head-wearable device of claim 16 , wherein:

the first positional-control action is a continuous position change; and

causing the change in the representation of the user's position within the artificial-reality environment based on the first positional-control action includes continuously causing a predetermined constant position change to the representation of the user's position within the artificial-reality environment such that the user's position is continuously adjusted by the predetermined constant position change.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 23, 2024
From: FURTWANGLER, BRANDON
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 066544/0982 →
Continuity (2)
Provisional Application 63432036 · Dec 12, 2022
Related Publication 20240192766A1 · Jun 13, 2024
References Cited (2)
US 20210090332A1 · Ravasz · 2021 [cited by examiner]
US 20240134460A1 · Millar · 2024 [cited by examiner]
Cited By (1)
US 12,718,622