IP Library Granted Patent US 12,399,574
Granted Patent B2
US 12,399,574 · App. 18/675,326 · Granted Aug 26, 2025

Stabilizing gestures in artificial reality environments

Inventors: Eldad Yitzhak (Foster City, CA); Asaf Nitzan (Menlo Park, CA); Matthew Longest (Seattle, WA); Brandon Furtwangler (Issaquah, WA)
Assignee: Meta Platforms Technologies, LLC
G06F3/017G02B27/0093G02B27/017G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,399,574
App. No.
18/675,326
Granted
Aug 26, 2025
Kind
B2
Abstract

In one embodiment, a computing may display an artificial reality environment to a user wearing an artificial reality device. The artificial reality environment may include at least a first virtual object. The computing system may monitor a motion of a first gesture performed by the user when interacting with the first virtual object. The computing system may determine, using a motion-stabilization profile of the user, a motional range associated with the user. The computing system may compare the motion of the first gesture performed by the user with the motional range associated with the user. The computing system may stabilize one or more second gestures performed by the user during subsequent user interactions in the artificial reality environment responsive to determining that the motion of the first gesture performed by the user exceeds the motional range.

Claims (35)

1. A method comprising, by a computing system:

monitoring motional patterns of a user's hand during an interaction between the user's hand and a target virtual object, wherein the interaction relates to a first hand gesture performed by the user in relation to the target virtual object in an artificial reality environment presented to the user by an artificial reality device; and

based on at least the monitored motional patterns of the user's hand, generating a motion-stabilization profile associated with the user, wherein the motion-stabilization profile is configured to stabilize input associated with a motion of the user's hand during a subsequent user interaction within the artificial reality environment.

2. The method of claim 1 , further comprising determining a trigger for commencing the monitoring of the motional patterns of the user's hand.

3. The method of claim 2 , wherein the trigger comprises a context in which the user is interacting with the target virtual object.

4. The method of claim 1 , further comprising determining a motional range associated with the user based on the motion-stabilization profile.

5. The method of claim 4 , the method further comprising:

stabilizing a second hand gesture performed by the user during the subsequent user interaction within the artificial reality environment based on a determination that the motion of the user's hand exceed the motional range.

6. The method of claim 4 , the method further comprising:

forgoing stabilizing a second hand gesture performed by the user during the subsequent user interaction within the artificial reality environment based on a determination that the motion of the user's hand are within the motional range.

7. The method of claim 1 , further comprising:

monitoring second motional patterns of the user's hand during a second interaction between the user's hand and a second target virtual object, wherein the second interaction relates to a second hand gesture performed by the user in relation to the second target virtual object, wherein the motion-stabilization profile is further based at least in part on the monitored second motional patterns of the user's hand.

8. The method of claim 1 , wherein the artificial reality device is a virtual reality headset.

9. The method of claim 1 , wherein the motion-stabilization profile associated with the user is generated utilizing a machine learning model trained on at least the monitored motional patterns of the user's hand.

10. The method of claim 1 , wherein the target virtual object is a virtual user interface element.

11. A non-transitory, non-volatile computer-readable medium comprising instructions that, when executed by one or more processors of a computing system, cause the computing system to:

monitor motional patterns of a user's hand during an interaction between the user's hand and a target virtual object, wherein the interaction relates to a first hand gesture performed by the user in relation to the target virtual object in an artificial reality environment presented to the user by an artificial reality device; and

based on at least the monitored motional patterns of the user's hand, generate a motion-stabilization profile associated with the user, wherein the motion-stabilization profile is configured to stabilize input associated with a motion of the user's hand during a subsequent user interaction within the artificial reality environment.

12. The non-transitory, non-volatile computer-readable medium of claim 11 , wherein the instructions, when executed by one or more processors of the computing system, further cause the computing system to:

determine a trigger for commencing the monitoring of the motional patterns of the user's hand.

13. The non-transitory, non-volatile computer-readable medium of claim 12 , wherein the trigger comprises a context in which the user is interacting with the target virtual object.

14. The non-transitory, non-volatile computer-readable medium of claim 11 , wherein the instructions, when executed by one or more processors of the computing system, further cause the computing system to:

determine a motional range associated with the user based on the motion-stabilization profile.

15. The non-transitory, non-volatile computer-readable medium of claim 11 , wherein the motion-stabilization profile associated with the user is generated utilizing a machine learning model trained on at least the monitored motional patterns of the user's hand.

16. A system, comprising:

one or more processors; and

one or more non-transitory, non-volatile computer readable media storing instructions that, when executed by at least one of the one or more processors, cause the system to:

monitor motional patterns of a user's hand during an interaction between the user's hand and a target virtual object, wherein the interaction relates to a first hand gesture performed by the user in relation to the target virtual object in an artificial reality environment presented to the user by an artificial reality device; and

based on at least the monitored motional patterns of the user's hand, generate a motion-stabilization profile associated with the user, wherein the motion-stabilization profile is configured to stabilize input associated with a motion of the user's hand during a subsequent user interaction within the artificial reality environment.

17. The system of claim 16 , wherein the instructions, when executed by at least one of the one or more processors, further cause the system to:

determine a trigger for commencing the monitoring of the motional patterns of the user's hand.

18. The system of claim 17 , wherein the trigger comprises a context in which the user is interacting with the target virtual object.

19. The system of claim 16 , wherein the instructions, when executed by at least one of the one or more processors, further cause the system to:

determine a motional range associated with the user based on the motion-stabilization profile.

20. The system of claim 16 , wherein the motion-stabilization profile associated with the user is generated utilizing a machine learning model trained on at least the monitored motional patterns of the user's hand.

Assignments (4)
CHANGE OF NAME Recorded Aug 22, 2024
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 068748/0766 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 15, 2024
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 068379/0171 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 13, 2024
From: YITZHAK, ELDAD; NITZAN, ASAF; LONGEST, MATTHEW; FURTWANGLER, BRANDON
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 067714/0911 →
CHANGE OF NAME Recorded May 28, 2024
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 067554/0962 →
Continuity (3)
Continuation 18194323 · Mar 31, 2023
Continuation 17138256 · Dec 30, 2020
Related Publication 20240385694A1 · Nov 21, 2024
References Cited (16)
US 9874977B1 · Soyannwo · 2018 [cited by examiner]
US 11116395B1 · Gur · 2021 [cited by examiner]
US 11687165B2 · Yitzhak · 2023 [cited by examiner]
US 20080306535A1 · Winslow · 2008 [cited by examiner]
US 20160038088A1 · Lari · 2016 [cited by examiner]
US 20170228025A1 · Hall · 2017 [cited by examiner]
US 20170278306A1 · Rico · 2017 [cited by examiner]
US 20190362557A1 · Lacey et al. · 2019 [cited by applicant]
US 20210307652A1 · Lari · 2021 [cited by examiner]
US 20220141483A1 · Takamura · 2022 [cited by examiner]
US 20220206586A1 · Yitzhak · 2022 [cited by examiner]
US 20230004229A1 · Karri · 2023 [cited by examiner]
US 20230045759A1 · Ma · 2023 [cited by examiner]
US 20230061174A1 · Hong · 2023 [cited by examiner]
International Search Report and Written Opinion for International Application No. PCT/US2021/065183 mailed Mar. 24, 2022, 11 pages. [cited by applicant]
Pfeiffer, et al., “Gaze+ Pinch Interaction in Virtual Reality,” Proceedings of the 5th Symposium on Spatial User Interaction, SUI '17, Oct. 16, 2017, pp. 99-108. [cited by applicant]