IP Library Granted Patent US 11,687,165
Granted Patent B2
US 11,687,165 · App. 17/138,256 · Granted Jun 27, 2023

Stabilizing gestures in artificial reality environments

Inventors: Eldad Yitzhak (Foster City, CA); Asaf Nitzan (Menlo Park, CA); Matthew Longest (Seattle, WA); Brandon Furtwangler (Issaquah, WA)
Assignee: Meta Platforms Technologies, LLC
G06F3/017G02B27/0093G02B27/017G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,687,165
App. No.
17/138,256
Granted
Jun 27, 2023
Kind
B2
Abstract

A method includes displaying an artificial reality environment to a user, determining a context in which the user is interacting with the artificial reality environment, and determining, based on the context, that the user intends to use a hand gesture to interact with a target virtual object within the artificial reality environment. The method further includes monitoring, while the user is attempting to interact with the target virtual object, motional patterns of the hand gesture performed by the user with respect to the target virtual object, and generating a motion-stabilization profile associated with the user based on the motional patterns. The motion-stabilization profile is configured to be utilized to stabilize the hand gesture performed by the user during subsequent user interactions within the artificial reality environment.

Claims (49)

1. A method comprising, by a computing system:

displaying an artificial reality environment to a user wearing an artificial reality device;

determining a context in which the user wearing the artificial reality device is interacting with the artificial reality environment;

determining, based on the context, that the user wearing the artificial reality device intends to use a hand gesture to interact with a target virtual object displayed by the artificial reality device worn by the user;

monitoring, while the user wearing the artificial reality device is attempting to interact using the hand gesture with the target virtual object displayed by the artificial reality device worn by the user, motional patterns of the hand gesture performed by the user with respect to the target virtual object; and

generating a motion-stabilization profile associated with the user based on at least the monitored motional patterns of the hand gesture performed by the user wearing the artificial reality device with respect to the target virtual object displayed by the artificial reality device worn by the user, wherein the motion-stabilization profile is configured to be utilized to stabilize the hand gesture performed by the user during subsequent user interactions within the artificial reality environment.

2. The method of claim 1 , wherein determining the context in which the user wearing the artificial reality device is interacting with the artificial reality environment comprises determining a trigger for which to commence monitoring the motional patterns of the hand gesture performed by the user with respect to the target virtual object.

3. The method of claim 1 , wherein determining, based on the context, that the user wearing the artificial reality device intends to use the hand gesture to interact with the target virtual object comprises determining a time elapsed while the user is attempting to interact with the target virtual object.

4. The method of claim 1 , further comprising determining a motional range associated with the user based on the motion-stabilization profile.

5. The method of claim 4 , further comprising:

monitoring, while the user wearing the artificial reality device is attempting to perform the subsequent user interactions with virtual objects in the artificial reality environment, a motion of the hand gesture performed by the user with respect to the virtual objects; and

stabilizing the hand gesture performed by the user during the subsequent user interactions with the virtual objects in the artificial reality environment when the motion of the hand gesture performed by the user exceeds the motional range.

6. The method of claim 4 , further comprising:

monitoring, while the user wearing the artificial reality device is attempting to perform the subsequent user interactions with virtual objects in the artificial reality environment, a motion of the hand gesture performed by the user with respect to the virtual objects; and

forgoing stabilizing the hand gesture performed by the user during the subsequent user interactions with the virtual objects in the artificial reality environment when the motion of the hand gesture performed by the user is within the motional range.

7. The method of claim 1 , wherein the user is a first user, and wherein the motion-stabilization profile is a first motion-stabilization profile, the method, further comprising:

monitoring, while a second user is attempting to interact with a second target virtual object within the artificial reality environment, motional patterns of a second hand gesture performed by the second user with respect to the second target virtual object; and

generating a second motion-stabilization profile associated with the second user based on the motional patterns, wherein the second motion-stabilization profile is configured to be utilized to stabilize the second hand gesture performed by the second user during subsequent user interactions with virtual objects in the artificial reality environment.

8. The method of claim 7 , wherein the second motion-stabilization profile is different from the first motion-stabilization profile.

9. The method of claim 1 , wherein the motion-stabilization profile associated with the user is generated utilizing a process executing in the background with respect to the artificial reality environment.

10. A system comprising:

one or more non-transitory computer-readable storage media including instructions; and

one or more processors coupled to the storage media, the one or more processors configured to execute the instructions to:

display an artificial reality environment to a user wearing an artificial reality device;

determine a context in which the user wearing the artificial reality device is interacting with the artificial reality environment;

determine, based on the context, that the user wearing the artificial reality device intends to use a hand gesture to interact with a target virtual object displayed by the artificial reality device worn by the user;

monitor, while the user wearing the artificial reality device is attempting to interact using the hand gesture with the target virtual object displayed by the artificial reality device worn by the user, motional patterns of the hand gesture performed by the user with respect to the target virtual object; and

generate a motion-stabilization profile associated with the user based on at least the monitored motional patterns of the hand gesture performed by the user wearing the artificial reality device with respect to the target virtual object displayed by the artificial reality device worn by the user, wherein the motion-stabilization profile is configured to be utilized to stabilize the hand gesture performed by the user during subsequent user interactions within the artificial reality environment.

11. The system of claim 10 , wherein the instructions to determine the context in which the user wearing the artificial reality device is interacting with the artificial reality environment further comprise instructions to determine a trigger for which to commence monitoring the motional patterns of the hand gesture performed by the user with respect to the target virtual object.

12. The system of claim 10 , wherein the instructions to determine, based on the context, that the user wearing the artificial reality device intends to use the hand gesture to interact with the target virtual object further comprise instructions to determine a time elapsed while the user is attempting to interact with the target virtual object.

13. The system of claim 10 , wherein the instructions further comprise instructions to determine a motional range associated with the user based on the motion-stabilization profile.

14. The system of claim 13 , wherein the instructions further comprise instructions to:

monitor, while the user wearing the artificial reality device is attempting to perform the subsequent user interactions with virtual objects in the artificial reality environment, a motion of the hand gesture performed by the user with respect to the virtual objects; and

stabilize the hand gesture performed by the user during the subsequent user interactions with the virtual objects in the artificial reality environment when the motion of the hand gesture performed by the user exceeds the motional range.

15. The system of claim 13 , wherein the instructions further comprise instructions to:

monitor, while the user wearing the artificial reality device is attempting to perform the subsequent user interactions with virtual objects in the artificial reality environment, a motion of the hand gesture performed by the user with respect to the virtual objects; and

forgo stabilizing the hand gesture performed by the user during the subsequent user interactions with the virtual objects in the artificial reality environment when the motion of the hand gesture performed by the user is within the motional range.

16. The system of claim 10 , wherein the user is a first user, and wherein the motion-stabilization profile is a first motion-stabilization profile, the instructions further comprising instructions to:

monitor, while a second user is attempting to interact with a second target virtual object within the artificial reality environment, motional patterns of a second hand gesture performed by the second user with respect to the second target virtual object; and

generate a second motion-stabilization profile associated with the second user based on the motional patterns, wherein the second motion-stabilization profile is configured to be utilized to stabilize the second hand gesture performed by the second user during subsequent user interactions with virtual objects in the artificial reality environment.

17. The system of claim 16 , wherein the second motion-stabilization profile is different from the first motion-stabilization profile.

18. The system of claim 10 , wherein the motion-stabilization profile associated with the user is generated utilizing a process executing in the background with respect to the artificial reality environment.

19. A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors of a computing system, cause the one or more processors to:

display an artificial reality environment to a user wearing an artificial reality device;

determine a context in which the user wearing the artificial reality device is interacting with the artificial reality environment;

determine, based on the context, that the user wearing the artificial reality device intends to use a hand gesture to interact with a target virtual object displayed by the artificial reality device worn by the user;

monitor, while the user wearing the artificial reality device is attempting to interact using the hand gesture with the target virtual object displayed by the artificial reality device worn by the user, motional patterns of the hand gesture performed by the user with respect to the target virtual object; and

generate a motion-stabilization profile associated with the user based on at least the monitored motional patterns of the hand gesture performed by the user wearing the artificial reality device with respect to the target virtual object displayed by the artificial reality device worn by the user, wherein the motion-stabilization profile is configured to be utilized to stabilize the hand gesture performed by the user during subsequent user interactions within the artificial reality environment.

20. The non-transitory computer-readable medium of claim 19 , wherein the motion-stabilization profile associated with the user is generated utilizing a process executing in the background with respect to the artificial reality environment.

Assignments (2)
CHANGE OF NAME Recorded Jul 6, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060591/0848 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 21, 2021
From: YITZHAK, ELDAD; NITZAN, ASAF; LONGEST, MATTHEW; FURTWANGLER, BRANDON
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 056318/0840 →