IP Library Granted Patent US 11,609,625
Granted Patent B2
US 11,609,625 · App. 17/500,383 · Granted Mar 21, 2023

Posture-based virtual space configurations

Inventors: Samuel Alan Johnson (Redwood City, CA); Shaik Shabnam Nizamudeen Basha (Mountain View, CA); Mahdi Salmani Rahimi (San Francisco, CA); Benjamin Antoine Georges Lefaudeux (Menlo Park, CA)
Assignee: Meta Platforms Technologies, LLC
G06F3/011G06T7/60G06T19/006G06T19/20G06T2207/20081G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,609,625
App. No.
17/500,383
Granted
Mar 21, 2023
Kind
B2
Abstract

A virtual space configuration system of an artificial reality system can detect a user posture and provide various corresponding customizations of the system's virtual space. The virtual space configuration system can, when a user is in a seated posture, provide for seated virtual space customizations. In various implementations, these customizations can include allowing adjustment of a floor height; setting a flag that can be surfaced to applications to adjust the applications' mechanics for seated users; customizing display of virtual space boundaries when in seated mode to be less intrusive; providing options to detect when a user leaves seated mode and trigger corresponding actions; provide a passthrough workspace area allowing a user to interact with certain real-world objects naturally without having to remove a virtual reality headset; or automatically determining virtual space dimensions for seated users.

Claims (44)

1. A method for customizing a virtual space based on user posture, the method comprising:

determining that a user posture corresponds to a seated mode;

in response to the determining that the user posture corresponds to the seated mode,

setting a seated customization for the virtual space by:

receiving a boundary mode selection, for the virtual space, corresponding to the seated mode;

detecting a boundary display event; and

displaying, based on the selected boundary mode corresponding to the seated mode, an indication of a boundary area configured based on the selected boundary mode corresponding to the seated mode, wherein the boundary area specifies a physical region in which the user is permitted to move.

2. The method of claim 1 , wherein the boundary mode selection is based on a mapping, provided by a current application, of postures to boundary modes.

3. The method of claim 1 , wherein the selected boundary mode is a passthrough mode that causes the displaying to include displaying images of the real-world in the virtual space.

4. The method of claim 1 , wherein detecting the boundary display event comprises applying a machine learning model trained to: A) receive one or more of inertia data, position data, camera image data, a model of a user's bone structure, or any combination thereof, and B) produce a projection of whether the user will intersect with an outer edge of the boundary area.

5. The method of claim 1 , wherein the displaying includes showing a virtual wall, based on at least part of the boundary area, with a pattern and/or color mapped to the seated mode.

6. The method of claim 1 , wherein the displaying to include displaying images of real-world objects, in the virtual space, that are within the physical region.

7. The method of claim 1 , wherein the displaying includes showing a virtual wall based on at least part of the boundary area.

8. A computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to perform a process for customizing a virtual space based on user posture, the process comprising:

determining that a first user posture corresponds to a seated mode;

in response to the determining that the first user posture corresponds to the seated mode, setting a seated customization for the virtual space by:

while a virtual experience configured for seated mode is in progress:

determining a second user posture corresponds to no-longer being in the seated mode; and

in response to the determining the second user posture corresponds to no-longer being in the seated mode, triggering a response action for the virtual experience including one or more of:

automatically stopping or pausing the virtual experience;

providing a notification to resume a pervious posture or that the current posture is not recommended for the virtual experience;

logging times at which various postures are held;

switching to a display mode that shows real-world objects;

changing input modalities; or

any combination thereof.

9. The computer-readable storage medium of claim 8 , wherein the response action includes the automatically stopping or pausing the virtual experience.

10. The computer-readable storage medium of claim 8 , wherein the response action includes the providing the notification to resume the pervious posture or that the current posture is not recommended for the virtual experience.

11. The computer-readable storage medium of claim 8 , wherein the response action includes the logging times at which various postures are held.

12. The computer-readable storage medium of claim 8 , wherein the response action includes the switching to the display mode that shows real-world objects.

13. The computer-readable storage medium of claim 8 , wherein the response action includes the changing input modalities.

14. The computer-readable storage medium of claim 8 , wherein the response action is selected based on a mapping, provided by a current application, that maps trigger actions to particular posture changes.

15. A computing system for customizing a virtual space based on user posture, the computing system comprising:

one or more processors; and

one or more memories storing instructions that, when executed by the one or more processors, cause the computing system to perform a process comprising:

determining that a first user posture corresponds to a seated mode;

in response to the determining that the first user posture corresponds to the seated mode, setting a seated customization for the virtual space by:

determining a second user posture corresponds to leaning forward;

determining a workspace area; and

in response to the determining the second user posture corresponds to leaning forward, enabling a display mode that displays, in a virtual environment, real-world objects that are in the workspace area.

16. The computing system of claim 15 , wherein the workspace area is determined based on an area defined based on a determined arm-span of a user.

17. The computing system of claim 15 , wherein the workspace area is determined based on an average of workspace areas previously manually set by other users.

18. The computing system of claim 15 , wherein the workspace area is determined based on an area corresponding to a top of a flat real-world object in in front of the user.

19. The computing system of claim 15 , wherein the workspace area is determined based on an area determined to be enclosing one or more specified real-world tools.

20. The computing system of claim 15 , wherein the determining that the first user posture corresponds to the seated mode is based on a determined height of a headset of the computing system and inertial motion data.

Assignments (1)
CHANGE OF NAME Recorded Jun 15, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060386/0364 →
Continuity (2)
Continuation 16705872 · Dec 6, 2019
Related Publication 20220035444A1 · Feb 3, 2022
Cited By (6)
US 12,223,587 US 12,353,680 US 12,468,379 US 12,492,913 US 12,501,150 US 12,663,874