IP Library Granted Patent US 11,606,364
Granted Patent B2
US 11,606,364 · App. 17/085,579 · Granted Mar 14, 2023

Artificial reality collaborative working environments

Inventors: Michael James LeBeau (London, GB); Manuel Ricardo Freire Santos (London, GB); Aleksejs Anpilogovs (London, GB); Alexander Sorkine Hornung (Zürich, CH); Bjorn Wanbo (London, GB); Connor Treacy (London, GB); Fangwei Lee (San Carlos, CA); Federico Ruiz (London, GB); Jonathan Mallinson (London, GB); Jonathan Richard Mayoh (London, GB); Marcus Tanner (Old Windsor, GB); Panya Inversin (Zürich, CH); Sarthak Ray (Santa Clara, CA); Sheng Shen (Seattle, WA); William Arthur Hugh Steptoe (London, GB); Alessia Marra (Zürich, CH); Gioacchino Noris (Zürich, CH); Derrick Readinger (Redmond, WA); Jeffrey Wai-King Lock (Menlo Park, CA); Jeffrey Witthuhn (Fremont, CA); Jennifer Lynn Spurlock (Seattle, WA); Larissa Heike Laich (Zürich, CH); Javier Alejandro Sierra Santos (London, GB)
Assignee: Meta Platforms Technologies, LLC
H04L63/107G06F3/011G06F3/0219G06F3/1423G06T19/003G06T19/006G06V40/107H04L65/4015H04L65/4046H04L65/70G06T2219/024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,606,364
App. No.
17/085,579
Granted
Mar 14, 2023
Kind
B2
Abstract

Aspects of the present disclosure are directed to creating and administering artificial reality collaborative working environments and providing interaction modes for them. An XR work system can provide and control such artificial reality collaborative working environments to enable, for example, A) links between real-world surfaces and XR surfaces; B) links between multiple real-world areas to XR areas with dedicated functionality; C) maintaining access, while inside the artificial reality working environment, to real-world work tools such as the user's computer screen and keyboard; D) various hand and controller modes for different interaction and collaboration modalities; E) use-based, multi-desk collaborative room configurations; and F) context-based auto population of users and content items into the artificial reality working environment.

Claims (63)

1. A method comprising:

establishing at least two virtual areas, each corresponding to a real-world area; and

providing an artificial reality environment in relation to the at least two virtual areas by:

identifying a height of a dedicated space on a surface of a real-world desk in one of the real-world areas, and setting a height of a virtual desk, based on the identified height of the dedicated space, in one of the at least two virtual areas, corresponding to the real-world area that includes the real-world desk; or

transitioning between a first of the at least two virtual areas to a second of the at least two virtual areas by:

detecting a position switch trigger;

turning on a passthrough mode that presents, in the artificial reality environment, a display of the real-world;

detecting that a user has arrived at the second of the at least two virtual areas; and

disabling the passthrough mode.

2. The method of claim 1 , wherein the method comprises the identifying the height of the dedicated space on the surface of the real-world desk in the one of the real-world areas, and setting the height of the virtual desk, based on the identified height of the dedicated space, in the one of the at least two virtual areas, corresponding to the real-world area that includes the real-world desk.

3. The method of claim 1 , wherein the method comprises the transitioning between the first of the at least two virtual areas to the second of the at least two virtual areas, including the detecting the position switch trigger, the turning on the passthrough mode, the detecting that the user has arrived at the second of the at least two virtual areas, and the disabling the passthrough mode.

4. The method of claim 3 , wherein the position switch trigger comprises detecting that the user has stood up.

5. The method of claim 3 , wherein the passthrough mode includes displaying an overlay, of at least part of the second of the at least two virtual areas, over the display of the real-world.

6. The method of claim 1 ,

wherein at least one of the at least two virtual areas is a whiteboarding area;

wherein the whiteboarding area includes multiple whiteboard units, each whiteboard unit being the same specified size; and

wherein, when in the whiteboarding area, the user can activate a command or control to move between the multiple whiteboard units without having to move in a longitude or latitude direction in the real-world.

7. A computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to perform a process comprising:

establishing at least two virtual areas, each corresponding to a real-world area; and

providing an artificial reality environment in relation to the at least two virtual areas by:

identifying a height of a dedicated space in relation to a surface of a real-world desk in one of the real-world areas, wherein the dedicated space is at least a pre-determined size;

automatically identifying that there is not enough open space on the surface of the real-world desk for the pre-determined size of the dedicated space and in response, warning a user to make available additional space on the surface of the real-world desk; and

setting a height of a virtual desk, based on the identified height of the dedicated space, in one of the at least two virtual areas, corresponding to the real-world area that includes the real-world desk.

8. The computer-readable storage medium of claim 7 , wherein identifying the height of the dedicated space on the surface of the real-world desk is based on a determined vertical position of a tracked keyboard.

9. The computer-readable storage medium of claim 7 , wherein the process further comprises:

interfacing with a real-world keyboard that is at least partially in the dedicated space;

causing the real-world keyboard to display a pattern of lights; and

tracking the real-world keyboard based on recognizing the pattern of lights.

10. The computer-readable storage medium of claim 7 , wherein the process further comprises:

detecting that a user's attention is focused outside a current virtual area, of the at least two virtual areas, that corresponds to a real-world location in which the user is located; and

in response, automatically turning on a passthrough mode that presents, in the artificial reality environment, a display of the real-world.

11. A computing system comprising:

one or more processors; and

one or more memories storing instructions that, when executed by the one or more processors, cause the computing system to perform a process comprising:

establishing at least two virtual areas, each corresponding to a real-world area;

providing an artificial reality environment in relation to the at least two virtual areas; and

transitioning a user between a first of the at least two virtual areas to a second of the at least two virtual areas by:

detecting a position switch trigger;

turning on a passthrough mode that presents, in the artificial reality environment, a display of the real-world;

detecting that the user has arrived at the second of the at least two virtual areas; and

disabling the passthrough mode.

12. The computing system of claim 11 , wherein the second of the at least two virtual areas is a whiteboarding area, and wherein the whiteboarding area is associated with multiple whiteboards, that each correspond to a particular project or team and that can be individually activated.

13. The computing system of claim 11 , wherein the detecting that the user has arrived at the second of the at least two virtual areas includes detecting that the user has moved from A) the real-world area corresponding to the first of the at least two virtual areas to B) the real-world area corresponding to the second of the at least two virtual areas.

14. The computing system of claim 11 , wherein the process further comprises:

identifying a height of a dedicated space on a surface of a real-world desk in one of the real-world areas;

setting a height of a virtual desk, based on the identified height of the dedicated space, in one of the at least two virtual areas, corresponding to the real-world area that includes the real-world desk; and

setting one or more anchors, in relation to the dedicated space, where each anchor is identified as a location in the artificial reality environment for placing virtual content.

15. The computing system of claim 14 , wherein the process further comprises:

receiving a stream of the display of a real-world computer; and

displaying content from the display of a real-world computer, in the artificial reality environment, with a location based on at least one of the one or more anchors.

16. The computing system of claim 11 ,

wherein at least one of the at least two virtual areas is a whiteboarding area;

wherein the real-world area corresponding to the whiteboarding area includes a wall, wherein a portion of the wall is associated with a virtual whiteboard; and

wherein interactions by the user with the portion of the wall are interpreted as interactions with the virtual whiteboard.

17. The computing system of claim 11 ,

wherein at least one of the at least two virtual areas is a whiteboarding area;

wherein the real-world area corresponding to the whiteboarding area includes a 2D plane, in the air, associated with a virtual whiteboard; and

wherein interactions by the user that intersect the 2D plane are interpreted as interactions with the virtual whiteboard.

18. The computing system of claim 11 , wherein the passthrough mode includes a direction overlay indicating a direction for the user to reach the second of the at least two virtual areas.

19. The computing system of claim 11 ,

wherein the first of the at least two virtual areas includes a virtual desk with one or more content items displayed on a surface of the virtual desk;

wherein the second of the at least two virtual areas includes a whiteboard, and

wherein the process further comprises, in response to the detecting that the user has arrived at the second of the at least two virtual areas, automatically displaying the one or more content items from the surface of the virtual desk on the whiteboard.

Assignments (2)
CHANGE OF NAME Recorded Jun 15, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060386/0364 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 25, 2021
From: LEBEAU, MICHAEL JAMES; FREIRE SANTOS, MANUEL RICARDO; ANPILOGOVS, ALEKSEJS; HORNUNG, ALEXANDER SORKINE; WANBO, BJORN; TREACY, CONNOR; LEE, FANGWEI; RUIZ, FEDERICO; MALLINSON, JONATHAN; MAYOH, JONATHAN RICHARD; TANNER, MARCUS; INVERSIN, PANYA; RAY, SARTHAK; SHEN, SHENG; STEPTOE, WILLIAM ARTHUR HUGH; MARRA, ALESSIA; NORIS, GIOACCHINO; READINGER, DERRICK; LOCK, JEFFREY WAI-KING; WITTHUHN, JEFFREY; SPURLOCK, JENNIFER LYNN; LAICH, LARISSA HEIKE; SANTOS, JAVIER ALEJANDRO SIERRA
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 056335/0365 →
Continuity (2)
Provisional Application 63078821 · Sep 15, 2020
Related Publication 20220086205A1 · Mar 17, 2022
Cited By (5)
US 12,238,059 US 12,586,326 US 12,614,355 US 12,712,840 US 12,719,882