IP Library Granted Patent US 11,831,814
Granted Patent B2
US 11,831,814 · App. 17/466,528 · Granted Nov 28, 2023

Parallel video call and artificial reality spaces

Inventors: Michael James Lebeau (London, GB); Björn Wanbo (London, GB); Fábio Resende (San Francisco, CA); Mark Rabkin (Palo Alto, CA); Vesa Petteri Rantanen (London, GB)
Assignee: Meta Platforms Technologies, LLC
H04N7/157G06Q10/1093H04L12/1818H04L12/1822
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,831,814
App. No.
17/466,528
Granted
Nov 28, 2023
Kind
B2
Abstract

Aspects of the present disclosure are directed to a VC/XR connection system that can establish and administer an XR space for a video call. The VC/XR connection system allows users to easily transition from a typical video call experience to the XR space, simply by putting on her artificial reality device. The VC/XR connection system can identify calendared video call events, establish corresponding XR spaces, and create a link between the video call and the XR space. Invitees to the video call that don an artificial reality device can be automatically taken into the XR space. The XR space can A) connect to the video call as a call participant, allowing the video call participants to see into the XR space and B) show a feed of the video call in the XR space, allowing users in the XR space to see the video call participants.

Claims (70)

1. A method for establishing and administering an artificial reality (XR) space as a parallel platform for a video call, the method comprising:

establishing the XR space for the video call, wherein one or more XR users, each wearing a head-mounted display of an artificial reality device, join the XR space;

creating a connection mechanism for connecting the XR space to the video call, wherein the XR space provides an XR environment at the same time as the video call;

whereby the one or more XR users view, via that user's artificial reality device, at least portions of the video call; and

whereby the one or more video call users view, via that user's computing device, at least portions of the XR space;

providing the portions of the XR space, to be viewable to the one or more video call users, by adding, using the connection mechanism, one or more representations of the one or more XR users to the video call; and

providing the portions of the video call, to be viewable to the one or more XR users, by adding, using the connection mechanism, one or more representations of the one or more video call users to the XR space,

wherein the adding the one or more representations of the one or more video call users to the XR space includes:

segmenting a single feed, from the video call, into multiple feeds, each showing a representation of one of multiple of the one or more video call users; and

arranging the multiple feeds in the XR space according to a defined layout, for participants, of the XR space.

2. The method of claim 1 , further comprising receiving an identification of a calendar event associated with the video call, wherein one or more video call users each join the video call, via a computing device, without using a head-mounted display, wherein the receiving the identification of the calendar event includes interrogating events on a calendar, for associations with video calls, by:

reviewing links embedded in two or more of the events on the calendar for link portions that match one of multiple link portions, each defined for one of multiple video call platforms.

3. The method of claim 1 , further comprising receiving an identification of a calendar event associated with the video call, wherein one or more video call users each join the video call, via a computing device, without using a head-mounted display, wherein the receiving the identification of the calendar event includes using calendar access permissions to interrogate events, on a calendar, for associations with video calls.

4. The method of claim 1 , further comprising receiving an identification of a calendar event associated with the video call, wherein one or more video call users each join the video call, via a computing device, without using a head-mounted display, wherein the receiving the identification of the calendar event includes receiving a user's manual selection of the calendar event for association with the XR space.

5. The method of claim 1 , wherein establishing the XR space is performed prior to a start time identified for the calendar event.

6. The method of claim 1 , wherein establishing the XR space for the video call includes selecting a size for the XR space based on a determined number of invitees for the video call.

7. The method of claim 1 , wherein establishing the XR space for the video call includes selecting a layout for the XR space based on contextual factors of the calendar event.

8. The method of claim 1 further comprising:

identifying, after the video call has begun, that a new user, who was invited to the video call, has enabled an artificial reality device and, in response:

automatically adding the new user to the XR space.

9. The method of claim 1 ,

wherein the connection mechanism is based on an invite link; and

wherein the connection mechanism is set up by:

adding a system, for an artificial reality device, as an invitee to the video call, and

causing the system for the artificial reality device to receive the invite link, wherein the invite link is configured for the system for the artificial reality device.

10. The method of claim 1 , wherein the connection mechanism is based on an invite link provided in the calendar event.

11. The method of claim 1 , wherein the adding the one or more representations of the one or more XR users to the video call includes:

adding a virtual camera to the XR space; and

providing a feed from the virtual camera to a video call platform, causing the video call platform to show the feed from the virtual camera as a participant in the video call.

12. The method of claim 1 , wherein the adding the one or more representations of the one or more XR users to the video call includes:

adding multiple virtual cameras to the XR space, one for each of the one or more XR users added to the XR space; and

providing multiple feeds, one from each of the virtual cameras, to a video call platform, causing the video call platform to show each of the multiple feeds as a participant in the video call.

13. The method of claim 1 , wherein the adding the one or more representations of the one or more video call users to the XR space includes:

adding a single feed, from the video call, as a virtual element in the XR space, wherein the single feed shows representations of multiple of the one or more video call users.

14. A non-transitory computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to perform a process for establishing and administering an artificial reality (XR) space as a parallel platform for a video call, the process comprising:

establishing the XR space for the video call, wherein one or more XR users, each wearing a head-mounted display of an artificial reality device, join the XR space;

creating a connection mechanism for connecting the XR space to the video call, wherein the XR space provides an XR environment at the same time as the video call;

whereby the one or more XR users view, via that user's artificial reality device, at least portions of the video call; and

whereby the one or more video call users view, via that user's computing device, at least portions of the XR space;

providing the portions of the XR space, to be viewable to the one or more video call users, by adding, using the connection mechanism, one or more representations of the one or more XR users the video call; and

providing the portions of the video call, to be viewable to the one or more XR users, by adding, using the connection mechanism, one or more representations of the one or more video call users to the XR space,

wherein the adding the one or more representations of the one or more video call users to the XR space includes:

segmenting a single feed, from the video call, into multiple feeds, each showing a representation of one of multiple of the one or more video call users; and

arranging the multiple feeds in the XR space according to a defined layout, for participants, of the XR space.

15. The non-transitory computer-readable storage medium of claim 14 , wherein the process further comprises receiving an identification of a calendar event associated with the video call, wherein one or more video call users each join the video call, via a computing device, without using a head-mounted display, wherein the receiving the identification of the calendar event includes interrogating events on a calendar, for associations with video calls, by:

reviewing links embedded in two or more of the events on the calendar for link portions that match one of multiple link portions, each defined for one of multiple video call platforms.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the adding the one or more XR users to the video call includes:

adding a virtual camera to the XR space; and

providing a feed from the virtual camera to a video call platform, causing the video call platform to show the feed from the virtual camera as a participant in the video call.

17. A computing system for establishing and administering an artificial reality (XR) space as a parallel platform for a video call, the computing system comprising:

one or more processors; and

one or more memories storing instructions that, when executed by the one or more processors, cause the computing system to perform a process comprising:

receiving an identification of a calendar event associated with the video call, wherein one or more video call users each join the video call, via a computing device, without using a head-mounted display;

in response to the identification of the calendar event, establishing the XR space for the video call, wherein one or more XR users, each wearing a head-mounted display of an artificial reality device, join the XR space;

accessing a connection mechanism for connecting the XR space to the video call, wherein the XR space provides an XR environment at the same time as the video call;

whereby the one or more XR users view, via that user's artificial reality device, at least portions of the video call; and

whereby the one or more video call users view, via that user's computing device, at least portions of the XR space;

providing the portions of the XR space, to be viewable to the one or more video call users, by adding, using the connection mechanism, one or more representations of the one or more XR users to the video call; and

providing the portions of the video call, to be viewable to the one or more XR users, by adding, using the connection mechanism, one or more representations of the one or more video call users to the XR space,

wherein the adding the one or more representations of the one or more video call users to the XR space includes:

segmenting a single feed, from the video call, into multiple feeds, each showing a representation of one of multiple of the one or more video call users; and

arranging the multiple feeds in the XR space according to a defined layout, for participants, of the XR space.

18. The computing system of claim 17 , wherein the process further comprises:

identifying, after the video call has begun, that a new user who was invited to the video call has enabled an artificial reality device and, in response:

automatically adding the new user to the XR space.

19. The computing system of claim 17 ,

wherein the connection mechanism is based on an invite link; and

wherein the connection mechanism is set up by:

adding a system, for an artificial reality device, as an invitee to the video call, and

causing the system for the artificial reality device to receive the invite link, wherein the invite link is configured for the system for the artificial reality device.

Assignments (2)
CHANGE OF NAME Recorded Jun 15, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060386/0364 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2021
From: LEBEAU, MICHAEL JAMES; WANBO, BJÖRN; RESENDE, FÁBIO; RABKIN, MARK; RANTANEN, VESA PETTERI
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 057639/0963 →
Continuity (1)
Related Publication 20230071584A1 · Mar 9, 2023
Cited By (3)
US 12,289,561 US 12,321,468 US 12,705,847