IP Library Granted Patent US 11,557,093
Granted Patent B1
US 11,557,093 · App. 16/566,335 · Granted Jan 17, 2023

Using social connections to define graphical representations of users in an artificial reality setting

Inventor: Mark Terrano (Redmond, WA)
Assignee: Meta Platforms Technologies, LLC
G06T19/00G06T13/40G06T2210/08G06T2210/36G06T2219/024H04L67/10H04L67/306
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,557,093
App. No.
16/566,335
Granted
Jan 17, 2023
Kind
B1
Abstract

Systems, methods, and non-transitory computer-readable media are disclosed for variably rendering graphical representations of co-users in VR environments based on social graph information between the co-users and a VR user. For example, the disclosed systems can identify a co-user within a VR environment. Furthermore, the disclosed systems can determine a social relevancy (e.g., a social relationship type) between the co-user and a VR user within the VR environment based on social graph information. Then, the disclosed systems can select and/or determine a graphical representation and/or other capabilities of the co-user within the VR environment based on the social relevancy. Additionally, the disclosed systems can display the co-user within the VR environment using the determined graphical representation type (e.g., from the perspective of the VR user).

Claims (66)

1. A computer-implemented method comprising:

identifying a virtual user identity within a three-dimensional (3D) virtual reality environment displayed by a head mounted display associated with a user, wherein the virtual user identity is associated with a co-user of a communications system;

determining a social relationship type for the co-user based on social graph information associated with the user and the co-user;

automatically selecting, without user interaction, a 3D graphical representation type specific to the social relationship type for the co-user;

automatically selecting, without user interaction, a set of virtual reality communication capabilities specific to the social relationship type for the co-user to enable the co-user to interact with the user within the 3D virtual reality environment by utilizing associations between the social relationship type and one or more virtual reality communication capabilities to select a combination of two or more of a symbol-based virtual reality communication capability, a color-based virtual reality communication capability, a movement-based virtual reality communication capability, an emote-based virtual reality communication capability, or a voice-based virtual reality communication capability; and

in response to detecting the co-user within a point of view of the user in the 3D virtual reality environment, causing the head mounted display to automatically display the co-user within the 3D virtual reality environment utilizing the automatically selected 3D graphical representation type to represent the virtual user identity associated with the co-user within the 3D virtual reality environment and to generate communications transmitted by a device corresponding to the co-user using the automatically selected set of virtual reality communication capabilities from for the co-user within the 3D virtual reality environment.

2. The computer-implemented method of claim 1 , further comprising determining the social relationship type for the co-user by determining a number of social connections between the user and the co-user from the social graph information, wherein the social relationship type comprises at least one of a family member type, a close friend type, a casual friend type, an acquaintance type, a stranger type, or a restricted type.

3. The computer-implemented method of claim 1 , wherein the 3D graphical representation type for the co-user comprises at least one of:

a first 3D graphical representation type having a first level of graphical detail; or

a second 3D graphical representation type having a second level of graphical detail different than the first level of graphical detail.

4. The computer-implemented method of claim 1 , further comprising:

identifying a second virtual user identity within the 3D virtual reality environment, wherein the second virtual user identity is associated with a second co-user of the communications system;

determining a social relationship type for the second co-user based on social graph information associated with the user and the second co-user, wherein the social relationship type for the co-user is different than the social relationship type for the second co-user; and

causing the head mounted display to display a second 3D graphical representation type specific to the social relationship type for the second co-user to represent the second virtual user identity within the 3D virtual reality environment.

5. The computer-implemented method of claim 1 , further comprising determining the social relationship type for the co-user by utilizing connections between the user and the co-user from nodes and edges of the social graph information.

6. The computer-implemented method of claim 1 , further comprising:

identifying multiple virtual user identities within the 3D virtual reality environment, wherein the multiple virtual user identities are associated with multiple co-users of the communications system;

determining a social relationship type for the multiple co-users based on social graph information associated with the user and the multiple co-users, wherein the social relationship type for the co-user is different than the social relationship type for the multiple co-users;

selecting an additional set of virtual reality communication capabilities specific to the social relationship type for the multiple co-users, wherein the additional set of virtual reality communication capabilities is different from the set of virtual reality communication capabilities; and

causing the head mounted display to generate additional communications corresponding to the additional set of virtual reality communication capabilities from the multiple co-users within the 3D virtual reality environment as an aggregate communication.

7. The computer-implemented method of claim 1 , further comprising:

providing, for display within a graphical user interface of the head mounted display associated with the user, graphical representation preference information with a selectable option to associate one or more 3D graphical representation types with one or more social relationship types; and

receiving, from the head mounted display, a user selection of a particular 3D graphical representation type for a particular social relationship type.

8. A non-transitory computer-readable medium storing instructions that, when executed by at least one processor, cause a computer device to:

identify a virtual user identity within a three-dimensional (3D) virtual reality environment displayed by a head mounted display associated with a user, wherein the virtual user identity is associated with a co-user of a communications system;

determine a social relationship type for the co-user based on social graph information associated with the user and the co-user;

automatically select, without user interaction, a 3D graphical representation type specific to the social relationship type for the co-user;

automatically select, without user interaction, a set of virtual reality communication capabilities specific to the social relationship type for the co-user to enable the co-user to interact with the user within the 3D virtual reality environment by utilizing associations between the social relationship type and one or more virtual reality communication capabilities to select a combination of two or more of a symbol-based communication capability virtual reality, a color-based virtual reality communication capability, a movement-based virtual reality communication capability, an emote-based virtual reality communication capability, or a voice-based virtual reality communication capability; and

in response to detecting the co-user within a point of view of the user in the 3D virtual reality environment, cause the head mounted display to automatically display the co-user within the 3D virtual reality environment utilizing the automatically selected 3D graphical representation type to represent the virtual user identity associated with the co-user within the 3D virtual reality environment and to generate communications transmitted by a device corresponding to the co-user using the automatically selected set of virtual reality communication capabilities for the co-user within the 3D virtual reality environment.

9. The non-transitory computer-readable medium of claim 8 , further storing instructions that, when executed by the at least one processor, cause the computer device to determine the social relationship type for the co-user by determining a number of social connections between the user and the co-user from the social graph information, wherein the social relationship type comprises at least one of a family member type, a close friend type, a casual friend type, an acquaintance type, a stranger type, or a restricted type.

10. The non-transitory computer-readable medium of claim 8 , wherein the 3D graphical representation type for the co-user comprises at least one of:

a first 3D graphical representation type having a first level of graphical detail; or

a second 3D graphical representation type having a second level of graphical detail different than the first level of graphical detail.

11. The non-transitory computer-readable medium of claim 8 , further storing instructions that, when executed by the at least one processor, cause the computer device to:

identify a second virtual user identity within the 3D virtual reality environment, wherein the second virtual user identity is associated with a second co-user of the communications system;

determine a social relationship type for the second co-user based on social graph information associated with the user and the second co-user, wherein the social relationship type for the co-user is different than the social relationship type for the second co-user; and

cause the head mounted display to display a second 3D graphical representation type specific to the social relationship type for the second co-user to represent the second virtual user identity within the 3D virtual reality environment.

12. The non-transitory computer-readable medium of claim 11 , wherein:

causing the head mounted display to display the co-user within the 3D virtual reality environment utilizing the selected 3D graphical representation type by causing the head mounted display to display a digital avatar to represent the virtual user identity associated with the co-user within the 3D virtual reality environment; and

causing the head mounted display to display the second 3D graphical representation type specific to the social relationship type for the second co-user comprises causing the head mounted display to display a digital dot to represent the second virtual user identity associated with the second co-user within the 3D virtual reality environment.

13. The non-transitory computer-readable medium of claim 8 , further storing instructions that, when executed by the at least one processor, cause the computer device to:

select a display position for the co-user specific to the social relationship type for the co-user; and

cause the head mounted display to display the 3D graphical representation type of the co-user within the 3D virtual reality environment at the display position.

14. The non-transitory computer-readable medium of claim 13 , further storing instructions that, when executed by the at least one processor, cause the computer device to select the display position by selecting a radial range specific to the social relationship type for the co-user, the radial range indicating a radial distance from the user within the 3D virtual reality environment.

15. A system comprising:

at least one processor; and

at least one non-transitory computer-readable storage medium storing instructions that, when executed by the at least one processor, cause the system to:

identify a virtual user identity within a three-dimensional (3D) virtual reality environment displayed by a head mounted display associated with a user, wherein the virtual user identity is associated with a co-user of a communications system;

determine a social relationship type for the co-user based on social graph information associated with the user and the co-user;

automatically select, without user interaction, a 3D graphical representation type specific to the social relationship type for the co-user;

automatically select, without user interaction, a set of virtual reality communication capabilities specific to the social relationship type for the co-user to enable the co-user to interact with the user within the 3D virtual reality environment by utilizing associations between the social relationship type and one or more virtual reality communication capabilities to select a combination of two or more of a symbol-based virtual reality communication capability, a color-based virtual reality communication capability, a movement-based virtual reality communication capability, an emote-based virtual reality communication capability, or a voice-based virtual reality communication capability; and

in response to detecting the co-user within a point of view of the user in the 3D virtual reality environment, cause the head mounted display to automatically display the co-user within the 3D virtual reality environment utilizing the automatically selected 3D graphical representation type to represent the virtual user identity associated with the co-user within the 3D virtual reality environment and to generate communications transmitted by a device corresponding to the co-user using the automatically selected set of virtual reality communication capabilities for the co-user within the 3D virtual reality environment.

16. The system of claim 15 , further comprising instructions that, when executed by the at least one processor, cause the system to determine the social relationship type for the co-user by determining a number of social connections between the user and the co-user from the social graph information, wherein the social relationship type comprises at least one of a family member type, a close friend type, a casual friend type, an acquaintance type, a stranger type, or a restricted type.

17. The system of claim 15 , wherein the 3D graphical representation type for the co-user comprises at least one of:

a first 3D graphical representation type having a first level of graphical detail; or

a second 3D graphical representation type having a second level of graphical detail different than the first level of graphical detail.

18. The system of claim 15 , further comprising instructions that, when executed by the at least one processor, cause the system to:

identify a second virtual user identity within the 3D virtual reality environment, wherein the second virtual user identity is associated with a second co-user of the communications system;

determine a social relationship type for the second co-user based on social graph information associated with the user and the second co-user, wherein the social relationship type for the co-user is different than the social relationship type for the second co-user; and

select an additional set of virtual reality communication capabilities specific to the social relationship type for the second co-user, wherein the additional set of virtual reality communication capabilities is different from the set of virtual reality communication capabilities.

19. The system of claim 18 , wherein:

causing the head mounted display to display the co-user within the 3D virtual reality environment utilizing the selected 3D graphical representation type by causing the head mounted display to display a digital avatar to represent the virtual user identity associated with the co-user within the 3D virtual reality environment; and

causing the head mounted display to display a 3D second graphical representation type specific to the social relationship type for the second co-user comprises causing the head mounted display to display a digital dot to represent the second virtual user identity associated with the second co-user within the 3D virtual reality environment.

20. The system of claim 19 , wherein:

the set of virtual reality communication capabilities for the co-user comprise the movement-based virtual reality communication capability and the voice-based virtual reality communication capability; and

the additional set of virtual reality communication capabilities for the second co-user comprise the color-based virtual reality communication capability and the movement-based virtual reality communication capability.

Assignments (2)
CHANGE OF NAME Recorded May 19, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060121/0676 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 10, 2019
From: TERRANO, MARK
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 050330/0580 →
Cited By (6)
US 12,271,839 US 12,327,315 US 12,394,106 US 12,417,600 US 12,452,056 US 12,567,180