IP Library Granted Patent US 11,651,562
Granted Patent B2
US 11,651,562 · App. 17/138,656 · Granted May 16, 2023

Method and system for enabling enhanced user-to-user communication in digital realities

Inventor: Cevat Yerli (Frankfurt am Main, DE)
Assignee: TMRW Foundation IP S. À R.L.
G06T19/006G06F3/011G06T7/75G06V40/176G06T2207/30208G06T2219/024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,651,562
App. No.
17/138,656
Granted
May 16, 2023
Kind
B2
Abstract

A method for enabling the enhanced user-to-user communication in digital realities comprising generating a marker of a target user that is persistently applied on the target user; detecting, through a wireless network, the presence of a target user device and counterpart user device connected to the server via the wireless network; sending a notification to the counterpart user device informing about the presence of the target user device based on a set of rules; receiving one or more forms of interaction from the counterpart user device on the marker of the target user; opening up a communication channel between the counterpart user device and target user device; and receiving, processing and accordingly redirecting corresponding communications through and between the counterpart user device and target user device. A system thereof is also disclosed.

Claims (44)

1. A method for enabling communication in a virtual world system implemented by a server comprising memory and at least one processor, the method comprising:

generating a marker of a target user that is associated with the target user and presented in the virtual world system;

detecting presence in the virtual world system of a target user device and a counterpart user device connected to the server via a wireless network;

sending a notification to the counterpart user device informing about the presence of the target user device in the virtual world system based on a set of rules, wherein the notification sent to the counterpart user device is made perceptible by virtually adding transparency to 3D structure data in the virtual world system, and wherein the notification is in the form of a highlighted version of the marker of the target user that is visible within a field of view of a user of the counterpart user device through an object corresponding to the 3D structure data to which the transparency has been added;

receiving one or more forms of interaction from the counterpart user device on the marker of the target user in the virtual world system;

opening up a communication channel between the counterpart user device and the target user device responsive to the one or more received forms of interaction; and

receiving and directing communications between the counterpart user device and the target user device via the communication channel.

2. The method of claim 1 , wherein the marker comprises an interactive virtual shape generated from a virtual replica of the target user retrieved from the virtual world system.

3. The method of claim 2 , further comprising, during communications between the user of the counterpart user device and the target user:

retrieving, by the server, sensor data associated with facial expressions or body language of the users; and

updating the versions of the virtual replica of the corresponding users based on the sensor data.

4. The method of claim 2 , further comprising virtually placing the versions of the virtual replicas in spatial proximity to simulate a close-range communication.

5. The method of claim 1 , wherein the marker is one of a pointer, an icon positioned on top of the target user, or an outline.

6. The method of claim 1 , wherein the notification to the counterpart user device is performed by virtually augmenting the marker of the target user with at least one distinctive characteristic comprising one or more distinctive colors, lighting effects, sounds, shapes, haptic sensations, or combinations thereof perceptible through the counterpart user device.

7. The method of claim 1 , wherein the set of rules comprises specific entitlements based on social connections between users, interest zones comprising one or more interests assigned to one or more predetermined geographic zones, individual user interests, a distance factor, availability configuration settings, or combinations thereof.

8. The method of claim 1 , wherein opening up the communication channel between the counterpart user device and target user device responsive to the one or more received forms of interaction comprises:

generating and sending an invitation to the target user device; and

if the invited target user accepts the invitation, receiving, from the invited target user, an invitation confirmation.

9. The method of claim 1 , wherein communications are enabled between human users, artificial reality users, or combinations thereof, through communication channels enabling communication through sharing of audio, video, text, hand or facial gestures, or movements.

10. A system for enabling communication in a virtual world system, the system comprising:

a server comprising memory and at least one processor, the memory comprising instructions that, when executed by the at least one processor, trigger the at least one processor to:

generate a marker of a target user that is associated with the target user and presented in the virtual world system;

detect presence in the virtual world system of a target user device and counterpart user device connected to the server via a wireless network;

send a notification to the counterpart user device informing about the presence of the target user device in the virtual world system based on a set of rules, wherein the notification sent to the counterpart user device is made perceptible by virtually adding transparency to 3D structure data in the virtual world system, and wherein the notification is in the form of a highlighted version of the marker of the target user that is visible within a field of view of a user of the counterpart user device through an object corresponding to the 3D structure data to which the transparency has been added;

receive one or more forms of interaction from the counterpart user device on the marker of the target user in the virtual world system;

open up a communication channel between the counterpart user device and the target user device responsive to the one or more received forms of interaction; and

receive and direct communication between the counterpart user device and the target user device via the communication channel.

11. The system of claim 10 , wherein the marker comprises an interactive virtual shape generated from a virtual replica of the target user retrieved from the virtual world system.

12. The system of claim 11 , wherein the server is further configured to:

retrieve sensor data associated with facial expressions or body language of the users;

update the versions of the virtual replicas of the corresponding users based on the sensor data; and

place the versions of the virtual replicas to simulate a close-range communication.

13. The system of claim 10 , wherein the set of rules comprises specific entitlements based on social connections between users, interest zones comprising one or more interests assigned to one or more predetermined geographic zones, individual user interests, a distance factor, availability configuration settings, or combinations thereof.

14. The system of claim 10 , wherein the one or more forms of interaction comprise at least one of looking, pointing, clicking, grabbing, pinching, swiping, interaction through voice, interaction through text, hand or facial gestures or movements, or combinations thereof.

15. The system of claim 10 , wherein the communications enable group interactions of more than two users.

16. One or more non-transitory computer-readable media having stored thereon instructions configured to cause a server computer system comprising memory and at least one processor to perform a method for enabling communication in a virtual world system, comprising the steps of:

generating a marker of respective users from a plurality of positional and orientational data points obtained from a first user device and a target user device;

detecting presence in the virtual world system of the first user device and the target user device connected to the server via a wireless network;

sending a notification to the first user device informing about the presence of the target user device in the virtual world system based on a set of rules, wherein the notification sent to the first user device is made perceptible by virtually adding transparency to 3D structure data in the virtual world system, and wherein the notification is in the form of a highlighted version of a marker of a target user that is visible within a field of view of a user of the counterpart user device through an object corresponding to the 3D structure data to which the transparency has been added;

receiving a form of interaction from the first user device on the marker of the target user in the virtual world system;

opening up a communication channel between the first user device and the target user device in response to the received form of interaction; and

receiving and directing communication between the first user device and the target user device via the communication channel.

17. The non-transitory computer-readable medium of claim 16 , wherein the marker of the target user comprises an interactive virtual shape generated from a virtual replica of the target user retrieved from the virtual world system.

18. The non-transitory computer-readable medium of claim 16 , wherein the instructions are further configured to cause the server computer system to retrieve sensor data associated with facial expressions or body language of the users and update the versions of the virtual replica of the corresponding users based on the sensor data.

Assignments (2)
CHANGE OF NAME Recorded Apr 18, 2025
From: TMRW FOUNDATION IP S.À R.L.
To: TMRW GROUP IP
Reel/Frame 070891/0012 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 9, 2023
From: YERLI, CEVAT
To: TMRW FOUNDATION IP S.ÀR.L.
Reel/Frame 063583/0662 →
Continuity (2)
Provisional Application 62955232 · Dec 30, 2019
Related Publication 20210201588A1 · Jul 1, 2021