IP Library Granted Patent US 10,007,482
Granted Patent B2
US 10,007,482 · App. 15/266,555 · Granted Jun 26, 2018

Method and system for voice chat in virtual environment

Inventor: Ingo Nadler (Bad Breisig, DE)
Assignee: Hashplay Inc.
G06F3/165G06T13/205G06N3/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,007,482
App. No.
15/266,555
Granted
Jun 26, 2018
Kind
B2
Abstract

A method for voice chat in a virtual environment includes receiving a plurality of audio streams corresponding to a plurality of avatars in the virtual environment, determining relative distances between the avatars in the virtual environment, calculating change in volumes of the audio streams, depending on the determined relative distances between the avatars, normalizing volumes of the audio streams depending on the calculated change in volumes, mixing the normalized audio streams to create a plurality of mixed audio streams, wherein one mixed audio stream corresponds to one avatar, and relaying the mixed audio streams to corresponding avatars.

Claims (51)

1. A method for voice chat in a virtual environment, the method comprising:

receiving a plurality of audio streams corresponding to a plurality of avatars in the virtual environment, wherein the virtual environment comprises a first location and a second location spaced apart from the first location by a predetermined distance, and each of the first and second locations includes at least one avatar;

calculating change in volumes of the audio streams, depending on the predetermined distance between the first and second locations;

mixing audio streams of the at least one avatar present in the first location to create a first audio stream;

mixing audio streams of the at least one avatar present in the second location to create a second audio stream;

normalising volumes of the first and second audio streams depending on the predetermined distance between the first and second locations;

mixing the normalised audio streams to create a first and a second mixed audio streams; and

relaying the first and second mixed audio streams to the at least one avatar at corresponding locations.

2. A method according to claim 1 , wherein the predetermined distance between the first and second location is a length of a shortest route between the first and second location in the virtual environment.

3. A method according to claim 1 , wherein calculating change in volumes of the audio streams comprises use of a mathematical function.

4. A method according to claim 3 , wherein the mathematical function is at least one of a linear function, an exponential function and a logarithmic function.

5. A method according to claim 1 , wherein change in volumes of the audio streams comprises reduction in volume and increase in volume.

6. A method according to claim 1 , wherein the method further comprises adding environmental cues to the mixed audio streams.

7. A method according to claim 6 , wherein the environmental cues comprises auditory cues.

8. The method of claim 1 further comprising:

receiving an audio stream corresponding to each of the avatars in the virtual environment; and

relaying an audio stream to a user device, the audio stream comprising audio streams of avatars other than an avatar associated with the user device.

9. A method for voice chat in a virtual environment, the method comprising:

receiving a plurality of audio streams corresponding to a plurality of avatars in the virtual environment;

determining relative distances between the avatars in the virtual environment;

calculating change in volumes of the audio streams, depending on the determined relative distances between the avatars;

normalising volumes of the audio streams depending on the calculated change in volumes;

mixing the normalised audio streams to create a plurality of mixed audio streams, wherein one mixed audio stream corresponds to one avatar; and

relaying the mixed audio streams to the corresponding avatars;

the method further comprising:

analysing the received plurality of audio streams to derive lip-sync information corresponding to the plurality of avatars;

adding the derived lip-sync information to the mixed audio streams; and

changing lip movements of the plurality of avatars depending on the added lip-sync information.

10. A method according to claim 9 , wherein the lip-sync information comprises phonemes.

11. A method according to claim 9 , wherein analysing the received audio streams to derive lip-sync information comprises implementing Fourier analysis algorithms to determine phonemes corresponding to the received audio streams.

12. A method according to claim 11 , wherein the Fourier analysis algorithms are Fast Fourier analysis algorithms.

13. The method of claim 9 , further comprising:

receiving an audio stream corresponding to each of the avatars in the virtual environment; and

relaying an audio stream to a user device, the audio stream comprising audio streams of avatars other than an avatar associated with the user device.

14. A system for voice chat in a virtual environment, the system comprising:

a plurality of user devices associated with a plurality of users, wherein one user device is associated with one user being represented by an avatar in a first location in the virtual environment, and another user being represented by an avatar in a second location in the virtual environment;

a server communicably coupled to the plurality of user devices, wherein the server comprises a voice chat engine operable to:

receive a plurality of audio streams corresponding to the avatars in the virtual environment;

determine relative distances between the first and second locations in the virtual environment;

calculate change in volumes of the audio streams, depending on the determined relative distances between the first and second locations;

mix audio streams of the at least one avatar present in the first location to create a first audio stream;

mix audio streams of the at least one avatar present in the second location to create a second audio stream;

normalise volumes of the first and second audio streams depending on the predetermined distance between the first and second locations;

mix the normalised audio streams to create a first and a second mixed audio streams; and

relay the first and second mixed audio streams to the avatar at each corresponding location.

15. A system according to claim 14 , wherein the server further comprises a database configured to store physical and spatial information of the avatars.

16. A system according to claim 15 , wherein the physical information of the avatars comprises physical attributes of the avatars.

17. A system according to claim 15 , wherein the spatial information of the avatars comprises position coordinates of the avatars in the virtual environment.

18. The system according to claim 14 , wherein the voice chat engine of the server is operable to:

receive an audio stream corresponding to each of the avatars in the virtual environment;

relaying an audio stream to a user device, the audio stream comprising audio streams of avatars other than an avatar associated with the user device.

Assignments (2)
CHANGE OF NAME Recorded Jan 19, 2021
From: HASHPLAY INC.
To: DARVIS, INC.
Reel/Frame 055029/0660 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 20, 2017
From: NADLER, INGO
To: HASHPLAY INC.
Reel/Frame 041028/0102 →
Continuity (2)
Provisional Application 62219154 · Sep 16, 2015
Related Publication 20170123752A1 · May 4, 2017