IP Library Granted Patent US 11,758,347
Granted Patent B1
US 11,758,347 · App. 17/377,727 · Granted Sep 12, 2023

Dynamic speech directivity reproduction

Inventor: Philip Robinson (Seattle, WA)
Assignee: Meta Platforms Technologies, LLC
H04S7/303G10L21/0232H04S7/305G10L2021/02082H04S2400/11H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,758,347
App. No.
17/377,727
Filed
Jul 16, 2021
Granted
Sep 12, 2023
Kind
B1
Art Unit
2653
USPC
381/303
Abstract

The disclosed computer-implemented method may include capturing, via a headset microphone of a speaker's artificial reality device, voice input of a speaker in communication with a listener in an artificial reality environment. The method may include detecting a pose of the speaker within the artificial reality environment and determining a position of the speaker relative to a position of the listener within the artificial reality environment. The method may further include processing, based on the pose and the relative position of the speaker within the artificial reality environment, the voice input to create a directivity-attuned voice signal for the listener, and delivering the directivity-attuned voice signal to an artificial reality device of the listener. Various other methods, systems, and computer-readable media are also disclosed.

Claims (64)

1. A method comprising:

capturing, via a headset microphone of a speaker's artificial reality device, voice input of a speaker in communication with a listener in an artificial reality environment;

determining a directivity profile for the speaker;

determining, based on the directivity profile, a directivity pattern for the voice input corresponding to the speaker's presence within the artificial reality environment;

processing, using the directivity pattern, the voice input to create a directivity-attuned voice signal for the listener; and

delivering the directivity-attuned voice signal to an artificial reality device of the listener.

2. The method of claim 1 , further comprising:

determining one or more avatar characteristics corresponding to the speaker;

wherein processing the voice input further comprises changing, for the directivity-attuned voice signal, the voice input to conform with the one or more avatar characteristics.

3. The method of claim 1 , further comprising:

detecting a pose of the speaker within the artificial reality environment; and

determining a position of the speaker relative to a position of the listener within the artificial reality environment;

wherein processing the voice input is further based on the pose and the relative position of the speaker within the artificial reality environment.

4. The method of claim 1 , wherein the directivity profile is determined based on a content of the voice input such that the directivity-attuned voice signal is created in a manner that accounts for the content of the voice input.

5. The method of claim 1 , wherein the directivity profile is determined based on at least one of a gender of the speaker, a physical characteristic of the speaker, a voice frequency range of the speaker, or a headset size of the speaker such that the directivity-attuned voice signal is created in a manner that accounts for the gender of the speaker, the physical characteristic of the speaker, the voice frequency range of the speaker, or the headset size of the speaker.

6. The method of claim 1 , wherein creating the directivity-attuned voice signal further comprises:

identifying, in the voice input, reverberation from a real-world environment of the speaker; and

removing, from the voice input, at least a portion of the reverberation.

7. The method of claim 1 , wherein creating the directivity-attuned voice signal further comprises:

identifying a reverberant property of an artificial reality environment of the listener; and

adding, to the voice input, reverberation based on the reverberant property of the artificial reality environment of the listener.

8. A system comprising:

at least one physical processor;

physical memory comprising computer-executable instructions that, when executed by the physical processor, cause the physical processor to:

capture, via a headset microphone of a speaker's artificial reality device, voice input of a speaker in communication with a listener in an artificial reality environment;

determine a directivity profile for the speaker;

determine, based on the directivity profile, a directivity pattern for the voice input corresponding to the speaker's presence within the artificial reality environment;

process, using the directivity pattern, the voice input to create a directivity-attuned voice signal for the listener; and

deliver the directivity-attuned voice signal to an artificial reality device of the listener.

9. The system of claim 8 , wherein the instructions further comprise instructions for:

determining one or more avatar characteristics corresponding to the speaker;

wherein processing the voice input further comprises changing, for the directivity-attuned voice signal, the voice input to conform with the one or more avatar characteristics.

10. The system of claim 8 , wherein the instructions further comprise instructions for:

detecting a pose of the speaker within the artificial reality environment; and

determining a position of the speaker relative to a position of the listener within the artificial reality environment;

wherein processing the voice input is further based on the pose and the relative position of the speaker within the artificial reality environment.

11. The system of claim 8 , wherein the directivity profile is determined based on a content of the voice input such that the directivity-attuned voice signal is created in a manner that accounts for the content of the voice input.

12. The system of claim 8 , wherein the directivity profile is determined based on at least one of a gender of the speaker, a physical characteristic of the speaker, a voice frequency range of the speaker, or a headset size of the speaker such that the directivity-attuned voice signal is created in a manner that accounts for the gender of the speaker, the physical characteristic of the speaker, the voice frequency range of the speaker, or the headset size of the speaker.

13. The system of claim 8 , wherein creating the directivity-attuned voice signal further comprises:

identifying, in the voice input, reverberation from a real-world environment of the speaker; and

removing, from the voice input, at least a portion of the reverberation.

14. The system of claim 8 , wherein creating the directivity-attuned voice signal further comprises:

identifying a reverberant property of an artificial reality environment of the listener; and

adding, to the voice input, reverberation based on the reverberant property of the artificial reality environment of the listener.

15. A non-transitory computer-readable medium comprising one or more computer-executable instructions that, when executed by at least one processor of a computing device, cause the computing device to:

capture, via a headset microphone of a speaker's artificial reality device, voice input of a speaker in communication with a listener in an artificial reality environment;

determine a directivity profile for the speaker;

determine, based on the directivity profile, a directivity pattern for the voice input corresponding to the speaker's presence within the artificial reality environment;

process, using the directivity pattern, the voice input to create a directivity-attuned voice signal for the listener; and

deliver the directivity-attuned voice signal to an artificial reality device of the listener.

16. The computer-readable medium of claim 15 , wherein the instructions further comprise instructions for:

determining one or more avatar characteristics corresponding to the speaker;

wherein processing the voice input further comprises changing, for the directivity-attuned voice signal, the voice input to conform with the one or more avatar characteristics.

17. The computer-readable medium of claim 15 , wherein the instructions further comprise instructions for:

detecting a pose of the speaker within the artificial reality environment; and

determining a position of the speaker relative to a position of the listener within the artificial reality environment;

wherein processing the voice input is further based on the pose and the relative position of the speaker within the artificial reality environment.

18. The computer-readable medium of claim 15 , wherein the directivity profile is determined based on a content of the voice input such that the directivity-attuned voice signal is created in a manner that accounts for the content of the voice input.

19. The computer-readable medium of claim 15 , wherein creating the directivity-attuned voice signal further comprises:

identifying, in the voice input, reverberation from a real-world environment of the speaker; and

removing, from the voice input, at least a portion of the reverberation.

20. The computer-readable medium of claim 15 , wherein creating the directivity-attuned voice signal further comprises:

identifying a reverberant property of an artificial reality environment of the listener; and

adding, to the voice input, reverberation based on the reverberant property of the artificial reality environment of the listener.

Assignments (2)
CHANGE OF NAME Recorded May 27, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060203/0228 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 17, 2021
From: ROBINSON, PHILIP
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 057201/0576 →
Continuity (1)
Continuation 16672549 · Nov 4, 2019
Cited By (1)
US 12,696,045