IP Library Granted Patent US 11,611,826
Granted Patent B1
US 11,611,826 · App. 17/584,326 · Granted Mar 21, 2023

Customized sound field for increased privacy

Inventors: Antonio John Miller (Woodinville, WA); Jacob Ryan Donley (Kirkland, WA); Scott Porter (Woodinville, WA)
Assignee: Meta Platforms Technologies, LLC
H04R3/005G10L25/78H04R1/1041H04R1/403H04R1/406H04S7/303H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,611,826
App. No.
17/584,326
Granted
Mar 21, 2023
Kind
B1
Abstract

An audio system for customizing sound fields for increased user privacy. A microphone array of a headset detects sounds from one or more sound sources in a local area of the headset. The audio system estimates array transfer functions (ATFs) associated with the sounds, and determines determining sound field reproduction filters for a loudspeaker array of the headset using the ATFs. The audio system presents audio content, via the loudspeaker array, based in part on the sound field reproduction filters. The presented audio content has a sound field that has a reduced amplitude in a first damped region of the local area that includes a first sound source of the one or more sound sources.

Claims (44)

1. A method comprising:

determining sound field reproduction filters for a loudspeaker array, wherein the loudspeaker array includes a plurality of acoustic emission locations and each acoustic emission location is substantially collocated with a corresponding acoustic detection location; and

providing the sound field reproduction filters to the loudspeaker array, wherein audio content presented according to the sound field reproduction filters has a sound field that has a reduced amplitude in a first damped region of a local area.

2. The method of claim 1 , further comprising:

classifying sound source types in a local area of a loudspeaker array; and

wherein determining the sound field reproduction filters is based on the sound source types.

3. The method of claim 1 , wherein determining the sound field reproduction filters for the loudspeaker array comprises:

estimating array transfer functions (ATFs) for one or more sound sources in a local area of the loudspeaker array; and

applying an optimization algorithm to the ATFs, the optimization algorithm subject to one or more constraints.

4. The method of claim 3 , wherein a constraint of the one or more constraints is that the audio content is provided to ears of a user.

5. The method of claim 3 , wherein the optimization algorithm also uses a relative location of the one or more sound sources to the loudspeaker array to determine the sound field reproduction filters.

6. The method of claim 3 , further comprising:

classifying the ATFs based on predicted types of the one or more sound sources as human type or non-human type, and

wherein the classification of each of the ATFs is a constraint of the one or more constraints.

7. The method of claim 6 , wherein applying the optimization algorithm to the ATFs is such that an energy of a sum energies of the ATFs classified as human type is minimized.

8. The method of claim 6 , wherein a first sound source is classified as a human type and the one or more sound sources also includes a second sound source that is classified as non-human type, and the sound field reproduction filters are such that the sound field that has a first amplitude in the first damped region of the local area that includes the first sound source and a second amplitude in a second damped region of the local area that includes the second sound source.

9. The method of claim 1 , further comprising:

detecting a first set of sounds in the local area over a first time period;

detecting additional sounds over a second time period subsequent to the first time period;

estimating ATFs associated with the additional sounds, the ATFs indicating a change in a location of a first sound source from the first time period to the second time period;

updating the sound field reproduction filters for the loudspeaker array using the ATFs; and

providing the updated sound field reproduction filters to the loudspeaker array, wherein audio content presented according to the updated sound field reproduction filters has a sound field that has a reduced amplitude in a second damped region of the local area that includes the first sound source.

10. The method of claim 9 , wherein a location of the first sound source is the same in the first time period and the second time period, and a location of the loudspeaker array changes from the first time period to the second time period.

11. The method of claim 9 , wherein a location of the loudspeaker array is the same in the first time period and the second time period, and a location of the first sound source changes from the first time period to the second time period.

12. The method of claim 1 , wherein substantially collocated refers to each acoustic detection location being less than a quarter wavelength away from the corresponding acoustic emission location.

13. The method of claim 1 , wherein an acoustic emission location is a port in a frame of a headset, the port providing an outcoupling point of sound from an acoustic waveguide that separates a speaker of the loudspeaker array from the port, wherein sound emitted from the speaker travels through the acoustic waveguide and is then emitted by the port into the local area.

14. A non-transitory computer-readable storage medium comprising stored instructions, the instructions when executed by a processor of a device, cause the device to:

determine sound field reproduction filters for a loudspeaker array, wherein the loudspeaker array includes a plurality of acoustic emission locations and each acoustic emission location is substantially collocated with a corresponding acoustic detection location; and

provide the sound field reproduction filters to the loudspeaker array, wherein audio content presented according to the sound field reproduction filters has a sound field that has a reduced amplitude in a first damped region of a local area.

15. The storage medium of claim 14 , wherein the stored instructions to determine the sound field reproduction filters for the loudspeaker array further comprises stored instructions that when executed cause the device to:

estimate array transfer functions (ATFs) for one or more sound sources in the local area; and

apply an optimization algorithm to the ATFs, the optimization algorithm subject to one or more constraints.

16. The storage medium of claim 15 , wherein the optimization algorithm also uses a relative location of the one or more sound sources to the loudspeaker array to determine the sound field reproduction filters.

17. The storage medium of claim 15 , further comprising stored instructions that when executed cause the device to:

classify the ATFs based on predicted types of the one or more sound sources as human type or non-human type, and

wherein the classification of each of the ATFs is a constraint of the one or more constraints.

18. The storage medium of claim 17 , wherein a first sound source is classified as a human type and the one or more sound sources also includes a second sound source that is classified as non-human type, and the sound field reproduction filters are such that the sound field that has a first amplitude in the first damped region of the local area that includes the first sound source and a second amplitude in a second damped region of the local area that includes the second sound source.

19. The storage medium of claim 14 , further comprising stored instructions that when executed cause the device to:

detect a first set of sounds in the local area over a first time period;

detect additional sounds over a second time period subsequent to the first time period;

estimate ATFs associated with the additional sounds, the ATFs indicating a change in a location of a first sound source from the first time period to the second time period;

update the sound field reproduction filters for the loudspeaker array using the ATFs; and

provide the updated sound field reproduction filters to the loudspeaker array, wherein audio content presented according to the updated sound field reproduction filters has a sound field that has a reduced amplitude in a second damped region of the local area that includes the first sound source.

20. The storage medium of claim 14 , wherein an acoustic emission location is a port in a frame of a headset, the port providing an outcoupling point of sound from an acoustic waveguide that separates a speaker of the loudspeaker array from the port, wherein sound emitted from the speaker travels through the acoustic waveguide.

Assignments (1)
CHANGE OF NAME Recorded Jun 8, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060314/0965 →
Continuity (3)
Continuation 17119327 · Dec 11, 2020
Continuation 16867406 · May 5, 2020
Continuation 16221864 · Dec 17, 2018