IP Library Granted Patent US 11,564,038
Granted Patent B1
US 11,564,038 · App. 17/206,594 · Granted Jan 24, 2023

Spherical harmonic decomposition of a sound field detected by an equatorial acoustic sensor array

Inventors: Jens Ahrens (Gothenburg, SE); Hannes Helmholz (Gothenburg, SE); David Lou Alon (Arugot, IL); Sebastià Vicenç Amengual Garí (Seattle, WA)
Assignee: Meta Platforms Technologies, LLC
H04R5/027H04R3/005H04R5/033H04R5/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,564,038
App. No.
17/206,594
Granted
Jan 24, 2023
Kind
B1
Abstract

An audio system includes an equatorial acoustic sensor array (EASA) that may be coupled to an object. The audio system is configured to detect, via the EASA, signals corresponding to a portion of a sound field in a local area. The detected signals are converted into a plurality of corresponding abstract representations that describe the portion of the sound field. Effects of scattering of the object are removed from the abstract representations to create adjusted abstract representations. A set of spherical harmonic (SH) coefficients is determined using the adjusted abstract representations. The set of SH coefficients describe an entirety of the sound field. And the set of SH coefficients and head related transfer functions of a user are used for binaural rendering of the reconstructed sound field to the user.

Claims (34)

1. A method comprising:

detecting, via an equatorial acoustic sensor array (EASA) of a headset coupled to an object, signals corresponding to a portion of a sound field in a local area;

determining a set of circular harmonic (CH) coefficients using the detected signals that describe in part the portion of the sound field;

removing effects of scattering of the object from the set of CH coefficients to create an adjusted representation of the portion of the sound field; and

determining a set of spherical harmonic (SH) coefficients using the adjusted representation of the portion of the sound field, the set of SH coefficients describing an entirety of the sound field,

wherein the set of SH coefficients and head related transfer functions of a user are used for binaural rendering of the reconstructed sound field to the user.

2. The method of claim 1 , further comprising:

providing the set of SH coefficients to another headset associated with the user.

3. The method of claim 1 , wherein acoustic sensors in the EASA are positioned relative to a center point such that the EASA has a non-circular arrangement.

4. The method of claim 1 , wherein the object is a head of the user.

5. The method of claim 1 , wherein the object is a spherical scatterer.

6. The method of claim 1 , wherein the EASA includes a plurality of acoustic sensors that are arranged in a same plane and circumscribe the object.

7. The method of claim 1 , wherein removing effects of scattering of the object from the set of CH coefficients to create the adjusted representation of the portion of the sound field is performed irrespective of distances between the EASA and sound sources generating the sound field.

8. An audio system comprising:

an equatorial microphone array (EASA) that is part of a headset configured to be coupled to an object, and detect signals corresponding to a portion of a sound field in a local area;

a controller configured to:

determine a set of circular harmonic (CH) coefficients using the detected signals that describe in part the portion of the sound field;

remove effects of scattering of the object from the set of CH coefficients to create an adjusted representation of the portion of the sound field; and

determine a set of spherical harmonic (SH) coefficients using the adjusted representation of the portion of the sound field, the set of SH coefficients describing an entirety of the sound field,

wherein the set of SH coefficients and head related transfer functions of a user are used for binaural rendering of the reconstructed sound field to the user.

9. The audio system of claim 8 , further comprising:

a transmitter configured to provide the set of SH coefficients to another headset associated with the user.

10. The audio system of claim 8 , wherein acoustic sensors in the EASA are positioned relative to a center point such that the EASA has a non-circular arrangement.

11. The audio system of claim 8 , wherein the object is a head of the user.

12. The audio system of claim 8 , wherein the object is a spherical scatterer.

13. The audio system of claim 8 , wherein the EASA includes a plurality of acoustic sensors that are arranged in a same plane and circumscribe the object.

14. The audio system of claim 8 , wherein the EASA includes at most 25 acoustic sensors.

15. The audio system of claim 8 , wherein the sound field is generated by a plurality of sound sources, and at least some of the plurality of sound sources are at different distances from the EASA.

16. A non-transitory computer readable medium configured to store program code instructions, when executed by a processor, cause the processor to perform steps comprising:

receiving, from an equatorial microphone array (EASA) that is part of a headset coupled to an object, signals corresponding to a portion of a sound field in a local area;

determining a set of circular harmonic (CH) coefficients using the detected signals that describe in part the portion of the sound field;

removing effects of scattering of the object from the set of CH coefficients to create an adjusted representation of the portion of the sound field; and

determining a set of spherical harmonic (SH) coefficients using the adjusted representation of the portion of the sound field, the set of SH coefficients describing an entirety of the sound field,

wherein the set of SH coefficients and head related transfer functions of a user are used for binaural rendering of the reconstructed sound field to the user.

Assignments (2)
CHANGE OF NAME Recorded Jun 8, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060314/0965 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 25, 2021
From: AHRENS, JENS; HELMHOLZ, HANNES; ALON, DAVID LOU; AMENGUAL GARI, SEBASTIÀ VICENÇ
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 055712/0777 →
Continuity (1)
Provisional Application 63148535 · Feb 11, 2021
Cited By (1)
US 12,548,548