IP Library Granted Patent US 11,102,603
Granted Patent B2
US 11,102,603 · App. 16/423,927 · Granted Aug 24, 2021

Determination of material acoustic parameters to facilitate presentation of audio content

Inventor: Carl Schissler (Redmond, WA)
Assignee: Facebook Technologies, LLC
H04S7/304H04R5/033H04R5/04H04S3/008H04S2400/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,102,603
App. No.
16/423,927
Granted
Aug 24, 2021
Kind
B2
Abstract

Determination of material acoustic parameters for a headset is presented herein. A value of a material acoustic parameter is initialized. A simulation is performed using the value of the material acoustic parameter and a model. The model includes a three-dimensional representation of a local area occupied by the headset. During the simulation, the value of the material acoustic parameter is dynamically modified until a reverberation time calculated based on the modified value of the material acoustic parameter falls within a threshold value of a target reverberation time. The model is updated with the modified value of the material acoustic parameter. The model is used to determine one or more acoustic parameters. Audio content is rendered based on the one or more acoustic parameters so that the audio content appears originating from an object in the local area.

Claims (43)

1. A method comprising:

initializing a value of a material acoustic parameter describing a portion of a local area based on a model that comprises a three-dimensional (3D) virtual representation describing a plurality of surfaces in the portion of the local area, wherein initializing the value of the material acoustic parameter comprises:

assigning a same value of the material acoustic parameter to each of the plurality of surfaces described in the 3D virtual representation, the plurality of surfaces having different materials;

performing a simulation that calculates reverberation time based on the model and the initialized value of the material acoustic parameter of each of the plurality of surfaces, the simulation dynamically modifying the value of the material acoustic parameter of each of the plurality of surfaces to a modified value of the material acoustic parameter until a simulated reverberation time calculated using the modified value of the material acoustic parameter is within a threshold value of a target reverberation time, the simulation comprising a sequence of iterations, wherein each respective iteration in the sequence comprises a change in the value of the material acoustic parameter of at least one of the plurality of surfaces in each iteration and the change in the value of the material acoustic parameter is smaller than a change in the value of the material acoustic parameter in a previous iteration in the sequence; and

updating the model based on the modified value of the material acoustic parameter of each of the plurality of surfaces that causes the simulated reverberation time to be within the threshold value of the target reverberation time, wherein the updated model is used to render audio content presented by a headset.

2. The method of claim 1 , further comprising:

receiving, from the headset, visual information of at least the portion of the local area; and

developing the 3D virtual representation based on the visual information.

3. The method of claim 2 , further comprising:

receiving a query from the headset, the query comprising virtual information and location information of the headset;

determining one or more acoustic parameters based on the query and the updated model; and

transmitting the one or more acoustic parameters to the headset.

4. The method of claim 1 , wherein the material acoustic parameter describes an acoustic property of a material of a surface within the local area.

5. The method of claim 4 , wherein the material acoustic parameter is acoustic absorption coefficient, acoustic scattering coefficient, or a combination thereof.

6. The method of claim 1 , further comprising:

receiving a plurality of reverberation times of the local area from the headset; and

determining the target reverberation time based on the plurality of reverberation times.

7. The method of claim 6 , wherein determining the target reverberation time based on the plurality of reverberation times comprises:

determining a weight of each of the plurality of reverberation times; and

determining a weighted average of the plurality of reverberation times.

8. The method of claim 1 , wherein the local area is a conference room, a bathroom, a hallway, an office, a bedroom, a dining room, a living room, or some combination thereof.

9. An apparatus comprising:

an initializing module configured to initialize a value of a material acoustic parameter describing a portion of a local area based on a model that comprises a three-dimensional (3D) virtual representation describing a plurality of surfaces in the portion of the local area, wherein the initializing module is configured to initialize the value of the material acoustic parameter by:

assigning a same value of the material acoustic parameter to each of the plurality of surfaces described in the 3D virtual representation, the plurality of surfaces having different materials; and

an acoustic simulation module configured to:

perform a simulation that calculates reverberation time based on the model and the initialized value of the material acoustic parameter of each of the plurality of surfaces, the simulation dynamically modifying the value of the material acoustic parameter of each of the plurality of surfaces to a modified value of the material acoustic parameter until a simulated reverberation time calculated using the modified value of the material acoustic parameter is within a threshold value of a target reverberation time, the simulation comprising a sequence of iterations, wherein each respective iteration in the sequence comprises a change in the value of the material acoustic parameter of at least one of the plurality of surfaces in each iteration and the change in the value of the material acoustic parameter is smaller than a change in the value of the material acoustic parameter in a previous iteration in the sequence, and

update the model based on the modified value of the material acoustic parameter of each of the plurality of surfaces that causes the simulated reverberation time to be within the threshold value of the target reverberation time, wherein the updated model is used to render audio content presented by a headset.

10. The apparatus of claim 9 , wherein the apparatus is configured to receive, from the headset, visual information of at least the portion of the local area, and the initializing module is further configured to develop the 3D virtual representation based on the visual information.

11. The apparatus of claim 9 , wherein the material acoustic parameter describes an acoustic property of a material of a surface within the local area.

12. The apparatus of claim 9 , wherein the target reverberation time is determined based on one or more reverberation times measured by the headset.

13. A non-transitory computer-readable storage medium having instructions encoded thereon that, when executed by a processor, cause the processor to:

initialize a value of a material acoustic parameter describing a portion of a local area based on a model that comprises a three-dimensional (3D) virtual representation describing a plurality of surfaces in the portion of the local area, wherein the instructions for initializing the value of the material acoustic parameter comprise instructions, when executed by the processor, cause the processor to:

assign a same value of the material acoustic parameter to each of the plurality of surfaces described in the 3D virtual representation, the plurality of surfaces having different materials;

perform a simulation that calculates reverberation time based on the model and the initialized value of the material acoustic parameter of each of the plurality of surfaces, the simulation dynamically modifying the value of the material acoustic parameter of each of the plurality of surfaces to a modified value of the material acoustic parameter until a simulated reverberation time calculated using the modified value of the material acoustic parameter is within a threshold value of a target reverberation time, the simulation comprising a sequence of iterations, wherein each respective iteration in the sequence comprises a change in the value of the material acoustic parameter of at least one of the plurality of surfaces in each iteration and the change in the value of the material acoustic parameter is smaller than a change in the value of the material acoustic parameter in a previous iteration in the sequence; and

update the model based on the modified value of the material acoustic parameter of each of the plurality of surfaces that causes the simulated reverberation time to be within the threshold value of the target reverberation time, wherein the updated model is used to render audio content presented by a headset.

14. The computer readable medium of claim 13 , wherein the instructions further cause the processor to:

receive, from the headset, visual information of at least the portion of the local area; and

develop the 3D virtual representation based on the visual information.

15. The computer readable medium of claim 14 , wherein the instructions further cause the processor to:

receive a query from the headset, the query comprising virtual information and location information of the headset;

determining one or more acoustic parameters based on the query and the updated model; and

transmit the one or more acoustic parameters to the headset.

16. The computer readable medium of claim 13 , wherein the target reverberation time is determined based on one or more reverberation times measured by the headset.

Assignments (2)
CHANGE OF NAME Recorded Jun 8, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060315/0224 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 31, 2019
From: SCHISSLER, CARL
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 049329/0309 →
Continuity (1)
Related Publication 20200382895A1 · Dec 3, 2020