IP Library Granted Patent US 11,462,230
Granted Patent B1
US 11,462,230 · App. 17/248,797 · Granted Oct 4, 2022

System for filtering mechanical coupling from a microphone signal

Inventors: Sebastian Sztuk (Menlo Park, CA); Tony David (San Jose, CA); Andrew Lovitt (Redmond, WA)
Assignee: Meta Platforms Technologies, LLC
G10L21/0232G10L15/18G10L15/20G10L15/22H04R1/08H04R29/004G10L2015/223G10L2021/02082
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,462,230
App. No.
17/248,797
Granted
Oct 4, 2022
Kind
B1
Abstract

An audio system that includes an IMU or accelerometer in physical proximity to a microphone and a driver. The signal generated by the IMU or accelerometer may be used to filter the audio signal generated by the microphone with respect to mechanically coupling between the driver outputting sound and the microphone via a shared structure. In some cases, an accelerometer may be incorporated into a package of the microphone to provide analog-based filtering prior to converting the audio signal of the microphone to a digital format.

Claims (56)

1. A system comprising:

a microphone to generate microphone audio data, the microphone associated with a structure;

a measurement unit to generate mechanical vibration data, the measurement unit associated with the structure and less than or equal to a predetermined distance from the microphone, the predetermined distance based at least in part on a transfer function;

a first component to subtract the mechanical vibration data from the microphone audio data; and

a digital to analog converter to convert the microphone audio data into digital microphone audio data and send the digital microphone audio data to an acoustic cancelation component.

2. The system of claim 1 , wherein the microphone and the measurement unit are associated with a shared package.

3. The system of claim 1 , wherein the measurement unit is at least one of:

an inertial measurement unit (IMU);

a contact microphone;

an accelerometer; or

a gyroscope.

4. The system of claim 1 , further comprising a driver associated with the structure, the driver to output sound into an environment based on acoustic output data, and wherein the mechanical vibration data represents data associated with mechanical coupling between the driver and the microphone.

5. The system of claim 1 , wherein the acoustic echo cancelation component is configured to filter the digital microphone audio data based at least in part on the acoustic output data.

6. The system of claim 4 , wherein the driver, the microphone, and the measurement unit are associated with a shared substrate.

7. The system of claim 1 , wherein the first component is an operational amplifier configured to subtract the mechanical vibration data from the microphone audio data.

8. A method comprising:

receiving, from a microphone associated with a substrate, microphone audio data;

receiving, from a measurement unit, mechanical vibration data, the measurement unit positioned on the substrate within a predetermined distance of the microphone, the predetermined distance based at least in part on a transfer function;

filtering the microphone audio data based at least in part on the mechanical vibration data;

applying natural language processing to the microphone audio data to detect a user command;

determining a pose based at least in part on the mechanical vibration data; and

causing an operation to execute based at least in part on the pose and the command.

9. The method of claim 8 , further comprising:

receiving acoustic output data, the acoustic output data being output as sound by a driver; and

filtering the microphone audio data based at least in part on the acoustic output data prior to detecting the command.

10. The method of claim 9 , further comprising:

receiving environmental audio data from an external microphone;

generating a noise cancelation signal based at least in part on the environmental audio data and the microphone audio data; and

causing the driver to output the noise cancelation signal.

11. The method of claim 8 , wherein the transfer function is determined based at least in part on at least one of:

a material of a device associated with the microphone and the measurement unit;

a distance between the microphone and the accelerometer; or

a relative position on the device between the microphone and the accelerometer.

12. The method of claim 8 , wherein a driver outputting the acoustic output data is less than an acoustical transmission threshold from the microphone.

13. The method of claim 8 , wherein the microphone and the measurement unit are associated with a shared package.

14. The method of claim 8 , wherein filtering the microphone audio data based at least in part on the mechanical vibration data further comprises subtracting the mechanical vibration data from the microphone audio data.

15. The method of claim 8 ,

wherein the pose is a six degree of freedom pose of a structure including the substrate.

16. One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

receiving acoustic output data, the acoustic output data being output as sound by a driver;

receiving, from a microphone associated with a substrate, microphone audio data;

receiving, from a measurement unit, mechanical vibration data, the measurement unit positioned on the substrate within a predetermined distance of the microphone, the predetermined distance based at least in part on a predetermined transfer function;

filtering the microphone audio data based at least in part on the mechanical vibration data;

filtering the microphone audio data based at least in part on the acoustic output data;

detecting a command within the microphone audio data; and

causing an operation to execute with respect to the command.

17. The one or more computer-readable media of claim 16 , wherein filtering the microphone audio data is based at least in part on a transfer function between the microphone and the measurement unit.

18. The one or more computer-readable media of claim 16 , wherein the measurement unit is at least one of:

an inertial measurement unit (IMU);

a contact microphone;

an accelerometer, or

a gyroscope.

19. The one or more computer-readable media of claim 16 , wherein the operations further comprise determine a pose of the system based at least in part on the mechanical vibration data and wherein the command is based at least in part on the pose and the microphone audio data.

20. The system of claim 1 , further comprising:

a second component to determine a six degree of freedom pose of the system based at least in part on the mechanical vibration data; and

a third component to determine a command based at least in part on the mechanical vibration data and the digital microphone audio data.

Assignments (2)
CHANGE OF NAME Recorded Jul 12, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060635/0291 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 17, 2021
From: SZTUK, SEBASTIAN; DAVID, TONY; LOVITT, ANDREW
To: FACEBOOK TECHNOLOGIES, LLC.
Reel/Frame 055291/0134 →
Cited By (1)
US 12,340,785