IP Library Granted Patent US 11,778,361
Granted Patent B1
US 11,778,361 · App. 17/184,063 · Granted Oct 3, 2023

Headset activation validation based on audio data

Inventor: Andrew Lovitt (Redmond, WA)
Assignee: Meta Platforms Technologies, LLC
H04R1/1041G06F1/325G10L15/08G10L15/28G10L25/90G02B27/0176G06F1/3215G10L25/21G10L25/48G10L2015/088H04W52/0254
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,778,361
App. No.
17/184,063
Granted
Oct 3, 2023
Kind
B1
Abstract

Validation of an activation event of a device based on analyzing audio data is disclosed. The device detects an activation event, e.g., an input to a soft-touch button or a wake word detected by a microphone array. Responsive to detecting the activation event, the device captures, via a microphone array on the device, sound from a local area of the device. The device stores the captured sound as audio data in an audio buffer. The device performs a validation of the activation event by analyzing the captured sound. The device performs an action based on a result of the validation.

Claims (54)

1. A method comprising:

detecting an activation event on a device;

responsive to detecting the activation event:

starting supply of a power to a microphone array on the device;

capturing, via the microphone array on the device over a plurality of time periods, sound from a local area of the device;

storing each portion of the sound captured during a respective time period of the plurality of time period as respective audio data in a buffer;

performing a respective validation of a plurality of iterative validations of the activation event by analyzing the respective audio data stored in the buffer; and

performing an action based on a result of the plurality of iterative validations, the action comprises stopping supply of the power to the microphone array when a result of each validation of the plurality of iterative validations is an invalid activation state.

2. The method of claim 1 , wherein the activation event is a press of a soft-touch button on the device.

3. The method of claim 1 , wherein the action further comprises switching the device into a high-power state from a low-power state when the result of the plurality of iterative validations is a valid activation state.

4. The method of claim 3 , further comprising:

transmitting the respective audio data stored in the buffer to a second device when the result of the plurality of iterative validations is the valid activation state.

5. The method of claim 1 , further comprising:

responsive to detecting the activation event on the device, switching the device into a high-power state from a low-power state, wherein a first power is supplied to the microphone array in the low-power state, a second power is supplied to the microphone array in the high-power state, and the first power is lower than the second power.

6. The method of claim 1 , wherein performing the plurality of iterative validations of the activation event by analyzing the captured sound comprises:

determining a proximity of the device to a user of the device based on the captured sound; and

determining the result of the plurality of iterative validations based in part on the determined proximity.

7. The method of claim 6 , wherein determining the proximity of the device to the user comprises:

identifying a portion of the captured sound as speech generated by the user; and

analyzing an intensity of the speech to estimate the proximity of the device to the user.

8. The method of claim 1 , wherein performing the plurality of iterative validations of the activation event by analyzing the captured sound comprises:

determining a movement of the device relative to a user of the device based on the captured sound; and

determining the result of the plurality of iterative validations based in part on the determined movement.

9. The method of claim 8 , wherein the result of the plurality of iterative validations is determined to be the invalid activation state based on the determined movement of the device being away from the user of the device.

10. The method of claim 8 , wherein determining the movement of the device relative to the user comprises:

identifying a portion of the captured sound as speech generated by the user; and

analyzing an intensity of the speech over time to determine the movement of the device relative to the user.

11. The method of claim 8 , wherein determining the movement of the device relative to the user comprises:

determining an acoustic receptive field of the microphone array using the captured sound; and

analyzing the acoustic receptive field over time to determine the movement of the device relative to the user.

12. The method of claim 11 , wherein the microphone array includes a first microphone configured to monitor a first region in the acoustic receptive field, wherein the first region is a null region when the device is in a first position relative to the user, and analyzing the acoustic receptive field over time comprises determining whether the first region transitions between an active region and the null region over time.

13. A headset comprising:

a frame configured to be worn on a head of a user;

a soft-touch button on the frame and configured to detect an activation event;

a microphone array configured to capture sound; and

a controller configured to:

start supply of a power to the microphone array responsive to detection of the activation event,

instruct the microphone array to capture sound from a local area of the headset over a plurality of time periods responsive to detection of the activation event,

store each portion of the sound captured during a respective time period of the plurality of time period as respective audio data in a buffer,

perform a respective validation of a plurality of iterative validations of the activation event by analyzing the respective audio data stored in the buffer, and

perform an action based on a result of the plurality of iterative validations, the action comprises stopping supply of the power to the microphone array when the result of each validation of the plurality of iterative validations is an invalid activation state.

14. The headset of claim 13 , wherein the soft-touch button is a capacitive touch sensor configured to determine the activation event based on a proximity of skin of the user to the capacitive touch sensor.

15. The headset of claim 13 , wherein the controller is further configured to:

switch the headset into a high-power state from a low-power state when the result of the plurality of iterative validations is a valid activation state.

16. The headset of claim 13 , wherein the controller is further configured to:

switch the headset into a high-power state from a low-power state based on the activation event, wherein a first power is supplied to the microphone array in the low-power state, a second power is supplied to the microphone array in the high-power state, and the first power is lower than the second power.

17. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to perform operations comprising:

detecting an activation event on a device;

responsive to detecting the activation event:

starting supply of a power to a microphone array on the device;

instructing the microphone array to capture sound from a local area of the device over a plurality of time periods;

storing each portion of the sound captured during a respective time period of the plurality of time period as respective audio data in a buffer;

performing a respective validation of a plurality of iterative validations of the activation event by analyzing the respective audio data stored in the buffer; and

performing an action based on a result of the plurality of iterative validations, the action comprises stopping supply of the power to the microphone array when a result of each validation of the plurality of iterative validations is an invalid activation state.

Assignments (2)
CHANGE OF NAME Recorded Jun 8, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060314/0965 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2021
From: LOVITT, ANDREW
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 055444/0990 →
Continuity (1)
Provisional Application 63043626 · Jun 24, 2020
Cited By (2)
US 12,437,754 US 12,614,544