IP Library Granted Patent US 11,238,853
Granted Patent B2
US 11,238,853 · App. 16/669,195 · Granted Feb 1, 2022

Keyword-based audio source localization

Inventor: Scott Kurtz (Mount Laurel, NJ)
Assignee: Comcast Cable Communications, LLC
G10L15/20G10L15/22G10L15/30G10L25/84H04R1/406H04R3/005G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,238,853
App. No.
16/669,195
Granted
Feb 1, 2022
Kind
B2
Abstract

Systems, apparatuses, and methods are described for determining a direction associated with a detected spoken keyword, forming an acoustic beam in the determined direction, and listening for subsequent speech using the acoustic beam in the determined direction.

Claims (51)

1. A method comprising:

receiving, by a computing device and from a plurality of microphones, one or more indications of first speech detected in a plurality of listening zones;

determining, based on the one or more indications of the first speech, that the first speech comprises a keyword;

determining a direction associated with the keyword;

detecting, using an acoustic beam formed by at least some of the plurality of microphones, pointed in the direction associated with the keyword, and having a width that is narrower than a width of each of the plurality of listening zones, second speech associated with the keyword; and

recognizing the second speech to generate an indication of recognized speech.

2. The method of claim 1 , further comprising:

determining, based on the indication of the recognized speech, a device;

determining, based on the indication of the recognized speech, a command; and

sending the command to the device.

3. The method of claim 1 , wherein the direction of the acoustic beam is fixed during the detecting the second speech.

4. The method of claim 1 , wherein the direction of the acoustic beam is different than a direction of each of the plurality of listening zones.

5. The method of claim 1 , wherein the determining the direction comprises:

determining, for one or more of the plurality of listening zones, one or more scores based on the one or more indications of first speech; and

determining, based on the one or more scores, the direction.

6. The method of claim 1 , wherein the plurality of microphones comprises a plurality of microphone arrays, and wherein each of the microphone arrays is associated with a different one of the plurality of listening zones.

7. The method of claim 1 , wherein the plurality of listening zones comprises a plurality of acoustic beams that are each different from the acoustic beam used to detect the second speech.

8. The method of claim 1 , wherein the keyword comprises a plurality of words.

9. A method comprising:

determining, by a computing device, based on signals from a plurality of microphones, and for a plurality of directions, audio characteristics associated with first speech;

determining that the first speech comprises a keyword;

determining, based on the audio characteristics, a direction and a width associated with the keyword;

directing, using at least some of the plurality of microphones, an acoustic beam having the direction;

detecting, using the acoustic beam, second speech; and

recognizing the second speech to generate an indication of recognized speech.

10. The method of claim 9 , further comprising:

determining, based on the indication of the recognized speech, a device;

determining, based on the indication of the recognized speech, a command; and

sending the command to the device.

11. The method of claim 9 , further comprising:

determining, for the plurality of directions, scores based on the audio characteristics; and

determining the direction based on the scores.

12. The method of claim 9 , wherein the direction of the acoustic beam is different than any of the plurality of directions.

13. The method of claim 9 , wherein the audio characteristics comprise one or more of amplitudes, confidence levels, or signal-to-noise ratios associated with the keyword.

14. A method comprising:

detecting, by each of a plurality of devices, and using a plurality of microphones of each of the plurality of devices, first speech;

determining that the first speech comprises a keyword;

determining, for each of the plurality of devices, one or more scores associated with the keyword;

determining, based on the one or more scores for each of the plurality of devices, a first device of the plurality of devices and a direction of an acoustic beam;

forming, using at least some of the plurality of microphones of the first device, the acoustic beam having the direction;

detecting, by the first device and using the acoustic beam, second speech; and

recognizing the second speech to generate an indication of recognized speech.

15. The method of claim 14 , wherein for each of the plurality of devices, each of the scores is associated with a different listening direction.

16. The method of claim 14 , further comprising determining, based on the one or more scores for each of the plurality of devices, a width of the acoustic beam, wherein the forming comprises forming the acoustic beam having the width.

17. The method of claim 14 , wherein the direction of the acoustic beam is fixed during the detecting the second speech.

18. The method of claim 14 , further comprising:

determining, based on the indication of the recognized speech, a second device different than any of the plurality of devices;

determining, based on the indication of the recognized speech, a command; and

sending the command to the second device.

19. The method of claim 14 , wherein the determining the direction of the acoustic beam is performed by a second device of the plurality of devices, the method further comprising causing, by the second device, the first device to form the acoustic beam.

20. The method of claim 9 , wherein the acoustic beam has the width that is determined.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 5, 2019
From: KURTZ, SCOTT
To: COMCAST CABLE COMMUNICATIONS, LLC
Reel/Frame 051189/0465 →
Continuity (1)
Related Publication 20210134280A1 · May 6, 2021
Cited By (1)
US 12,243,520