IP Library Granted Patent US 11,600,269
Granted Patent B2
US 11,600,269 · App. 16/308,849 · Granted Mar 7, 2023

Techniques for wake-up word recognition and related systems and methods

Inventors: Meik Pfeffinger (Ulm, DE); Timo Matheja (Neu-Ulm, DE); Tobias Herbig (Ulm, DE); Tim Haulick (Blaubeuren, DE)
Assignee: Cerence Operating Company
G10L15/22G06F3/167G10L15/08G10L17/22G10L2015/088G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,600,269
App. No.
16/308,849
Granted
Mar 7, 2023
Kind
B2
Abstract

A system for detection of at least one designated wake-up word for at least one speech-enabled application. The system comprises at least one microphone; and at least one computer hardware processor configured to perform: receiving an acoustic signal generated by the at least one microphone at least in part as a result of receiving an utterance spoken by a speaker; obtaining information indicative of the speaker's identity; interpreting the acoustic signal at least in part by determining, using the information indicative of the speaker's identity and automated speech recognition, whether the utterance spoken by the speaker includes the at least one designated wake-up word; and interacting with the speaker based, at least in part, on results of the interpreting.

Claims (50)

1. A system for detecting at least one designated wake-up word for at least one speech-enabled application, the system comprising:

at least one computer hardware processor configured to perform:

receiving a first acoustic signal generated by at least one first microphone at least in part as a result of receiving an utterance spoken by a first speaker;

obtaining information indicative of a first speaker's identity by processing, at least in part, the first acoustic signal;

using the information indicative of the first speakers identity to determine whether the utterance spoken by the first speaker includes at least one or more wake-up words associated with the fast speaker's identity;

in response to determining that the utterance spoken by the first speaker includes the at least one designated wake-up word, interacting with the speaker, wherein the at least one designated wake-up word includes a first designated wake-up word for a first speech-enabled application of the at least one speech-enabled application, and wherein the first designated wake-up word is specific to the first speaker such that no other speaker can use the first designated wake-up word,

receiving a second acoustic signal generated by at least one second microphone at least in part as a result of receiving, concurrently with the first microphone, a second utterance spoken by a second speaker;

obtaining information indicative of the second speaker's identity;

interpreting the second acoustic signal at least in part by determining, using the information indicative of the second speaker's identity and automated speech recognition, whether the second utterance spoken by the second speaker includes a second designated wake-up word for a second speech-enabled application specific to the speaker's identity; and

interacting with the second speaker based, at least in part, on results of the interpreting.

2. The system of claim 1 , wherein interacting with the speaker comprises allowing the speaker to control the at least one speech-enabled application.

3. The system of claim 1 , wherein the at least one computer hardware processor is configured to use the information indicative of the speaker's identity to determine whether the speaker is authorized to control the at least one speech-enabled application, and to allow the speaker to control the at leas one speech-enabled application if it is determined that the speaker is authorized to control the at least one speech-enabled application, and not allow the speaker to control the at least one speech-enabled application if it is determined that the speaker is not authorized to control the at least one speech-enabled application.

4. The system of claim 1 , wherein obtaining the speakers identity comprises:

obtaining speech characteristics from the first acoustic signal;

comparing the obtained speech characteristics against stored speech characteristics for each of multiple speakers registered with the system.

5. The system of claim 1 , wherein determining whether the utterance spoken by the speaker includes the at least one designated wake-up word comprises:

using automated speech recognition to determine whether the utterance spoken by the speaker includes a wake-up word in the one or more wake-up words, wherein the automated speech recognition is performed using the one or more wake-up words associated with the speaker identity.

6. The system of claim 1 , wherein obtaining information indicative of the speaker's identity comprises determining a position of the speaker in an environment.

7. The system of claim 6 , wherein the at least one computer hardware processor is configured to determine, using the position of the speaker in the environment, whether the speaker is authorized to control the at least one speech-enabled application, and to allow the speaker to control the at least one speech-enabled application if it is determined that the speaker is authorized to control the at least one speech-enabled application, and not allow the speaker to control the at least one speech-enabled application if it is determined that the speaker is not authorized to control the at least one speech-enabled application.

8. The system of claim 6 , wherein the at least one computer hardware processor is configured to determine the position of the speaker inside a vehicle based, at least in part, on information gathered by at least one sensor in the vehicle.

9. The system of claim 6 , wherein the at least one computer hardware processor receives the first and second acoustic signals from a plurality of microphones, and wherein the position of the speaker is determined using the acoustic signals received from the plurality of microphones.

10. The system of claim 1 , wherein the at least one microphone comprises a plurality of microphones installed in a respective plurality of acoustic ones inside of a vehicle, wherein each of the plurality of acoustic zones comprises a seating area for a passenger in the vehicle.

11. The system of claim 1 , wherein interacting with the speaker comprises inferring, based at least in part on the information indicative of the speaker's identity, at least one action to take when interacting with the speaker.

12. The system of claim 1 , wherein obtaining information indicative of the speaker's identity composes obtaining the speaker's identity; and

wherein determining whether the utterance spoken by the speaker includes the at least one designated wake-up word comprises:

accessing a list of wake-up words associated with the speaker's identity; and

determining whether the utterance includes any wake-up word in the list of wake-up words associated with the speaker's identity.

13. The system of claim 1 , wherein determining whether the utterance spoken by the speaker includes the at least one designated wake-up word comprises:

compensating for interference received by the at least one microphone by using the information associated with the speaker's identity.

14. The system of claim 1 , wherein the at least one computer hardware processor is further configured to store the information about the speaker's identity in at least one data store.

15. The system of claim 14 , wherein the at least one data store comprises a plurality of data records including a first data record, the first data record comprising information selected from the group consisting of an identity of a particular speaker, a position of the particular speaker in an environment, a list of one or more wake-up words associated with the particular speaker, a list of one or more speech-enabled applications that the particular speaker is allowed to control, a list of one or more speech-enabled applications that the particular speaker is not allowed to control, and information obtained from one or more sensors.

16. A method for detecting at least one designated wake-up word for at least one speech-enabled application, the method comprising:

using at least one computer hardware processor to perform:

receiving a first acoustic signal generated by at least one microphone at least in part as a result of receiving an utterance spoken by a first speaker;

obtaining information indicative of the first speaker's identity;

using the information indicative of the first speaker's identity to determine whether the utterance spoken by the first speaker includes the at least one designated wake-up word associated with the speaker's identity;

in response to determining that the utterance spoken by the first speaker includes the at least one designated wake-up word, interacting with the first speaker;

receiving a second acoustic signal generated by at least one second microphone at least in part as a result of receiving, concurrently with the first microphone a second utterance spoken by a second speaker;

obtaining information indicative of the second speaker's identity;

interpreting the second acoustic signal at least in part by determining using the information indicative of the second speaker's identity and automated speech recognition whether the second utterance spoken by the second speaker includes a second designated wake-up word for a second speech-enabled application specific to the speaker's identity; and

interacting with the second speaker based, at least in part, on results of the interpreting.

17. At least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by at least one computer hardware processor, cause the at least one computer hardware processor to perform a method for detecting at least one designated wake-up word for at least one speech-enabled application, the method comprising:

receiving a first acoustic signal generated by at least one first microphone at least in part as a result of receiving an utterance spoken by a first speaker;

obtaining information indicative of the first speaker's identity;

using the information indicative of the first speaker's identity to determine whether the utterance spoken by the first speaker includes the at least one designated wake-up word associated with the speaker's identity;

in response to determining that the utterance spoken by the speaker includes the at least one designated wake-up word, interacting with the speaker;

receiving a second acoustic signal generated by at least one second microphone at least in part as a result of receiving, concurrently with the first microphone, a second utterance spoken by a second speaker;

obtaining information indicative of the second speaker's identity;

interpreting the second acoustic signal at least in part by determining, using the information indicative of the second speaker's identity and automated speech recognition, whether the second utterance spoken by the second speaker includes a second designated wake-up word for a second speech-enabled application specific to the speaker's identity; and

interacting with the second speaker based, at least in part, on results of the interpreting.

Assignments (5)
RELEASE (REEL 067417 / FRAME 0303) Recorded Jan 2, 2025
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: CERENCE OPERATING COMPANY
Reel/Frame 069797/0422 →
SECURITY AGREEMENT Recorded Apr 15, 2024
From: CERENCE OPERATING COMPANY
To: WELLS FARGO BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 067417/0303 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2023
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 064723/0519 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 15, 2021
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 055927/0620 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 4, 2019
From: PFEFFINGER, MEIK; MATHEJA, TIMO; HERBIG, TOBIAS; HAULICK, TIM
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 048489/0639 →