IP Library › Granted Patent US 11,978,440
Granted Patent B2
US 11,978,440 · App. 18/323,625 · Granted May 7, 2024

Wakeword detection

Inventors: Deepak Yavagal (Issaquah, WA); Ajith Prabhakara (Seattle, WA); John Gray (Redmond, WA)
Assignee: Amazon Technologies, Inc.
G10L15/183G10L15/063G10L15/22G10L2015/088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,978,440
App. No.
18/323,625
Granted
May 7, 2024
Kind
B2
Abstract

Techniques for processing input data for a detected user are described. Received image data is processed to identify an indicated user. Based on the user a machine learning model is implemented. The machine learning model is then used to process input data for a user input. An action is performed using the resulting output data.

Claims (38)

1. A computer-implemented method, comprising:

receiving image data;

processing the image data to determine a first user is represented in the image data;

based at least in part on the first user being represented in the image data, implementing a first machine learning model;

receiving input data representing a user input;

processing the input data using the first machine learning model to determine output data; and

performing an action using the output data.

2. The computer-implemented method of claim 1 , wherein receiving the input data comprises receiving audio data representing user speech.

3. The computer-implemented method of claim 1 , wherein implementing the first machine learning model occurs prior to receiving the input data.

4. The computer-implemented method of claim 1 , wherein the first machine learning model comprises a wakeword detection model.

5. The computer-implemented method of claim 1 , further comprising:

selecting the first machine learning model from a plurality of machine learning models including at least the first machine learning model and a second machine learning model different from the first machine learning model.

6. The computer-implemented method of claim 1 , wherein the first machine learning model is trained using data corresponding to the first user.

7. The computer-implemented method of claim 1 , wherein the first machine learning model is trained using data corresponding to speech of the first user.

8. The computer-implemented method of claim 1 , wherein the first machine learning model is associated with a first speech processing component of a plurality of speech processing components.

9. The computer-implemented method of claim 1 , wherein the first machine learning model is associated with a first companion application of a plurality of applications.

10. The computer-implemented method of claim 1 , further comprising:

processing the output data to determine that the user input originated from the first user.

11. A system comprising:

at least one processor; and

at least one memory comprising instructions that, when executed by the at least one processor, cause the system to:

receive image data;

process the image data to determine a first user is represented in the image data;

based at least in part on the first user being represented in the image data, implement a first machine learning model;

receive input data representing a user input;

process the input data using the first machine learning model to determine output data; and

perform an action using the output data.

12. The system of claim 11 , wherein receiving the input data comprises receiving audio data representing user speech.

13. The system of claim 11 , wherein implementing the first machine learning model occurs prior to receiving the input data.

14. The system of claim 11 , wherein the first machine learning model comprises a wakeword detection model.

15. The system of claim 11 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:

select the first machine learning model from a plurality of machine learning models including at least the first machine learning model and a second machine learning model different from the first machine learning model.

16. The system of claim 11 , wherein the first machine learning model is trained using data corresponding to the first user.

17. The system of claim 11 , wherein the first machine learning model is trained using data corresponding to speech of the first user.

18. The system of claim 11 , wherein the first machine learning model is associated with a first speech processing component of a plurality of speech processing components.

19. The system of claim 11 , wherein the first machine learning model is associated with a first companion application of a plurality of applications.

20. The system of claim 11 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:

process the output data to determine that the user input originated from the first user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 25, 2023
From: YAVAGAL, DEEPAK; PRABHAKARA, AJITH; GRAY, JOHN
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 063762/0186 →
Continuity (4)
Continuation 17493188 · Oct 4, 2021
Continuation 16778057 · Jan 31, 2020
Continuation 16017160 · Jun 25, 2018
Related Publication 20230368780A1 · Nov 16, 2023
Cited By (1)
US 12,592,229