IP Library Granted Patent US 10,304,463
Granted Patent B2
US 10,304,463 · App. 15/284,476 · Granted May 28, 2019

Multi-user personalization at a voice interface device

Inventors: Kenneth Mixter (Los Altos Hills, CA); Diego Melendo Casado (Mountain View, CA); Bibo Xu (San Jose, CA)
Assignee: GOOGLE LLC
G10L17/06G06F3/167G06F21/32G10L15/08G10L15/22G10L17/04G10L21/0216G10L25/51G10L2015/088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,304,463
App. No.
15/284,476
Granted
May 28, 2019
Kind
B2
Abstract

A method at an electronic device with one or more microphones and a speaker includes receiving a first freeform voice input; comparing the first voice input to a set of voice models associated with a plurality of users associated with the electronic device, where the voice models are trained to the electronic device; based on the comparing, determining that the first voice input corresponds to a first user of the plurality of users; and presenting a response in accordance with the determination.

Claims (78)

1. A method, comprising:

at an electronic device with one or more microphones, a speaker, one or more processors, and memory storing one or more programs for execution by the one or more processors, the electronic device located at a structure having a plurality of occupants and being configured to present information to the plurality of occupants at the structure:

receiving a first freeform voice input, wherein the first freeform voice input is associated with a request for personal information;

in response to the request, accessing a set of one or more voice models, each trained to a respective one of the plurality of occupants;

comparing the first voice input to the one or more voice models;

based on the comparing, determining whether the first voice input corresponds to any of the plurality of occupants;

in accordance with a determination that the first voice input corresponds to a first occupant of the plurality of occupants: authenticating the first occupant based on the comparing, and presenting at the electronic device a response that includes the requested personal information with respect to the first occupant in accordance with the determination and the authentication; and

in accordance with a determination that the first voice input corresponds to none of the plurality of occupants: restricting functionality of the electronic device, wherein restricting functionality of the electronic device comprises acting on only requests that involve non-personal information.

2. The method of claim 1 , wherein the response is an audible response including personal account data in numerical form, and presenting the response comprises:

receiving the audible response from a content host;

outputting the audible response.

3. The method of claim 1 , further comprising:

determining the request based on the first voice input; and

generating the response in accordance with the determined request.

4. The method of claim 3 , wherein:

the determined request includes a request to the electronic device to awaken; and

the response includes an audible greeting, wherein the greeting includes an indication of an identity of the determined first occupant.

5. The method of claim 3 , wherein:

the personal information includes an email, a calendar event, or a bank balance; and

generating the response in accordance with the determined request comprises obtaining the requested personal information with respect to the first occupant.

6. The method of claim 5 , wherein:

obtaining the requested personal information with respect to the determined first occupant comprises accessing a personal account associated with the first occupant.

7. The method of claim 1 , further comprising:

receiving a second voice input;

comparing the second voice input to the one or more voice models;

based on the comparing, determining that the second voice input corresponds to a second occupant of the plurality of occupants and authenticating the second occupant; and

presenting at the electronic device a response that includes the requested personal information with respect to the second occupant in accordance with the determination that the second voice input corresponds to the second occupant and in accordance with the authentication of the second occupant.

8. The method of claim 1 , wherein the electronic device includes a display; and

the method further comprising:

indicating, in accordance with the determination, that the electronic device has identified the first occupant by displaying on the display an indication of an identity of the first occupant; and

providing the first occupant an opportunity to verify the identification.

9. The method of claim 1 , wherein the electronic device includes a display; and

the method further comprising:

indicating, in accordance with the determination, that the electronic device has identified the first occupant by displaying on the display a visual user interface associated with the first occupant; and

providing the first occupant an opportunity to verify the identification.

10. An electronic device located at a structure having a plurality of occupants and being configured to present information to the plurality of occupants at the structure, the electronic device comprising:

one or more microphones;

a speaker;

one or more processors; and

memory storing one or more programs to be executed by the one or more processors, the one or more programs comprising instructions for:

receiving a first freeform voice input, wherein the first freeform voice input is associated with a request for personal information;

in response to the request, accessing a set of one or more voice models, each trained to a respective one of the plurality of occupants;

comparing the first voice input to the one or more voice models;

based on the comparing, determining whether the first voice input corresponds to any of the plurality of occupants;

in accordance with a determination that the first voice input corresponds to a first occupant of the plurality of occupants: authenticating the first occupant based on the comparing, and presenting at the electronic device a response that includes the requested personal information with respect to the first occupant in accordance with the determination and the authentication; and

in accordance with a determination that the first voice input corresponds to none of the plurality of occupants: restricting functionality of the electronic device, wherein restricting functionality of the electronic device comprises acting on only requests that involve non-personal information.

11. The device of claim 10 , comprising instructions for:

determining the request based on the first voice input; and

generating the response in accordance with the determined request.

12. The device of claim 11 , wherein:

the determined request includes a request to the electronic device to awaken; and

the response includes an audible greeting, wherein the greeting includes an indication of an identity of the determined first occupant.

13. The device of claim 11 , wherein:

the personal information includes an email, a calendar event, or a bank balance; and

the device comprises instructions for:

obtaining the requested personal information with respect to the first occupant.

14. The device of claim 13 , comprising instructions for:

accessing a personal account associated with the first occupant.

15. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by an electronic device being configured to present information to a plurality of occupants and having one or more microphones, a speaker, and one or more processors, cause the electronic device to perform operations comprising:

receiving a first freeform voice input, wherein the first freeform voice input is associated with a request for personal information;

in response to the request, accessing a set of one or more voice models, each trained to a respective one of the plurality of occupants;

comparing the first voice input to the one or more voice models;

based on the comparing, determining whether the first voice input corresponds to any of the plurality of occupants;

in accordance with a determination that the first voice input corresponds to a first occupant of the plurality of occupants: authenticating the first occupant based on the comparing, and presenting at the electronic device a response that includes the requested personal information with respect to the first occupant in accordance with the determination and the authentication; and

in accordance with a determination that the first voice input corresponds to none of the plurality of occupants: restricting functionality of the electronic device, wherein restricting functionality of the electronic device comprises acting on only requests that involve non-personal information.

16. The computer readable storage medium of claim 15 , further comprising instructions which, when executed by the electronic device, cause the electronic device to perform operations comprising:

receiving a second voice input;

comparing the second voice input to the one or more voice models;

based on the comparing, determining that the second voice input corresponds to a second occupant of the plurality of occupants and authenticating the second occupant; and

presenting at the electronic device a response that includes the requested personal information with respect to the second occupant in accordance with the determination that the second voice input corresponds to the second occupant.

17. The computer readable storage medium of claim 15 , wherein the electronic device includes a display; and

the computer readable storage medium further comprises instructions which, when executed by the electronic device, cause the electronic device to perform operations comprising:

indicating, in accordance with the determination, that the electronic device has identified the first occupant by displaying on the display an indication of an identity of the first occupant; and

providing the first occupant an opportunity to verify the identification.

18. The computer readable storage medium of claim 15 , wherein the electronic device includes a display; and

the computer readable storage medium further comprises instructions which, when executed by the electronic device, cause the electronic device to perform operations comprising:

indicating, in accordance with the determination, that the electronic device has identified the first occupant by displaying on the display a visual user interface associated with the first occupant; and

providing the first occupant an opportunity to verify the identification.

Assignments (2)
CHANGE OF NAME Recorded Oct 20, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044567/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 6, 2016
From: MIXTER, KENNETH; MELENDO CASADO, DIEGO; XU, BIBO
To: GOOGLE INC.
Reel/Frame 039961/0998 →
Continuity (1)
Related Publication 20180096690A1 · Apr 5, 2018
Cited By (29)
US 12,197,712 US 12,197,817 US 12,200,297 US 12,204,932 US 12,211,502 US 12,216,894 US 12,219,314 US 12,223,228 US 12,223,282 US 12,236,952 US 12,254,887 US 12,260,234 US 12,277,954 US 12,293,763 US 12,301,635 US 12,333,404 US 12,361,943 US 12,367,879 US 12,381,880 US 12,386,434 US 12,386,491 US 12,388,831 US 12,405,717 US 12,431,128 US 12,477,470 US 12,556,890 US 12,608,171 US 12,613,730 US 12,619,452