IP Library Granted Patent US 11,620,104
Granted Patent B2
US 11,620,104 · App. 17/811,793 · Granted Apr 4, 2023

User interface customization based on speaker characteristics

Inventors: Eugene Weinstein (New York, NY); Ignacio L. Moreno (New York, NY)
Assignee: Google LLC
G06F3/167G06F3/04817G06F9/451G06F40/109
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,620,104
App. No.
17/811,793
Granted
Apr 4, 2023
Kind
B2
Abstract

Characteristics of a speaker are estimated using speech processing and machine learning. The characteristics of the speaker are used to automatically customize a user interface of a client device for the speaker.

Claims (34)

1. A computer-implemented method when executed on data processing hardware causes the data processing hardware to perform operations comprising:

receiving audio data corresponding to a voice command that requires access to a contact application storing a list of phone numbers, the voice command captured by a microphone of a user device, the user device shared by one or more users corresponding to a child age classification and one or more other users corresponding to an adult age classification;

generating an utterance feature vector derived from the received audio data corresponding to the voice command;

determining, using a neural network configured to receive the utterance feature vector as input, that the voice command was spoken by one of the one or more users corresponding to the child age classification; and

restricting the user device from calling one or more of the phone numbers in the list of phone numbers stored in the contact application based on determining that the voice command was spoken by the one of the one or more users corresponding to the child age classification.

2. The computer-implemented method of claim 1 , wherein determining that the voice command was spoken by the one of the one or more users corresponding to the child age classification comprises:

generating, using the neural network configured to receive the utterance feature vector as input, a probability distribution indicating a likelihood that the voice command was spoken by one of the of the one or more users corresponding to the child age classification; and

determining that the voice command was spoken by the one of the one or more users corresponding to the child age classification satisfies a threshold.

3. The computer-implemented method of claim 1 , wherein the voice command is used to access a user profile.

4. The computer-implemented method of claim 1 , wherein the data processing hardware resides on the user device.

5. The computer-implemented method of claim 1 , wherein the data processing hardware resides on a server in communication with the user device via a network.

6. The computer-implemented method of claim 1 , wherein the user device comprises a tablet.

7. The computer-implemented method of claim 1 , wherein the user device comprises an e-book reader.

8. The computer-implemented method of claim 1 , wherein each user among the one or more users corresponding to the child age classification and the one or more other users corresponding to the adult age classification that share the user device establish a respective user profile that includes preferences for operating the user device and applications of interest to the respective user.

9. The computer-implemented method of claim 1 , wherein the operations further comprise allowing the user device to call one or more other phone numbers in the list of phone numbers stored in the contact application based on determining that the voice command was spoken by the one of the one or more users corresponding to the child age classification.

10. The computer-implemented method of claim 9 , wherein at least one of the one or more other phone numbers comprises a home phone number.

11. A system comprising:

data processing hardware; and

memory hardware in communication with the data processing hardware and storing instructions that when executed by the data processing hardware causes the data processing hardware to perform operations comprising:

receiving audio data corresponding to a voice command that requires access to a contact application storing a list of phone numbers, the voice command captured by a microphone of a user device, the user device shared by one or more users corresponding to a child age classification and one or more other users corresponding to an adult age classification;

generating an utterance feature vector derived from the received audio data corresponding to the voice command;

determining, using a neural network configured to receive the utterance feature vector as input, that the voice command was spoken by one of the one or more users corresponding to the child age classification; and

restricting the user device from calling one or more of the phone numbers in the list of phone numbers stored in the contact application based on determining that the voice command was spoken by the one of the one or more users corresponding to the child age classification.

12. The system of claim 11 , wherein determining that the voice command was spoken by the one of the one or more users corresponding to the child age classification comprises:

generating, using the neural network configured to receive the utterance feature vector as input, a probability distribution indicating a likelihood that the voice command was spoken by one of the of the one or more users corresponding to the child age classification; and

determining that the voice command was spoken by the one of the one or more users corresponding to the child age classification satisfies a threshold.

13. The system of claim 11 , wherein the voice command is used to access a user profile.

14. The system of claim 11 , wherein the data processing hardware resides on the user device.

15. The system of claim 11 , wherein the data processing hardware resides on a server in communication with the user device via a network.

16. The system of claim 11 , wherein the user device comprises a tablet.

17. The system of claim 11 , wherein the user device comprises an e-book reader.

18. The system of claim 11 , wherein each user among the one or more users corresponding to the child age classification and the one or more other users corresponding to the adult age classification that share the user device establish a respective user profile that includes preferences for operating the user device and applications of interest to the respective user.

19. The system of claim 11 , wherein the operations further comprise allowing the user device to call one or more other phone numbers in the list of phone numbers stored in the contact application based on determining that the voice command was spoken by the one of the one or more users corresponding to the child age classification.

20. The system of claim 19 , wherein at least one of the one or more other phone numbers comprises a home phone number.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2022
From: WEINSTEIN, EUGENE; MORENO, IGNACIO L.
To: GOOGLE INC.
Reel/Frame 060477/0098 →
CHANGE OF NAME Recorded Jul 11, 2022
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 060631/0894 →
Continuity (4)
Continuation 17136069 · Dec 29, 2020
Continuation 15230891 · Aug 8, 2016
Continuation 14096608 · Dec 4, 2013
Related Publication 20220342632A1 · Oct 27, 2022