IP Library Granted Patent US 9,218,819
Granted Patent B1
US 9,218,819 · App. 13/783,145 · Granted Dec 22, 2015

Customizing actions based on contextual data and voice-based inputs

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,218,819
App. No.
13/783,145
Granted
Dec 22, 2015
Kind
B1
Abstract

Methods and systems are provided for customizing an action. In some implementations, voice input is received from a user and a context is determined from the voice input. Potential contextual data is identified based on the context and the voice input. A level of confidence is determined for an association of the potential contextual data and the context. An action is performed based on the voice input, the potential contextual data, and the level of confidence. The potential contextual data is used to customize the action.

Claims (59)

1. A computer-implemented method comprising:

receiving a voice input from a user;

determining a context from the voice input, wherein the context identifies a subject of the voice input, and wherein the context is associated with an action;

identifying from previously stored data specific to the user, one or more potentially relevant current or near-term events related to the user and the subject of the voice input based on the context and the voice input;

determining a level of confidence for an association of the one or more potentially relevant current or near-term events and the context; and

when the level of confidence is sufficiently high, performing the action based on the voice input, and on the one or more potentially relevant current or near-term events, wherein the one or more potentially relevant current or near-term events are used to customize the action.

2. The method of claim 1 , further comprising:

presenting a refining prompt when the level of confidence is sufficiently low.

3. The method of claim 1 , wherein the one or more potentially relevant current or near-term events are identified from the group consisting of calendar data associated with the user, social network data associated with the user, email data associated with the user, text message data associated with the user, telephone conversation data associated with the user, internet activity data associated with the user, and any combination thereof.

4. The method of claim 1 , wherein identifying the one or more potentially relevant current or near-term events comprises:

building an event model by identifying current and near term events related to the user, wherein the event model comprises data indicative of people, places, and times associated with the events; and

identifying data from the event model that is potentially associated with the context.

5. The method of claim 1 , further comprising:

processing the voice input and the context to determine whether there is sufficient information to perform the action; and

determining one or more missing parameters for the action when there is not sufficient information, wherein the potential contextual data comprises previously stored data specific to the user.

6. The method of claim 5 , wherein performing the action comprises customizing the one or more missing parameters using the identified current or near-term events.

7. The method of claim 5 , further comprising:

ranking the one or more missing parameters; and

presenting a query to refine the voice input based on the ranking when the level of confidence is sufficiently low.

8. The method of claim 5 , further comprising:

accessing data associated with other users; and

identifying data that are potentially associated with the one or more missing parameters from the data associated with other users.

9. The method of claim 5 , further comprising:

identifying trend in user data associated with the user over time; and

determining information indicative of the one or more missing parameters based on the trends.

10. The method of claim 5 , further comprising presenting options for the missing parameters to the user in order to allow the user to select one or more of the options.

11. A system comprising:

one or more computers configured to perform operations comprising:

receiving a voice input from a user;

determining a context from the voice input, wherein the context identifies a subject of the voice input, and wherein the context is associated with an action;

identifying, from previously stored data specific to the user, one or more potentially relevant current or near-term events related to the user and the subject of the voice input based on the context and the voice input;

determining a level of confidence for an association of the one or more potentially relevant current or near-term events and the context; and

when the level of confidence is sufficiently high, performing the action based on the voice input, and on the one or more potentially relevant current or near-term events, wherein the one or more potentially relevant current or near-term events are used to customize the action.

12. The system of claim 11 , the operations further comprising:

presenting a refining prompt when the level of confidence is sufficiently low.

13. The system of claim 11 , wherein the one or more potentially relevant current or near-term events are identified from the group consisting of calendar data associated with the user, social network data associated with the user, email data associated with the user, text message data associated with the user, telephone conversation data associated with the user, internet activity data associated with the user, and any combination thereof.

14. The system of claim 11 wherein identifying the one or more potentially relevant current or near-term events comprises:

building an event model by identifying current and near term events related to the user, wherein the event model comprises data indicative of people, places, and times associated with the events; and

identifying data from the event model that is potentially associated with the context.

15. The system of claim 11 , the operations further comprising:

processing the voice input and the context to determine whether there is sufficient information to perform the action; and

determining one or more missing parameters for the action when there is not sufficient information, wherein the potential contextual data comprises previously stored data specific to the user.

16. The system of claim 15 , wherein performing the action comprises customizing the one or more missing parameters using the identified current or near-term events.

17. The system of claim 15 , the operations further comprising:

ranking the one or more missing parameters; and

presenting a query to refine the voice input based on the ranking when the level of confidence is sufficiently low.

18. The system of claim 15 , the operations further comprising:

accessing data associated with other users; and

identifying data that are potentially associated with the one or more missing parameters from the data associated with the other users.

19. The system of claim 15 , the operations further comprising:

identifying trend in user data associated with the user over time; and

determining information indicative of the one or more missing parameters based on the trends.

20. The system of claim 15 , further comprising presenting options for the missing parameters to the user in order to allow the user to select one or more of the options.

21. A computer program product encoded on one or more non-transitory computer storage media, the computer program product comprising instructions that when executed by one or more computers cause the one or more computers to perform operations comprising:

receiving a voice input from a user;

determining a context from the voice input, wherein the context identifies a subject of the voice input, and wherein the context is associated with an action;

identifying, from previously stored data specific to the user, one or more potentially relevant current or near-term events related to the user and the subject of the voice input based on the context and the voice input;

determining a level of confidence for an association of the one or more potentially relevant current or near-term events and the context; and

when the level of confidence is sufficiently high, performing the action based on the voice input, and on the one or more potentially relevant current or near-term events, wherein the one or more potentially relevant current or near-term events are used to customize the action.

Assignments (2)
CHANGE OF NAME Recorded Oct 2, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044566/0657 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2013
From: STEKKELPAK, ZOLTAN; SIMONYI, GYULA
To: GOOGLE INC.
Reel/Frame 029909/0962 →