IP Library Granted Patent US 9,807,045
Granted Patent B2
US 9,807,045 · App. 14/736,226 · Granted Oct 31, 2017

Contextually driven messaging system

Inventor: Evan Nicklas Wu Malahy (Sunnyvale, CA)
Assignee: Google Inc.
H04L51/24G06Q10/107G10L13/02H04L51/00H04M1/72552G10L15/26H04M1/72569
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,807,045
App. No.
14/736,226
Granted
Oct 31, 2017
Kind
B2
Abstract

A method may include receiving, by a computing device associated with a user, a message from an origination source and receiving, by the computing device, an audio input. The method may also include determining, by the computing device and based at least in part on the audio input and contextual information, a probability that the user intends to send a response message to the origination source. The method may further include, responsive to determining that the probability the user intends to send the response message to the origination source satisfies a threshold probability, determining, by the computing device, that the user intends to send the response message to the origination source. The method may also include, responsive to determining that the user intends to send the response message to the origination source, generating, by the computing device and based on the audio input, the response message, and sending, by the computing device, the response message to the origination source.

Claims (96)

1. A method comprising:

receiving, by a computing device associated with a first user, a message from a device associated with a second user;

receiving, by the computing device, an audio input while the conversation in an active state, wherein, while in the active state, the computing device does not require a command to reply to the message;

determining, by the computing device and based at least in part on the audio input and contextual information, a probability that the first user intends to send a response message to the device associated with the second user, the contextual information including one or more of a frequency of incoming messages from the device associated with the second user, a frequency of outgoing messages to the device associated with the second user, an amount of time that has elapsed since a most recent message was received from the device associated with the second user, an amount of time that has elapsed since a most recent response was sent to the device associated with the second user;

determining whether the probability the first user intends to send the response message to the device associated with the second user satisfies a threshold probability;

responsive to determining that the probability the first user intends to send the response message to the device associated with the second user satisfies the threshold probability, determining, by the computing device, that the first user intends to send the response message to the device associated with the second user; and

responsive to determining that the first user intends to send the response message to the device associated with the second user:

generating, by the computing device and based on the audio input, the response message; and

sending, by the computing device, the response message to the device associated with the second user.

2. The method of claim 1 , further comprising:

responsive to determining that the probability the first user intends to send the response message to the device associated with the second user does not satisfy than the threshold probability:

outputting, by the computing device, a request for additional action by the first user;

receiving, by the computing device and from the first user; a second audio input indicative of the first user's intent to send a message; and

sending, by the computing device and based at least in part on the second audio input, the response message to the device associated with the second user.

3. The method of claim 1 , further comprising:

prior to receiving the audio input, receiving, by the computing device, a message from a device associated with a third user;

determining, by the computing device and based at least in part on the audio input and contextual information, a probability that the first user intends to send the response message to the device associated with the third user;

determining, by the computing device and based on the probability that the first user intends to send the response message to the device associated with the second user and the probability that the first user intends to send the response message to the device associated with the second user, whether the first user intends to send the response message to the device associated with the second user or to the device associated with the third user; and

responsive to determining that the first user intends to send the response message to the device associated with the third user:

generating, by the computing device and based on the audio input, the response message; and

sending, by the computing device, the response message to the device associated with the third user.

4. The method of claim 3 ,

wherein determining that the first user intends to send the response message to the device associated with the second user is further responsive to determining that the probability the first user intends to send the response message to the device associated with the second user satisfies the threshold probability but the probability that the first user intends to send the response message to the device associated with the third user does not satisfy the threshold probability, and

wherein determining that the first user intends to send the response message to the device associated with the third user is further responsive to determining that the probability the first user intends to send the response message to the device associated with the third user satisfies the threshold probability but the probability that the first user intends to send the response message to the device associated with the second user does not satisfy than the threshold probability.

5. The method of claim 3 ,

wherein determining that the first user intends to send the response message to the device associated with the second user is further responsive to determining that the probability the first user intends to send the response message to the device associated with the second user satisfies the threshold probability and is greater than the probability that the first user intends to send the response message to the device associated with the third user, and

wherein determining that the first user intends to send the response message to the device associated with the third user is further responsive to determining that the probability the first user intends to send the response message to the device associated with the third user satisfies the threshold probability and is greater than the probability that the first user intends to send the response message to the device associated with the second user.

6. The method of claim 1 , further comprising:

determining, by the computing device, a probability the first user intends to listen to the message from the device associated with the second user; and

responsive to determining that the probability the first user intends to listen to the message from the device associated with the second user satisfies a threshold probability for listening to messages:

generating, by the computing device and based on the message from the device associated with the second user; audio data; and

outputting, by the computing device, the audio data.

7. The method of claim 1 , wherein the probability that the first user intends to send the response message to the device associated with the second user is not based a user command.

8. A device associated with a first user, the device comprising:

an audio output device;

an audio input device;

a communication unit;

at least one processor; and

a storage device that stores a message management module operable by the at least one processor to:

receive, via the communication unit, a message from a device associated with a second user;

receive, via the audio input device, an audio input while the conversation in an active state, wherein, while in the active state, the computing device does not require a command to reply to the message;

determine, based at least in part on the audio input and contextual information, a probability that the first user intends to send a response message to the device associated with the second user, the contextual information including one or more of a frequency of incoming messages from the device associated with the second user, a frequency of outgoing messages to the device associated with the second user, an amount of time that has elapsed since a most recent message was received from the device associated with the second user, an amount of time that has elapsed since a most recent response was sent to the device associated with the second user;

determine whether the probability the first user intends to send the response message to the device associated with the second user satisfies a threshold probability;

responsive to determining that the probability the first user intends to send the response message to the device associated with the second user satisfies the threshold probability, determine, that the first user intends to send the response message to the device associated with the second user; and

responsive to determining that the first user intends to send the response message to the device associated with the second user:

generate, based on the audio input, the response message; and

send, via the communication unit, the response message to the device associated with the second user.

9. The device of claim 8 , wherein the message management module is further operable by the at least one processor to:

responsive to determining that the probability the first user intends to send the response message to the device associated with the second user does not satisfy the threshold probability:

output, via the audio output device, a request for additional action by the first user;

receive, via the audio input device; a second audio input indicative of the first user's intent to send a message; and

send, via the communication unit and based at least in part on the second audio input, the response message to the device associated with the second user.

10. The device of claim 8 , wherein the message management module is further operable by the at least one processor to:

prior to receiving the audio input, receive, via the communication unit, a message from a device associated with a third user;

determine, based at least in part on the audio input and contextual information, a probability that the first user intends to send the response message to the device associated with the third user

determine, based on the probability that the first user intends to send the response message to the device associated with the second user and the probability that the first user intends to send the response message to the device associated with the third user, whether the first user intends to send the response message to the device associated with the second user or to the device associated with the third user; and

responsive to determining that the first user intends to send the response message to the device associated with the third user:

generate, based on the audio input, the response message; and

send, via the communication network, the response message to the device associated with the third user.

11. The device of claim 10 , wherein determining that the first user intends to send the response message to the device associated with the second user is further responsive to determining that the probability the first user intends to send the response message to the device associated with the second user satisfies the threshold probability but the probability that the first user intends to send the response message to the device associated with the third user does not satisfy than the threshold probability, and

wherein determining that the first user intends to send the response message to the device associated with the third user is further responsive to determining that the probability the first user intends to send the response message to the device associated with the third user satisfies the threshold probability but the probability that the first user intends to send the response message to the device associated with the second user does not satisfy the threshold probability.

12. The device of claim 10 ,

wherein determining that the first user intends to send the response message to the device associated with the second user is further responsive to determining that the probability the first user intends to send the response message to the device associated with the second user satisfies the threshold probability and is greater than the probability that the first user intends to send the response message to the device associated with the third user, and

wherein determining that the first user intends to send the response message to the device associated with the third user is further responsive to determining that the probability the first user intends to send the response message to the device associated with the third user satisfies the threshold probability and is greater than the probability that the first user intends to send the response message to the device associated with the second user.

13. The device of claim 8 , wherein the message management module is further operable by the at least one processor to:

determine a probability the first user intends to listen to the message from the device associated with the second user; and

responsive to determining that the probability the first user intends to listen to the message from the device associated with the second user satisfies a threshold probability for listening to messages:

generate, based on the message from the device associated with the second user; audio data; and

output, via the audio output device, the audio data.

14. The device of claim 8 , wherein the probability that the first user intends to send the response message to the device associated with the second user is not based a user command.

15. A non-transitory computer-readable storage medium comprising instructions that, when executed, configure one or more processors of a computing system associated with a first user to:

receive a message from a device associated with a second user;

receive an audio input while the conversation in an active state, wherein, while in the active state, the computing device does not require a command to reply to the message;

determine, based at least in part on the audio input and contextual information, a probability that the first user intends to send a response message to the device associated with the second user, the contextual information including one or more of a frequency of incoming messages from the device associated with the second user, a frequency of outgoing messages to the device associated with the second user, an amount of time that has elapsed since a most recent message was received from the device associated with the second user, an amount of time that has elapsed since a most recent response was sent to the device associated with the second user;

determine whether the probability the first user intends to send the response message to the device associated with the second user satisfies a threshold probability;

responsive to determining that the probability the first user intends to send the response message to the device associated with the second user satisfies the threshold probability, determine that the first user intends to send the response message to the device associated with the second user; and

responsive to determining that the first user intends to send the response message to the device associated with the second user:

generate, based on the audio input, the response message; and

send the response message to the device associated with the second user.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the instructions, when executed, further configure the one or more processors to:

responsive to determining that the probability the first user intends to send the response message to the device associated with the second user does not satisfy the threshold probability:

output a request for additional action by a user;

receive a second audio input indicative of the first user's intent to send a message; and

send, based at least in part on the second audio input, the response message to the device associated with the second user.

17. The non-transitory computer-readable storage medium of claim 15 , wherein the instructions, when executed, further configure the one or more processors to:

prior to receiving the audio input, receive a message from a device associated with a third user;

determine, based at least in part on the audio input and contextual information, a probability that the first user intends to send the response message to the device associated with a third user;

determine, based on the probability that the first user intends to send the response message to the device associated with the second user and the probability that the first user intends to send the response message to the device associated with a third user, whether the first user intends to send the response message to the device associated with the second user or to the device associated with a third user; and

responsive to determining that the first user intends to send the response message to the device associated with a third user:

generate, based on the audio input, the response message; and

send the response message to the device associated with a third user.

18. The non-transitory computer-readable storage medium of claim 15 , wherein the instructions, when executed, further configure the one or more processors to:

determine a probability the first user intends to listen to the message from the device associated with the second user; and

responsive to determining that the probability the first user intends to listen to the message from the device associated with the second user satisfies a threshold probability for listening to messages:

generate, based on the message from the device associated with the second user; audio data; and

output the audio data.

Assignments (2)
CHANGE OF NAME Recorded Oct 5, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044129/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 10, 2015
From: MALAHY, EVAN NICKLAS WU
To: GOOGLE INC.
Reel/Frame 035819/0437 →
Continuity (1)
Related Publication 20160366084A1 · Dec 15, 2016