IP Library Granted Patent US 10,296,587
Granted Patent B2
US 10,296,587 · App. 15/620,567 · Granted May 21, 2019

Augmented conversational understanding agent to identify conversation context between two humans and taking an agent action thereof

Inventors: Larry Paul Heck (Los Altos, CA); Madhusudan Chinthakunta (Saratoga, CA); David Mitby (Mountain View, CA); Lisa Stifelman (Palo Alto, CA)
Assignee: Microsoft Technology Licensing, LLC
G06F17/279G06F17/2785G06F17/289G06N99/005H04M1/72519
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,296,587
App. No.
15/620,567
Granted
May 21, 2019
Kind
B2
Abstract

An augmented conversational understanding agent may be provided. Upon receiving, by an agent, at least one natural language phrase from a user, a context associated with the at least one natural language phrase may be identified. The natural language phrase may be associated, for example, with a conversation between the user and a second user. An agent action associated with the identified context may be performed according to the at least one natural language phrase and 201 a result associated with performing the action may be displayed.

Claims (54)

1. A method for providing an augmented conversational understanding agent, comprising:

receiving, on a computing device, at least one natural language phrase from a human user, wherein the at least one natural language phrase is from a conversation between the human user and at least one second human user;

identifying, by the computing device, a context associated with the received at least one natural language phrase, the context being identified by the computing device applying an understanding model to determine whether one or more parameters are included in the received at least one natural language phrase;

performing, by the computing device, an implicitly requested agent action associated with the identified context according to the received at least one natural language phrase, wherein the agent action comprises an action suggestion offered without being an active participant in the conversation; and

displaying, by the computing device, a result associated with performing the agent action.

2. The method of claim 1 , wherein the received at least one natural language phrase is received from the human user in response to an implicit invocation.

3. The method of claim 2 , wherein the implicit invocation occurs in response to a request to begin the conversation with the at least one second human user.

4. The method of claim 3 , wherein the conversation occurs via an instant message session.

5. The method of claim 4 , wherein the conversation occurs via a telephone call.

6. The method of claim 1 , further comprising:

receiving at least one second natural language phrase;

determining whether the at least one second natural language phrase is associated with the identified context; and

when it is determined that the at least one second natural language phrase is associated with the identified context:

performing a second agent action associated with the identified context according to the at least one second natural language phrase, and

updating the display according to a second result associated with the second agent action.

7. The method of claim 6 , further comprising, when it is determined that the at least one second natural language phrase is not associated with the identified context:

identifying a second context associated with the at least one second natural language phrase;

performing a third agent action associated with the second identified context according to the at least one second natural language phrase, and

replacing the display of the result with a second result associated with the third agent action.

8. The method of claim 1 , wherein the received at least one natural language phrase is received from the human user in response to an explicit invocation.

9. The method of claim 1 , wherein identifying the context of the natural language phrase further comprises identifying at least one domain associated with at least one word of the natural language phrase.

10. A computer-readable storage device storing a set of instructions, which when executed by a processing device, performs a method for providing an augmented conversational understanding agent, comprising:

receiving a natural language phrase from a human user, wherein the natural language phrase is from a conversation between the human user and at least one second human user;

determining whether the received natural language phrase comprises enough data to identify a context, the context being identified by applying an understanding model to determine whether one or more parameters are included in the received natural language phrase; and

when it is determined that the received natural language phrase comprises enough data to identify the context:

performing an implicitly requested agent action associated with the identified context according to the received natural language phrase, wherein the agent action comprises an action suggestion offered without being an active participant in the conversation, and

displaying a result associated with performing the agent action.

11. The computer-readable storage device of claim 10 , further comprising instructions for:

determining whether the result is to be shared with the at least one second human user; and

when determined that the result is to be shared with the at least one second human user, displaying the result associated with performing the agent action to the at least one second human user.

12. The computer-readable storage device of claim 11 , wherein determining whether the result is to be shared with the at least one second human user comprises determining whether the agent action comprises retrieving a personal note created by the human user.

13. The computer-readable storage device of claim 11 , wherein determining whether the result is to be shared with the at least one second human user comprises requesting authorization from the human user to share the result with the at least one second human user.

14. The computer-readable storage device of claim 11 , wherein determining whether the result is to be shared with the at least one second human user comprises determining whether a prior result associated with performing the agent action has been previously shared with the at least one second human user.

15. The computer-readable storage device of claim 11 , wherein determining whether the result is to be shared with the at least one second human user comprises determining whether the result is associated with scheduling an event.

16. The computer-readable storage device of claim 11 , wherein determining whether the result is to be shared with the at least one second human user comprises determining whether at least one second natural language phrase received from the human user refers to the result.

17. The computer-readable storage device of claim 10 , further comprising instructions for waiting to receive at least one second natural language phrase when it is determined that the received natural language phrase does not comprise enough data to identify a context.

18. The computer-readable storage device of claim 10 , wherein the identified context comprises a merger of a first ontology associated with the human user and a second ontology associated with the at least one second human user.

19. The computer-readable storage device of claim 10 , wherein performing the action comprises retrieving data from at least one network data source.

20. A system for providing a context-aware environment, comprising:

a memory storage; and

a processing unit coupled to the memory storage, wherein the processing unit is operative to:

invoke an agent application, wherein invoking the agent application occurs in response to a request from a first human user and wherein the request comprises at least one of the following: an explicit invocation request by the first human user and a request to begin a conversation between the first human user and at least one second human user,

receive a first natural language phrase, wherein the received first natural language phrase is from a conversation between the first human user and the at least one second human user,

determine whether the received first natural language phrase comprises enough data to identify a context, the context being identified by applying an understanding model to determine whether one or more parameters are included in the received first natural language phrase,

when determined that the received first natural language phrase does not comprise enough data to identify a context, wait to receive at least one second natural language phrase; and

when it is determined that the received first natural language phrase comprises enough data to identify a context:

perform an implicitly requested agent action associated with the received first natural language phrase, wherein the agent action comprises an action suggestion offered without being an active participant in the conversation;

display a result according to the performed action;

receive at least one second natural language phrase;

determine whether the at least one second natural language phrase is associated with the identified context;

when it is determined that the at least one second natural language phrase is associated with the identified context:

update the identified context according to the at least one second natural language phrase;

perform a second agent action associated with the updated context; and

update the display according to a second result associated with the second action.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 4, 2019
From: HECK, LARRY PAUL; CHINTHAKUNTA, MADHUSUDAN; MITBY, DAVID; STIFELMAN, LISA
To: MICROSOFT CORPORATION
Reel/Frame 050267/0739 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 4, 2019
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 050271/0001 →
Continuity (2)
Continuation 13076862 · Mar 31, 2011
Related Publication 20180129646A1 · May 10, 2018
Cited By (3)
US 12,608,182 US 12,699,553 US 12,699,554