IP Library Granted Patent US 10,515,628
Granted Patent B2
US 10,515,628 · App. 16/417,173 · Granted Dec 24, 2019

System and method for a cooperative conversational voice user interface

Inventors: Larry Baldwin (Maple Valley, WA); Tom Freeman (Mercer Island, WA); Michael Tjalve (Bellevue, WA); Blane Ebersold (Seattle, WA); Chris Weider (Seattle, WA)
Assignee: VB Assets, LLC
G10L15/18G06F3/167G06F17/2785G10L15/1815G10L15/1822G10L15/22G10L17/22G10L25/51G10L15/183G10L2015/0631G10L2015/225G10L2015/228G10L2021/02166
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,515,628
App. No.
16/417,173
Granted
Dec 24, 2019
Kind
B2
Abstract

A cooperative conversational voice user interface is provided. The cooperative conversational voice user interface may build upon short-term and long-term shared knowledge to generate one or more explicit and/or implicit hypotheses about an intent of a user utterance. The hypotheses may be ranked based on varying degrees of certainty, and an adaptive response may be generated for the user. Responses may be worded based on the degrees of certainty and to frame an appropriate domain for a subsequent utterance. In one implementation, misrecognitions may be tolerated, and conversational course may be corrected based on subsequent utterances and/or responses.

Claims (49)

1. A computer-implemented method of facilitating natural language system responses utilizing accumulated short-term and long-term knowledge, the method being implemented by a computer system that includes one or more physical processors executing one or more computer program instructions which, when executed, perform the method, the method comprising:

accumulating, by the computer system, short-term knowledge based on one or more natural language utterances received during a predetermined time period;

expiring, by the computer system, one or more items of short-term knowledge that are based on one or more natural language utterances received prior to the predetermined time period;

accumulating, by the computer system, long-term knowledge based on one or more natural language utterances received prior to the predetermined time period, wherein the long-term knowledge includes at least one of the one or more expired items of short-term knowledge, first long-term knowledge associated with a first user based on one or more natural language utterances received from the first user, and second long-term knowledge associated with a second user based on one or more natural language utterances received from the second user;

receiving, at the computer system, a first natural language utterance via an input device;

determining, by the computer system, based on the short-term knowledge and the long-term knowledge, a first context for the first natural language utterance;

determining, by the computer system, based on the first context, an interpretation of the first natural language utterance; and

generating, by the computer system, a first response to the first natural language utterance based on the interpretation.

2. The method of claim 1 , wherein the one or more natural language utterances received during the predetermined time period are related to a single conversation between a user and the computer system.

3. The method of claim 1 , wherein the long-term knowledge comprises one or more of user preferences, an indication of utilized domain agents, contexts of prior natural language utterances, requests of prior natural language utterances, and tasks performed in response to prior natural language utterances.

4. The method of claim 1 , the method further comprising:

receiving, by the computer system, a second natural language utterance in response to the first response;

identifying, by the computer system, one or more user preferences based on the second natural language utterance; and

updating, by the computer system, the long-term knowledge based on the identified user preferences.

5. The method of claim 1 , wherein the long-term knowledge is associated with a first user, the method further comprising:

generating, by the computer system, a profile associated with the first user based on the long-term knowledge, wherein the first context for the first natural language utterance is further determined based on the profile associated with the first user.

6. The method of claim 1 , the method further comprising:

generating, by the computer system, one or more of a user profile, an environmental profile, a historical profile, and/or a cognitive profile based on the long-term knowledge, wherein subsequent natural language utterances are processed based at least on the one or more of the user profile, the environmental profile, the historical profile, and the cognitive profile.

7. The method of claim 1 , the method further comprising:

receiving, by the computer system, information from a remote data source, wherein the long-term knowledge is based further on the information obtained from the remote data source.

8. The method of claim 1 , wherein determining the interpretation of the first natural language utterance comprises:

determining, by the computer system, an interpretation of one or more recognized words of the first natural language utterance based on the first context.

9. The method of claim 1 , the method further comprising:

causing, by the computer system, the response to the first natural language utterance to be provided to a user.

10. A system for facilitating natural language system responses utilizing accumulated short-term and long-term knowledge, the system comprising:

one or more physical processors programmed with one or more computer program instructions which, when executed, configure the one or more physical processors to:

accumulate short-term knowledge based on one or more natural language utterances received during a predetermined time period;

expire one or more items of short-term knowledge that are based on one or more natural language utterances received prior to the predetermined time period;

accumulate long-term knowledge based on one or more natural language utterances received prior to the predetermined time period, wherein the long-term knowledge includes at least one of the one or more expired items of short-term knowledge, first long-term knowledge associated with a first user based on one or more natural language utterances received from the first user, and second long-term knowledge associated with a second user based on one or more natural language utterances received from the second user;

receive a first natural language utterance via an input device;

determine a first context for the first natural language utterance based on the short-term knowledge and the long-term knowledge;

determine an interpretation of the first natural language utterance based on the first context; and

generate a first response to the first natural language utterance based on the interpretation.

11. The system of claim 10 , wherein the one or more natural language utterances received during the predetermined time period are related to a single conversation between a user and the computer system.

12. The system of claim 10 , wherein the long-term knowledge comprises one or more of user preferences, an indication of utilized domain agents, contexts of prior natural language utterances, requests of prior natural language utterances, and tasks performed in response to prior natural language utterances.

13. The system of claim 10 , wherein the one or more physical processors are further configured to:

receive a second natural language utterance in response to the first response;

identify one or more user preferences based on the second natural language utterance; and

update the long-term knowledge based on the identified user preferences.

14. The system of claim 10 , wherein the long-term knowledge is associated with a first user, and wherein the one or more physical processors are further configured to:

generate a profile associated with the first user based on the long-term knowledge, wherein the first context for the first natural language utterance is further determined based on the profile associated with the first user.

15. The system of claim 10 , wherein the one or more physical processors are further configured to:

generate one or more of a user profile, an environmental profile, a historical profile, and/or a cognitive profile based on the long-term knowledge, wherein subsequent natural language utterances are processed based at least on the one or more of the user profile, the environmental profile, the historical profile, and the cognitive profile.

16. The system of claim 10 , wherein the one or more physical processors are further configured to:

receive information from a remote data source, wherein the long-term knowledge is based further on the information obtained from the remote data source.

17. The system of claim 10 , wherein to determine the interpretation of the first natural language utterance, the one or more physical processors are configured to:

determine an interpretation of one or more recognized words of the first natural language utterance based on the first context.

18. The system of claim 10 , wherein the one or more physical processors are further configured to:

cause the response to the first natural language utterance to be provided to a user.

Assignments (4)
SECURITY INTEREST Recorded Apr 8, 2025
From: VB ASSETS, LLC
To: CONTINGENCY CAPITAL FUND A LP
Reel/Frame 070767/0583 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 20, 2019
From: BALDWIN, LARRY; FREEMAN, TOM; TJALVE, MICHAEL; EBERSOLD, BLANE; WEIDER, CHRIS
To: VOICEBOX TECHNOLOGIES, INC.
Reel/Frame 049233/0285 →
NUNC PRO TUNC ASSIGNMENT Recorded May 20, 2019
From: VOICEBOX TECHNOLOGIES CORPORATION
To: VB ASSETS, LLC
Reel/Frame 049233/0400 →
MERGER Recorded May 20, 2019
From: VOICEBOX TECHNOLOGIES, INC.
To: VOICEBOX TECHNOLOGIES CORPORATION
Reel/Frame 049234/0669 →