IP Library Granted Patent US 10,534,623
Granted Patent B2
US 10,534,623 · App. 14/107,545 · Granted Jan 14, 2020

Systems and methods for providing a virtual assistant

Inventors: Kenneth S. Harper (Hudson, NH); Fares Jaradeh (Westmount, CA); Holger Quast (Merelbeke, BE); Carey Radebaugh (Brookline, MA); Sean P. Brown (San Francisco, CA)
Assignee: Nuance Communications, Inc.
G06F9/453G06F3/048G06Q30/0277G10L15/22G06F3/167G06Q30/0631H04L67/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,534,623
App. No.
14/107,545
Granted
Jan 14, 2020
Kind
B2
Abstract

A method, performed by at least one computer, the method comprising using the at least one computer to perform acts of accessing information specifying at least one user-specified condition specified by a user and at least one corresponding user-specified action, the user-specified action to be performed when the user-specified condition is met; determining whether the at least one user-specified condition is met; and when it is determined that the at least one user-specified condition is met, causing a virtual assistant executing on a mobile device different from the at least one computer to perform the at least one user-specified action.

Claims (49)

1. A method comprising:

using at least one computer to perform acts of:

accessing information specifying at least one user-specified condition and at least one corresponding user-specified action to be performed when the at least one user-specified condition is met, wherein the at least one user-specified condition specifies a topic and the at least one corresponding user-specified action comprises outputting for presentation to a user information related to the topic;

in response to determining that obtained information related to the topic meets the at least one user-specified condition, causing a virtual assistant executing on a mobile device to perform the at least one corresponding user-specified action, wherein performing the at least one corresponding user-specified action comprises outputting, by the virtual assistant, at least some of the obtained information related to the topic for presentation to a user via the mobile device; and

after causing the virtual assistant to output the at least some of the obtained information related to the topic to the user:

selecting a topic-dependent language model, from among a plurality of language models, based on the topic specified by the at least one user-specified condition that was met by the obtained information, wherein the topic-dependent language model is specifically adapted for recognition of input related to the topic;

receiving first voice input of the user including a request for additional information about the topic;

processing the first voice input using automatic speech recognition techniques at least in part by using the topic-dependent language model for the topic specified by the at least one user-specified condition.

2. The method of claim 1 , further comprising monitoring and/or searching one or more sources of information to obtain the information related to the topic.

3. The method of claim 1 , wherein the virtual assistant is configured to perform the at least one corresponding user-specified action at least in part by using another application program configured to execute on the mobile device.

4. The method of claim 1 , further comprising:

receiving, from the user, second voice input specifying the at least one user-specified condition and the at least one corresponding user-specified action; and

identifying, at least in part by using automatic speech recognition, the at least one user-specified condition and the at least one corresponding user-specified action specified by the second voice input.

5. A system comprising:

at least one computer configured to perform acts of:

accessing information specifying at least one user-specified condition and at least one corresponding user-specified action to be performed when the at least one user-specified condition is met, wherein the at least one user-specified condition specifies a topic and the at least one corresponding user-specified action comprises outputting for presentation to a user information related to the topic;

in response to determining that obtained information related to the topic meets the at least one user-specified condition, causing a virtual assistant executing on a mobile device to perform the at least one corresponding user-specified action, wherein performing the at least one corresponding user-specified action comprises outputting, by the virtual assistant, at least some of the obtained information related to the topic for presentation to a user via the mobile device; and

after causing the virtual assistant to output the at least some of the obtained information related to the topic to the user:

selecting a topic-dependent language model, from among a plurality of language models, based on the topic specified by the at least one user-specified condition that was met by the obtained information, wherein the topic-dependent language model is specifically adapted for recognition of input related to the topic;

receiving first voice input of the user including a request for additional information about the topic;

processing the first voice input using automatic speech recognition techniques at least in part by using the topic-dependent language model for the topic specified by the at least one user-specified condition.

6. The system of claim 5 , wherein the at least one computer is further configured to perform monitoring and/or searching of one or more sources of information to obtain the information related to the topic.

7. The system of claim 5 , wherein the virtual assistant is configured to perform the at least one action at least in part by using another application program configured to execute on the mobile device.

8. The system of claim 5 , wherein the at least one computer is further configured to perform acts of:

receiving, from the user, second voice input specifying the at least one user-specified condition and the at least one corresponding user-specified action; and

identifying, at least in part by using automatic speech recognition, the at least one user-specified condition and the at least one corresponding user-specified action specified by the second voice input.

9. At least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by at least one computer, cause the at least one computer to perform a method comprising acts of:

accessing information specifying at least one user-specified condition and at least one corresponding user-specified action to be performed when the at least one user-specified condition is met, wherein the at least one user-specified condition specifies a topic and the at least one corresponding user-specified action comprises outputting for presentation to a user information related to the topic;

in response to determining that obtained information related to the topic meets the at least one user-specified condition, causing a virtual assistant executing on a mobile device to perform the at least one corresponding user-specified action, wherein performing the at least one corresponding user-specified action comprises outputting, by the virtual assistant, at least some of the obtained information related to the topic for presentation to a user via the mobile device; and

after causing the virtual assistant to output the at least some of the obtained information related to the topic to the user:

selecting a topic-dependent language model, from among a plurality of language models, based on the topic specified by the at least one user-specified condition that was met by the obtained information, wherein the topic-dependent language model is specifically adapted for recognition of input related to the topic;

receiving first voice input of the user including a request for additional information about the topic;

processing the first voice input using automatic speech recognition techniques at least in part by using the topic-dependent language model for the topic specified by the at least one user-specified condition.

10. The at least one non-transitory computer-readable storage medium of claim 9 , the method further comprising monitoring and/or searching one or more sources of information to obtain the information related to the topic.

11. The at least one non-transitory computer-readable storage medium of claim 9 , wherein the virtual assistant is configured to perform the at least one action at least in part by using another application program configured to execute on the mobile device.

12. The at least one non-transitory computer-readable storage medium of claim 9 , the method further comprising:

receiving, from the user, second voice input specifying the at least one user-specified condition and the at least one corresponding user-specified action; and

identifying, at least in part by using automatic speech recognition, the at least one user-specified condition and the at least one corresponding user-specified action specified by the second voice input.

13. The method of claim 1 , wherein the topic-dependent language model is tailored to recognition of speech containing words and/or phrases for the topic specified by the at least one user-specified condition.

14. The system of claim 5 , wherein the topic-dependent language model is tailored to recognition of speech containing words and/or phrases for the topic specified by the at least one user-specified condition.

15. The at least one non-transitory computer-readable storage medium of claim 9 , wherein the topic-dependent language model is tailored to recognition of speech containing words and/or phrases for the topic specified by the at least one user-specified condition.

16. The method of claim 1 , wherein accessing the information and causing the virtual assistant executing on the mobile device to perform the at least one corresponding user-specified action are performed proactively by the at least one computer.

17. The method of claim 1 , wherein accessing the information and causing the virtual assistant executing on the mobile device to perform the at least one corresponding user-specified action are not performed in response to receiving, from the mobile device, input from the user related to the topic.

18. The method of claim 1 , further comprising:

in response to processing the first voice input, causing the virtual assistant to present a response to the request for additional information about the topic to the user at least in part by providing the response to the mobile device.

19. The system of claim 5 , wherein the at least one computer is further configured to:

in response to processing the first voice input, causing the virtual assistant to present a response to the request for additional information about the topic to the user at least in part by providing the response to the mobile device.

20. The at least one non-transitory computer-readable storage medium of claim 9 , the method further comprising:

in response to processing the first voice input, causing the virtual assistant to present a response to the request for additional information about the topic to the user at least in part by providing the response to the mobile device.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2023
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065530/0871 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 17, 2023
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065255/0476 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2014
From: HARPER, KENNETH; JARADEH, FARES; QUAST, HOLGER; RADEBAUGH, CAREY; BROWN, SEAN P.
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 031970/0247 →
Cited By (7)
US 12,346,945 US 12,360,738 US 12,361,220 US 12,406,084 US 12,524,809 US 12,572,551 US 12,639,757