IP Library Granted Patent US 9,396,727
Granted Patent B2
US 9,396,727 · App. 14/094,110 · Granted Jul 19, 2016

Systems and methods for spoken dialog service arbitration

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,396,727
App. No.
14/094,110
Granted
Jul 19, 2016
Kind
B2
Abstract

Systems and methods for arbitrating spoken dialog services include determining a capability catalog associated with a plurality of devices accessible within an environment. The capability catalog includes a list of the plurality of devices mapped to a list of spoken dialog services provided by each of the plurality of devices. The system arbitrates between the plurality of devices and the spoken dialog services in the capability catalog to determine a selected device and a selected dialog service.

Claims (52)

1. A method for arbitrating spoken dialog services, the method comprising:

determining, with an arbitration module that includes a processor, a capability catalog associated with a plurality of devices accessible within an environment, the capability catalog including a list of the plurality of devices mapped to a list of spoken dialog services provided by each of the plurality of devices;

receiving, with a speech understanding module that includes a processor, a spoken utterance from a user within the environment;

arbitrating, with an arbitration module that includes a processor, between the plurality of devices and the spoken dialog services in the capability catalog to determine a selected device and a selected dialog service; and

processing the spoken utterance with the selected spoken dialog service on the selected device.

2. The method of claim 1 , wherein the arbitrating includes:

classifying the spoken utterance to determine a set of candidate devices from the plurality of devices and a set of spoken dialog services based on the capability catalog; and

determining the selected device from the set of candidate devices and the selected spoken dialog service from the list of candidate spoken dialog services based on a verification criterion.

3. The method of claim 2 , wherein the verification criterion comprises a confidence level associated with the classification of the spoken utterance.

4. The method of claim 2 , further comprising performing the classifying of the spoken dialog service in conjunction with at least one of training data associated with past classification performance and user behavior.

5. The method of claim 1 , further including determining the selected device and the selected spoken dialog service based on supplemental information requested from the user.

6. The method of claim 1 , wherein the environment is a vehicle environment, and the plurality of devices includes at least one of: a mobile device removeably located within the vehicle environment, a device incorporated into the vehicle environment, and a device comprising a network server remote from the vehicle environment.

7. The method of claim 2 , further including:

forwarding the spoken utterance to a first spoken dialog service and a second spoken dialog service within the capability catalog;

receiving, from the first spoken dialog service, a first confidence score associated with recognition of the spoken utterance;

receiving, from the second spoken dialog service, a second confidence score associated with recognition of the spoken utterance; and

determining the verification criterion based at least in part on the first and second confidence scores.

8. The method of claim 1 , further including:

specifying default settings associated with the plurality of devices and the spoken dialog services; and

modifying the default settings based on user behavior.

9. A system for spoken dialog arbitration, the system comprising:

a speech understanding module, including a processor, configured to process a speech utterance received from a user within an environment;

an arbitration module, including a processor, communicatively coupled to the speech understanding module, the arbitration module configured to determine a capability catalog associated with a plurality of devices accessible within the environment, the capability catalog including a list of the plurality of devices mapped to a list of spoken dialog services provided by each of the plurality of devices; receive the spoken utterance; arbitrate between the plurality of devices and the spoken dialog services in the capability catalog to determine a selected device and a selected dialog service; and processing the spoken utterance with the selected spoken dialog service on the selected device.

10. The system of claim 9 , wherein the arbitration module is configured to:

classify the spoken utterance to determine a set of candidate devices from the plurality of devices and a set of spoken dialog services based on the capability catalog; and

determine the selected device from the set of candidate devices and the selected spoken dialog service from the list of candidate spoken dialog services based on a verification criterion.

11. The system of claim 10 , wherein the verification criterion comprises a confidence level associated with the classification of the spoken utterance.

12. The system of claim 10 , wherein the arbitration module performs the classifying of the spoken dialog service in conjunction with at least one of training data associated with past classification performance and user behavior.

13. The system of claim 10 , wherein the arbitration module is configured to:

forward the spoken utterance to a first spoken dialog service and a second spoken dialog service within the capability catalog;

receive, from the first spoken dialog service, a first confidence score associated with recognition of the spoken utterance;

receive, from the second spoken dialog service, a second confidence score associated with recognition of the spoken utterance; and

determine the verification criterion based at least in part on the first and second confidence scores.

14. The system of claim 9 , wherein the arbitration module is configured to:

specify default settings associated with the plurality of devices and the spoken dialog services; and

modify the default settings based on user behavior.

15. An arbitration method comprising:

determining, with an arbitration module that includes a processor, a capability catalog associated with a plurality of devices accessible within a vehicle, the capability catalog including a list of the plurality of devices mapped to a list of spoken dialog services provided by each of the plurality of devices;

receiving, with a speech understanding module that includes a processor, the spoken utterance;

arbitrating, with an arbitration module that includes a processor, between the plurality of devices and the spoken dialog services in the capability catalog to determine a selected device and a selected dialog service, wherein the arbitrating includes classifying the spoken utterance to determine a set of candidate devices from the plurality of devices and a set of spoken dialog services based on the capability catalog, and determining the selected device from the set of candidate devices and the selected spoken dialog service from the list of candidate spoken dialog services based on a verification criterion; and

processing the spoken utterance with the selected spoken dialog service on the selected device.

16. The method of claim 15 , wherein the steps of receiving the first confidence score from the first spoken dialog service and receiving the second confidence score from the second spoken dialog service is followed by one or more steps of prompting the user for additional input and providing the additional user utterances to both services concurrently, and selecting one of the services when the confidence returned by that service is sufficiently higher than that of the other service.

17. The method of claim 15 , wherein the verification criterion comprises a confidence level associated with the classification of the spoken utterance.

18. The method of claim 15 , further comprising performing the classifying of the spoken dialog service in conjunction with at least one of training data associated with past classification performance and user behavior.

19. The method of claim 15 , further including:

specifying default settings associated with the plurality of devices and the spoken dialog services; and

modifying the default settings based on user behavior.

20. The method of claim 15 , further including:

forwarding the spoken utterance to a first spoken dialog service and a second spoken dialog service within the capability catalog;

receiving, from the first spoken dialog service, a first confidence score associated with recognition of the spoken utterance;

receiving, from the second spoken dialog service, a second confidence score associated with recognition of the spoken utterance; and

determining the verification criterion based at least in part on the first and second confidence scores.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded Nov 7, 2014
From: WILMINGTON TRUST COMPANY
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 034189/0065 →
SECURITY INTEREST Recorded Jun 12, 2014
From: GM GLOBAL TECHNOLOGY OPERATIONS LLC
To: WILMINGTON TRUST COMPANY
Reel/Frame 033135/0440 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2013
From: TZIRKEL-HANCOCK, ELI; LINDEMANN, GREG T.; SIMS, ROBERT D., III; TSIMHONI, OMER
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 031748/0090 →