IP Library › Granted Patent US 9,934,780
Granted Patent B2
US 9,934,780 · App. 13/351,315 · Granted Apr 3, 2018

Method and system for using sound related vehicle information to enhance spoken dialogue by modifying dialogue's prompt pitch

Inventors: Eli Tzirkel-Hancock (Ra'Anana, IL); Omer Tsimhoni (Herzliya, IL)
Assignee: GM Global Technology Operations LLC
G10L15/22G10L21/00G10L15/20G10L21/0208G10L2015/226G10L2021/02165
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,934,780
App. No.
13/351,315
Granted
Apr 3, 2018
Kind
B2
Abstract

Sound related vehicle information representing one or more sounds may be received in the processor. The sound related vehicle information may or may not include an audio signal. Spoken dialog of a spoken dialog system associated with the vehicle based on the sound related vehicle information may be modified. The said modification comprises of modifying pitch, pace and timing of audio prompts associated with the said spoken dialog based on the sound related vehicle information.

Claims (66)

1. A method comprising:

receiving, in a processor associated with a vehicle, sound related vehicle information representing one or more sounds, the sound related vehicle information measured an exterior microphone located exterior to a cabin of the vehicle;

and modifying spoken dialogue of a spoken dialogue system associated with the vehicle based on the sound related vehicle information;

comprising determining interference profile records based on the sound related vehicle information;

wherein modifying spoken dialogue of the spoken dialogue system associated with the vehicle based on the sound related vehicle information comprises:

modifying pace and timing and pitch of audio prompts based on the interference profile records;

and outputting the modified audio prompts.

2. The method of claim 1 , wherein modifying spoken dialogue of the spoken dialogue system associated with the vehicle based on the sound related vehicle information comprises:

determining introductory audio prompts based on the interference profile records; and

outputting the introductory audio prompts to a user.

3. The method of claim 1 , wherein modifying spoken dialogue of the spoken dialogue system associated with the vehicle based on the sound related vehicle information comprises:

modifying dialogue style to reduce grammar perplexity based on the interference profile records.

4. The method of claim 1 , wherein modifying spoken dialogue of the spoken dialogue system associated with the vehicle based on the sound related vehicle information comprises:

monitoring user confusion; and

outputting audio prompts responding to the user confusion.

5. The method of claim 1 , wherein modifying spoken dialogue of the spoken dialogue system associated with the vehicle based on the sound related vehicle information comprises:

modifying multi-modal dialogue based on the interference profile records.

6. The method of claim 1 , comprising:

measuring a success of modifying the spoken dialogue based on the sound related vehicle information in increasing dialogue success; and

adapting modification of the spoken dialogue based on the measured success.

7. The method of claim 1 , wherein the external microphone is located in an exterior location selected from a group consisting of:

a vehicle body;

a vehicle bumper;

a vehicle trunk; and

a vehicle windshield.

8. A system for a vehicle, the system comprising:

a memory;

an exterior microphone located exterior to a cabin of the vehicle for measuring sound-related information,

a processor associated with the vehicle to:

receive, in the processor associated with the vehicle, sound related vehicle information representing one or more sounds measured by the exterior microphone;

and modify spoken dialogue of a spoken dialogue system associated with the vehicle based on the sound related vehicle information;

wherein the processor is to determine interference profile records based on the sound related vehicle information;

wherein to modify spoken dialogue of the spoken dialogue system associated with the vehicle based on the sound related vehicle information the processor is to: modify pace and timing and pitch of audio prompts based on the interference profile records;

and output the modified audio prompts.

9. The system of claim 8 , wherein to modify spoken dialogue of the spoken dialogue system associated with the vehicle based on the sound related vehicle information the processor is to:

determine introductory audio prompts based on the interference profile records; and

output the introductory audio prompts to a user.

10. The system of claim 8 , wherein to modify spoken dialogue of the spoken dialogue system associated with the vehicle based on the sound related vehicle information the processor is to:

modify dialogue style to reduce grammar perplexity based on the interference profile records; and

output modified prompts.

11. The system of claim 8 , wherein to modify spoken dialogue of the spoken dialogue system associated with the vehicle based on the sound related vehicle information the processor is to:

monitor user confusion; and

output audio prompts responding to the user confusion.

12. The system of claim 8 , wherein to modify spoken dialogue of the spoken dialogue system associated with the vehicle based on the sound related vehicle information the processor is to:

modify multi-modal dialogue based on the interference profile records.

13. The system of claim 8 , wherein the processor is to:

measure a success of the spoken dialogue modification based on the sound related vehicle information in increasing dialogue success; and

adapt the spoken dialogue modification based on the measured success.

14. The system of claim 8 , wherein the external microphone is located in an exterior location selected from a group consisting of:

a vehicle body;

a vehicle bumper;

a vehicle trunk; and

a vehicle windshield.

15. A method comprising:

receiving, at a controller associated with a spoken dialogue system, information related to the operation of vehicle systems causing sound and measured by an exterior microphone located exterior to a vehicle cabin;

calculating interference profile records based on the information, the interference profile records representing noise types and noise levels; and

altering dialogue control based on the interference profile records;

wherein altering dialogue control based on the interference profile records comprises:

delaying and modifying pitch, pace and timing of an audio prompt output from the spoken dialogue system based on the interference profile records.

16. The method of claim 15 , wherein altering dialogue control based on the interference profile records comprises reducing confidence levels associated with a semantic interpreter.

17. The method of claim 15 , wherein altering dialogue control based on the interference profile records comprises modifying a backend application associated the spoken dialogue system based on the interference profile records.

18. The method of claim 15 , wherein the external microphone is located in an exterior location selected from a group consisting of:

a vehicle body;

a vehicle bumper;

a vehicle trunk; and

a vehicle windshield.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded Nov 7, 2014
From: WILMINGTON TRUST COMPANY
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 034287/0415 →
SECURITY AGREEMENT Recorded Jun 26, 2013
From: GM GLOBAL TECHNOLOGY OPERATIONS LLC
To: WILMINGTON TRUST COMPANY
Reel/Frame 030694/0500 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 19, 2012
From: TZIRKEL-HANCOCK, ELI; TSIMHONI, OMER
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 028989/0576 →
Continuity (1)
Related Publication 20130185078A1 · Jul 18, 2013