IP Library Granted Patent US 9,418,674
Granted Patent B2
US 9,418,674 · App. 13/351,317 · Granted Aug 16, 2016

Method and system for using vehicle sound information to enhance audio prompting

Inventors: Eli Tzirkel-Hancock (Ra'Anana, IL); Omer Tsimhoni (Herzliya, IL)
Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
G10L21/003G10L15/20G10L21/057G10L13/04G10L15/19G10L15/22G10L2021/03643
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,418,674
App. No.
13/351,317
Granted
Aug 16, 2016
Kind
B2
Abstract

Sound related vehicle information representing one or more sounds may be received in a processor associated with a vehicle. The sound related vehicle information may or may not include an audio signal. An audio signal output to a passenger may be modified based on the sound related vehicle information.

Claims (40)

1. A method of improving recognizability of a voice command comprising:

capturing a voice command of a vehicle occupant through a microphone, the voice command including background noise associated with vehicle operation;

using information on a vehicle system that relates to sounds in the vehicle to obtain a vehicle parameter describing a state of the vehicle system;

using a vehicular dialogue system to:

construct a digital interference profile including noise type and noise level in accordance with the vehicle parameter describing the state of the vehicle system;

select a pre-trained acoustic model based on the interference profile;

apply the pre-trained acoustic model to the voice command so as to generate a voice command modification having enhanced recognizability, the pre-trained acoustic model generated from supervised learning of records of the noise type and the noise level;

synthesize an audio prompt requesting clarification of the voice command modification, the audio prompt having a modified syllable duration and a modified prompt spectrum in accordance with the interference profile; and

initiate a vehicular action in accordance with the voice command modification.

2. The method of claim 1 , further comprising using a vehicular dialogue system wherein the vehicular dialogue system is further configured to cause text rendered into the audio prompt having a modified syllable duration to be displayed on a display device.

3. The method of claim 2 , wherein the audio prompt has a modified speech rate in accordance with the interference profile.

4. The method of claim 2 , further comprising using the vehicular dialogue system to request a tactile implemented clarification of the voice command modification.

5. The method of claim 2 , further comprising using the vehicular dialogue system to request an audial clarification of the voice command.

6. The method of claim 1 , wherein the vehicle parameter describing a state of the vehicle system indicates a window position.

7. The method of claim 1 , wherein the vehicle parameter describing a state of the vehicle system indicates an engine RPM.

8. The method of claim 1 , wherein the vehicle parameter describing a state of the vehicle system indicates a speed of the vehicle.

9. The method of claim 1 , wherein the vehicle parameter describing a state of the vehicle system indicates a fan setting.

10. The method of claim 1 , wherein the vehicle parameter describing a state of the vehicle system indicates an audio playback level.

11. A system for improving recognizability of a voice command comprising:

a vehicular microphone configured to capture a voice command of a vehicle occupant together with background noise associated with vehicle operation; and

a vehicular dialogue system linked to the microphone, the dialogue system configured to:

use information on a vehicle system that relates to sounds in the vehicle to obtain a vehicle parameter describing a state of the vehicle system;

construct a digital interference profile including noise type parameters and noise level parameters in accordance with the vehicle parameter describing the state of the vehicle system,

select a pre-trained acoustic model based on the interference profile,

apply the pre-trained acoustic model to the voice command so as to generate a voice command modification having enhanced recognizability, the pre-trained acoustic model generated from supervised learning of records of the noise type and the noise level,

synthesize an audio prompt requesting clarification of the voice command modification, the audio prompt having a modified syllable duration and modified prompt spectrum in accordance with the interference profile, and

initiate a vehicular action in accordance with the voice command modification.

12. The system of claim 11 , wherein the vehicular dialogue system is further configured to display text rendered into the audio prompt having a modified syllable duration.

13. The system of claim 12 , wherein the audio prompt has a modified speech rate in accordance with the interference profile.

14. The system of claim 12 , wherein the vehicular dialogue system is further configured to request a tactile implemented clarification of the voice command modification.

15. A method of improving recognizability of a voice command comprising:

capturing a voice command of a vehicle occupant through a microphone positioned within a cabin of the vehicle;

capturing vehicle background noise associated with vehicle operation through a microphone positioned on an exterior to the cabin;

using information on a vehicle system that relates to sounds in the vehicle to obtain a vehicle parameter describing a state of the vehicle system;

using a vehicular dialogue system to:

construct a digital interference profile including noise type and noise level in accordance with the vehicle parameter describing the state of the vehicle system;

select a pre-trained acoustic model based on the interference profile;

apply the pre-trained acoustic model to the voice command so as to generate a voice command modification having enhanced recognizability, the pre-trained acoustic model generated from supervised learning of records of the noise type and the noise level;

synthesize an audio prompt requesting clarification of the voice command modification, the audio prompt having a modified syllable duration in accordance with the interference profile; and

initiate a vehicular action in accordance with the voice command modification.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded Nov 7, 2014
From: WILMINGTON TRUST COMPANY
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 034287/0415 →
SECURITY AGREEMENT Recorded Jun 26, 2013
From: GM GLOBAL TECHNOLOGY OPERATIONS LLC
To: WILMINGTON TRUST COMPANY
Reel/Frame 030694/0500 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 19, 2012
From: TZIRKEL-HANCOCK, ELI; TSIMHONI, OMER
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 028989/0170 →
Continuity (1)
Related Publication 20130185066A1 · Jul 18, 2013