IP Library Granted Patent US 9,711,136
Granted Patent B2
US 9,711,136 · App. 15/021,839 · Granted Jul 18, 2017

Speech recognition device and speech recognition method

Inventor: Yusuke Seto (Tokyo, JP)
Assignee: MITSUBISHI ELECTRIC CORPORATION
G10L15/005G06F17/2735G10L15/02G10L15/06G10L15/32G10L25/84G10L25/51
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,711,136
App. No.
15/021,839
Granted
Jul 18, 2017
Kind
B2
Abstract

A speech acquisition unit 1 acquires an original speech uttered freely by a user. A speech data processing unit 7 processes an original speech signal to generate a processed speech signal. An acoustic model switching unit 4 determines one acoustic model from among a plurality of acoustic models 3 - 1 to 3 - x , based on a recognition score for each language in which a speech recognition unit 5 performs a recognition process on time series data on an acoustic feature of the processed speech signal to be calculated by using the acoustic models 3 - 1 to 3 - x for individual languages.

Claims (32)

1. A speech recognition device comprising:

a speech acquirer that acquires a speech to digitize and output the speech as an original speech signal;

a speech data processor that processes the original speech signal to generate a processed speech signal;

an acoustic analyzer that analyzes the original speech signal and the processed speech signal to generate time series data on an acoustic feature;

a plurality of acoustic models corresponding to a plurality of languages each serving as a recognition target;

a speech recognizer that converts the time series data on the acoustic feature of the original speech signal into a speech label string of each language by using the acoustic model for each language to generate a determination dictionary for each language, and that performs a recognition process on the time series data on the acoustic feature of the processed speech signal by using the acoustic model and the determination dictionary for each language to calculate a recognition score for each language; and

an acoustic model switcher that determines one acoustic model from among the plurality of the acoustic models, based on the recognition score for each language calculated by the speech recognizer.

2. The speech recognition device according to claim 1 , wherein

the speech data processor generates a plurality of the processed speech signals for one original speech signal, and

the acoustic model switcher calculates an average value of a plurality of the recognition scores corresponding to the plurality of the processed speech signals for each language, and determines the acoustic model for the language having the largest average value.

3. The speech recognition device according to claim 1 , wherein

the speech data processor generates a plurality of the processed speech signals for one original speech signal, and

the acoustic model switcher compares for each language a plurality of the recognition scores corresponding to the plurality of the processed speech signals with a threshold value, and determines the acoustic model for the language having the largest number of the recognition scores that are not less than the threshold value.

4. The speech recognition device according to claim 2 , wherein

the acoustic model switcher weights for each language the recognition score according to a time when the speech acquirer acquires the original speech signal.

5. The speech recognition device according to claim 3 , wherein

the acoustic model switcher weights the recognition score according to a time when the speech acquirer acquires the original speech signal.

6. The speech recognition device according to claim 1 , wherein

the speech data processor generates the processed speech signal in which an environmental noise is superimposed on the original speech signal.

7. The speech recognition device according to claim 1 , wherein

the speech data processor generates the processed speech signal in which a frequency of the original speech signal is fixed and volume is changed.

8. The speech recognition device according to claim 1 , further comprising a dictionary generator that registers a speech uttered by a user in a user dictionary as a recognition target word of the speech recognizer, wherein

the speech acquirer acquires the speech uttered by the user for registering the speech in the user dictionary, and outputs the acquired speech as the original speech signal.

9. The speech recognition device according to claim 1 , wherein

the speech acquirer acquires the speech uttered by a vehicle occupant, and

the speech data processor generates the processed speech signal in which a noise of the vehicle is superimposed on the original speech signal.

10. A speech recognition method comprising:

processing an original speech signal, which is a digitized speech, to generate a processed speech signal;

analyzing the original speech signal and the processed speech signal to generate time series data on an acoustic feature;

by using a plurality of acoustic models corresponding to a plurality of languages each serving as a recognition target, converting the time series data on the acoustic feature of the original speech signal into a speech label string of each language to generate a determination dictionary for each language;

performing a recognition process on the time series data on the acoustic feature of the processed speech signal by using the acoustic model and the determination dictionary for each language to calculate a recognition score for each language; and

determining one acoustic model from among the plurality of the acoustic models, based on the recognition score for each language.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 15, 2016
From: SETO, YUSUKE
To: MITSUBISHI ELECTRIC CORPORATION
Reel/Frame 037979/0354 →
Continuity (1)
Related Publication 20160240188A1 · Aug 18, 2016