IP Library Granted Patent US 10,490,194
Granted Patent B2
US 10,490,194 · App. 14/873,441 · Granted Nov 26, 2019

Speech processing apparatus, speech processing method and computer-readable medium

Inventors: Hitoshi Yamamoto (Tokyo, JP); Takafumi Koshinaka (Tokyo, JP)
Assignee: NEC Corporation
G10L17/02G10L15/075G10L25/30G10L25/63
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,490,194
App. No.
14/873,441
Granted
Nov 26, 2019
Kind
B2
Abstract

A speech processing apparatus, method and non-transitory computer-readable storage medium are disclosed. A speech processing apparatus may include a memory storing instructions, and at least one processor configured to process the instructions to calculate an acoustic diversity degree value representing a degree of variation in types of sounds included in a speech signal representing a speech, on a basis of the speech signal, and compensate for a recognition feature value calculated to recognize specific attribute information from the speech signal, using the acoustic diversity degree value.

Claims (62)

1. A speech processing apparatus, comprising:

a memory storing instructions; and

at least one processor configured to process the instructions to perform steps including:

calculating distribution of types of sounds included in a speech signal by using a speech model configured to identify the types of sounds represented by the speech signal, wherein the types of sounds represent sound's classes clustered based on similarity of the sounds;

calculating an acoustic diversity degree representing a degree of appearance of each of the types of sounds included in the speech signal;

calculating a recognition feature to recognize an attribute of the speaker;

compensating for the recognition feature so as to have a smaller bias of the types of sounds in the speech signal, by using the acoustic diversity degree value;

generating a recognition result based on the compensated recognition feature; and

transmitting the recognition result.

2. The speech processing apparatus according to claim 1 , wherein the types of sounds are types of phonemes.

3. The speech processing apparatus according to claim 1 , wherein the at least one processor is further configured to process the instructions to perform steps including:

calculating the degree of appearance of each of the types of sounds by using the speech model; and

calculating the acoustic diversity degree value by using the degree of appearance;

wherein the degree of appearance represents distribution of the types of sounds included in the speech signal.

4. The speech processing apparatus according to claim 1 , wherein the at least one processor is further configured to process the instructions to perform steps including:

calculating the compensated recognition feature of the speech signal based on an acoustic diversity degree, a recognition feature of each of at least one first speech signal, and a recognition feature of each of at least one second speech signal.

5. The speech processing apparatus according to claim 4 , wherein the first speech signal includes one or more speech signals obtained by segmenting the at least one second speech signal.

6. The speech processing apparatus according to claim 4 , wherein the at least one processor is further configured to process the instructions to perform steps including:

compensating for the recognition feature of the speech signal by using a neural network.

7. The speech processing apparatus according to claim 1 , wherein the at least one processor is further configured to process the instructions to perform steps including:

recognizing the attribute of the speaker based on the speech signal,

wherein the attribute represents at least one of information indicating the speaker, a language spoken by the speaker, an emotional expression included in the speech signal, and a character of a speaker wherein the character is assumed from the speech signal.

8. A speech processing method comprising:

calculating, using at least one processor, distribution of types of sounds included in a speech signal by using a speech model configured to identify the types of sounds represented by the speech signal, wherein the types of sounds represent sound's classes clustered based on similarity of the sounds;

calculating, using the at least one processor, an acoustic diversity degree representing a degree of appearance of each of the types of sounds included in the speech signal;

calculating a recognition feature to recognize an attribute of the speaker;

compensating for the recognition feature so as to have a smaller bias of the types of sounds in the speech signal, using the at least one processor, by using the acoustic diversity degree value;

generating a recognition result based on the compensated recognition feature; and

transmitting the recognition result.

9. The speech processing method of claim 8 , wherein the types of sounds are types of phonemes.

10. The speech processing method of claim 8 , further comprising:

calculating the degree of appearance of each of the types of sounds by using the speech model; and

calculating the acoustic diversity degree value by using the degree of appearance;

wherein the degree of appearance represents distribution of the types of sounds included in the speech signal.

11. The speech processing method of claim 8 , further comprising:

calculating the compensated recognition feature of the speech signal based on an acoustic diversity degree, a recognition feature of each of at least one first speech signal, and a recognition feature of each of at least one second speech signal.

12. The speech processing method of claim 11 , wherein the first speech signal includes one or more speech signals obtained by segmenting the at least one second speech signal.

13. The speech processing method of claim 11 , further comprising:

compensating for the recognition feature of the speech signal by using a neural network.

14. The speech processing method of claim 8 , further comprising:

recognizing the attribute of the speaker based on the speech signal,

wherein the attribute represents at least one of information indicating the speaker, a language spoken by the speaker, an emotional expression included in the speech signal, and a character of a speaker wherein the character is assumed from the speech signal.

15. A non-transitory computer-readable storage medium storing instructions that when executed by a computer enable the computer to implement a method comprising:

calculating, using at least one processor, distribution of types of sounds included in a speech signal using a speech model configured to identify the types of sounds represented by the speech signal, wherein the types of sounds represent sound's classes clustered based on similarity of the sounds;

calculating, using the at least one processor, an acoustic diversity degree representing a degree of appearance of each of the types of sounds included in the speech signal;

calculating a recognition feature to recognize an attribute of the speaker;

compensating for the recognition feature so as to have a smaller bias of the types of sounds in the speech signal, using the at least one processor, by using the acoustic diversity degree value;

generating a recognition result based on the compensated recognition feature; and

transmitting the recognition result.

16. The non-transitory computer-readable storage medium according to claim 15 , wherein the types of sounds are types of phonemes.

17. The non-transitory computer-readable storage medium according to claim 15 , wherein the method further comprises:

calculating the degree of appearance of each of the types of sounds by using the speech model; and

calculating the acoustic diversity degree value by using the degree of appearance;

wherein the degree of appearance represents distribution of the types of sounds included in the speech signal.

18. The non-transitory computer-readable storage medium according to claim 15 , wherein the method further comprises:

calculating the compensated recognition feature of the speech signal based on an acoustic diversity degree, a recognition feature of each of at least one first speech signal, and a recognition feature of each of at least one second speech signal.

19. The non-transitory computer-readable storage medium according to claim 18 , wherein the first speech signal includes one or more speech signals obtained by segmenting the at least one second speech signal.

20. The non-transitory computer-readable storage medium according to claim 18 , wherein the method further comprises:

compensating for the recognition feature of the speech signal by using a neural network.

21. The non-transitory computer-readable storage medium according to claim 15 , wherein the method further comprises:

recognizing the attribute of the speaker based on the speech signal,

wherein the attribute represents at least one of information indicating the speaker, a language spoken by the speaker, an emotional expression included in the speech signal, and a character of a speaker wherein the character is assumed from the speech signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 2, 2015
From: YAMAMOTO, HITOSHI; KOSHINAKA, TAKAFUMI
To: NEC CORPORATION
Reel/Frame 036713/0709 →
Priority Claims (1)
JP 2014-204585 · Oct 3, 2014 · national
Continuity (1)
Related Publication 20160098993A1 · Apr 7, 2016
Cited By (1)
US 12,217,767