IP Library Granted Patent US 11,640,831
Granted Patent B2
US 11,640,831 · App. 17/612,349 · Granted May 2, 2023

Evaluation apparatus, training apparatus, methods and programs for the same

Inventors: Yasufumi Uezu (Tokyo, JP); Sadao Hiroya (Tokyo, JP); Takemi Mochida (Tokyo, JP)
Assignee: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
G10L25/60G10L15/063G10L21/003G10L21/013G10L21/0364G10L21/14G10L25/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,640,831
App. No.
17/612,349
Granted
May 2, 2023
Kind
B2
Abstract

An evaluation device applies a lowpass filter with a cutoff frequency being a first predetermined value or a second predetermined value greater than the first predetermined value with or without change of feedback formant frequencies which are formant frequencies of a picked-up speech signal, converts the picked-up speech signal, feeds back the converted speech signal to a subject, and includes an evaluation unit that calculates a compensatory response vector by using pickup formant frequencies which are formant frequencies of a speech signal acquired by picking up an utterance made by the subject while feeding back a speech signal that has been converted with change of the feedback formant frequencies to the subject, and pickup formant frequencies which are formant frequencies of a speech signal acquired by picking up an utterance made by the subject while feeding back a speech signal that has been converted without change of the feedback formant frequencies to the subject, and determines an evaluation based on a compensatory response vector for each cutoff frequency.

Claims (28)

1. An evaluation device comprising:

a signal analyzer configured to analyze a picked-up speech signal, and determine a first formant frequency and a second formant frequency;

a convertor configured to apply a lowpass filter with a cutoff frequency being a first predetermined value or a second predetermined value greater than the first predetermined value with or without change of feedback formant frequencies which are formant frequencies of the picked-up speech signal, and convert the picked-up speech signal;

a feedback feeder configured to feed back the converted speech signal to a subject; and

an evaluator configured to determine a compensatory response vector by using pickup formant frequencies which are formant frequencies of a speech signal acquired by picking up an utterance made by the subject while feeding back a speech signal that has been converted with change of the feedback formant frequencies to the subject, and pickup formant frequencies which are formant frequencies of a speech signal acquired by picking up an utterance made by the subject while feeding back a speech signal that has been converted without change of the feedback formant frequencies to the subject, and determine an evaluation based on a compensatory response vector for each cutoff frequency.

2. The evaluation device according to claim 1 , wherein the cutoff frequency is between 3 kHz and 8 kHz.

3. The evaluation device according to claim 1 , further comprising:

a display configured to display a combination of the first formant frequency and the second formant frequency.

4. An evaluation method comprising:

analyzing, by a signal analyzer, a picked-up speech signal and determining a first formant frequency and a second formant frequency;

applying, by a convertor, a lowpass filter with a cutoff frequency being a first predetermined value or a second predetermined value greater than the first predetermined value with or without change of feedback formant frequencies which are formant frequencies of the picked-up speech signal;

converting, by the convertor, the picked-up speech signal;

feeding back, by a feedback feeder, the converted speech signal to a subject; and

determining, by an evaluator, a compensatory response vector by using pickup formant frequencies which are formant frequencies of a speech signal acquired by picking up an utterance made by the subject while feeding back a speech signal that has been converted with change of the feedback formant frequencies to the subject, and pickup formant frequencies which are formant frequencies of a speech signal acquired by picking up an utterance made by the subject while feeding back a speech signal that has been converted without change of the feedback formant frequencies to the subject; and

determining, by the evaluator, an evaluation based on a compensatory response vector for each cutoff frequency.

5. The evaluation method according to claim 4 , wherein the cutoff frequency is between 3 kHz and 8 kHz.

6. The evaluation method according to claim 4 , further comprising:

displaying a combination of the first formant frequency and the second formant frequency.

7. A training method comprising:

analyzing, by an analyzer, a picked-up speech signal and determining a first formant frequency and a second formant frequency;

applying, by a convertor, a lowpass filter with a cutoff frequency being a first predetermined value with or without change of feedback formant frequencies which are formant frequencies of the picked-up speech signal, and converting the picked-up speech signal;

feeding back, by a feed back feeder, the converted speech signal to a subject;

determining, by an evaluator, a compensatory response vector by using pickup formant frequencies which are formant frequencies of a speech signal acquired by picking up an utterance made by the subject while feeding back a speech signal that has been converted with change of the feedback formant frequencies to the subject, and pickup formant frequencies which are formant frequencies of a speech signal acquired by picking up an utterance made by the subject while feeding back a speech signal that has been converted without change of the feedback formant frequencies to the subject; and

determining, by the evaluator, an evaluation based on the compensatory response vector and a correct compensatory response vector,

wherein whether to make the subject conduct utterance training with a same utterance content repeatedly or not is determined based on a relation of magnitude between the evaluation and a predetermined threshold.

8. The training method according to claim 7 , wherein the cutoff frequency is between 3 kHz and 8 kHz.

9. The training method according to claim 7 , further comprising:

displaying a combination of the first formant frequency and the second formant frequency.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 18, 2021
From: UEZU, YASUFUMI; HIROYA, SADAO; MOCHIDA, TAKEMI
To: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
Reel/Frame 058151/0473 →
Continuity (1)
Related Publication 20220270635A1 · Aug 25, 2022