IP Library Granted Patent US 9,123,342
Granted Patent B2
US 9,123,342 · App. 13/560,596 · Granted Sep 1, 2015

Method of recognizing gender or age of a speaker according to speech emotion or arousal

Inventors: Oscal Tzyh-Chiang Chen (Chia-Yi County, TW); Ping-Tsung Lu (Chia-Yi County, TW); Jia-You Ke (Chia-Yi County, TW)
Assignee: NATIONAL CHUNG CHENG UNIVERSITY
G10L17/26G10L25/63
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,123,342
App. No.
13/560,596
Granted
Sep 1, 2015
Kind
B2
Abstract

A method of recognizing gender or age of a speaker according to speech emotion or arousal includes the following steps of A) segmentalizing speech signals into a plurality of speech segments; B) fetching the first speech segment from the plural speech segments to further acquire at least one of emotional features or arousal degree in the speech segment; C) determining whether at least one of the emotional feature and the arousal degree conforms to some condition; if yes, proceed to the step D); if no, return to the step B) and then fetch the next speech segment; D) fetching the feature indicative of gender or age from the speech segment to further acquire at least one feature parameter; and E) recognizing the at least one feature parameter to further determine the gender or age of the speaker at the currently-processed speech segment.

Claims (21)

1. A method of recognizing gender or age of a speaker according to speech emotion or arousal, comprising steps of:

A) segmentalizing speech signals into a plurality of speech segments;

B) fetching the first speech segment from the speech segments to further acquire an arousal degree of the speech segment;

B-1) after the first speech segment is fetched from the speech segments, applying a first classification to the arousal degree of the speech segment to enable the arousal to be classified as a high degree or a low degree of arousal;

C) if a determination condition is set at a greater-than-threshold condition, proceeding the step D) when the arousal degree of the speech segment is determined greater than the specific threshold, or returning to the step B) when the arousal degree of the speech segment is determined less than or equal to the specific threshold; and

if the determination condition is set at a less-than-threshold condition, proceeding to step D) when the arousal degree of the speech segment is determined less than the specific threshold, or returning to the step B) when the arousal degree of the speech segment is determined greater than or equal to the specific threshold;

D) fetching a feature indicative of gender or age from the speech segment to further acquire at least one feature parameter corresponding to gender or age; and

E) applying recognition to the at least one feature parameter according to a gender or age recognition measure to further determine the gender or age of the speaker in the currently-processed speech segment; next, apply the step B) to the next speech segment, wherein

the steps A)-E) are executed by a computer.

2. The method as defined in claim 1 , wherein speech signals in the step A) is segmentalized by a segmentation unit.

3. The method as defined in claim 1 , wherein in the step B), the first speech segment is fetched by a first acquisition unit and the first classification is done via a first classifier.

4. The method as defined in claim 1 , wherein in the step C), the arousal is the presentation of degree of the excitement.

5. The method as defined in claim 1 , wherein in the step C), whether the arousal degree of the speech segment is greater or less than a specific threshold is determined by a determination unit.

6. The method as defined in claim 1 , wherein in the step D), after at least one feature parameter is acquired, apply a second classification to the at least one feature parameter.

7. The method as defined in claim 6 , wherein in the step D), the at least one feature parameter is fetched via a parameter acquisition unit and the second classification is done via a second classifier.

8. The method as defined in claim 6 wherein in the step E), the gender or age recognition measure is based on the at least one feature parameter and then to determine the gender or age of the speaker according to the at least one feature parameter.

9. The method as defined in claim 8 , wherein in the step E), when multiple feature parameters are considered, the feature parameters are integrated and used to recognize the gender or age of the speaker.

10. The method as defined in claim 6 , wherein in the step D), whether the at least one feature parameter is remarkable or not in time domain or frequency domain is determined by whether it is greater than a specific mean or a specific standard deviation, where the mean and standard deviation of the feature parameter are computed from speech signals of multiple speakers.

11. The method as defined in claim 1 , wherein the at least one feature parameter is one of spectral centroid (SC), spectral spread (SS), zero crossing rate (ZCR), duration fast Fourier transformation (FFT) coefficients, jitter, and fundamental frequency (F 0 ); when the at least one feature parameter is plural in number, each of the feature parameters is one of SC, SS, ZCR, FFT coefficients, jitter, and FO and the feature parameters are different from each other.

12. The method as defined in claim 11 , wherein SC, SS, FFT coefficients, jitter, and F 0 belong to the frequency domain, and ZCR and duration belong to the time domain.

13. The method as defined in claim 11 , wherein SC, SS, ZCR, duration, FFT coefficients, and jitter are adopted for age recognition; F 0 and FFT coefficients are adopted for gender recognition.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2012
From: CHEN, OSCAL TZYH-CHIANG; LU, PING-TSUNG; KE, JIA-YOU
To: NATIONAL CHUNG CHENG UNIVERSITY
Reel/Frame 028661/0477 →
Priority Claims (1)
TW 101112660 A · Apr 10, 2012 · national
Continuity (1)
Related Publication 20130268273A1 · Oct 10, 2013