IP Library Granted Patent US 7,617,105
Granted Patent B2
US 7,617,105 · App. 11/140,190 · Granted Nov 10, 2009

Converting text-to-speech and adjusting corpus

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,617,105
App. No.
11/140,190
Granted
Nov 10, 2009
Kind
B2
Abstract

A method for text to speech conversion and for adjusting a corpus. The method includes a text analysis step for parsing the text to obtain descriptive prosody annotations of the text based on a TTS model generated from a first corpus, a prosody parameter prediction step for predicting the prosody parameter of the text according to the result of the text analysis step, a speech synthesis step for synthesizing speech of the text based on the prosody parameter of the text, adjusting according to a target speech speed for the synthesized speech when necessary.

Claims (25)

1. A method for text to speech conversion, comprising:

a text analysis step for parsing the text to obtain descriptive prosody annotations of the text based on a text to speech model generated from a first corpus;

a prosody parameter prediction step for predicting the prosody parameter of the text according to the result of text analysis step; and

a speech synthesis step for synthesizing speech of said text based on said predicted prosody parameter of the text;

Wherein descriptive prosody annotations of the text include prosody structure of the text, the prosody structure of the text is adjusted according to a target speech speed for the synthesized speech,

wherein said descriptive prosody annotations of the text further include pronunciation and accent annotation;

wherein said prosody parameters of the text include the value of pitch, duration and energy;

wherein said prosody structure includes prosody word, prosody phrase and intonation phrase;

wherein said prosody structure of the text is adjusted by adjusting the distribution of the prosody phrase length of the text;

wherein said first corpus has a first distribution of prosody phrase length corresponding to a first threshold for prosody boundary probability under a first speech speed, the distribution of the prosody phrase length of the text is adjusted by the following steps:

adjusting the distribution of the prosody phrase length of the first corpus by adjusting the first threshold for prosody boundary probability; and

carrying out said text analysis step by parsing the text according to the adjusted first corpus, and

further comprising:

acoustically evaluating the synthesized speech of the text; and

adjusting the prosody structure of the text according to the acoustic evaluation result,

wherein said target speech speed corresponds to a second speech speed of a second corpus,

wherein said prosody structure includes prosody phrase, said prosody structure of the text is adjusted by adjusting the distribution of the prosody phrase length of the text to a target distribution,

wherein said first corpus having a first distribution for prosody phrase length corresponding to a first threshold for prosody boundary probability under a first speech speed, said second corpus having a second distribution for prosody phrase length corresponding to a second threshold for prosody boundary probability under said second speech speed, the prosody structure of the text is adjusted by the following steps:

adjusting the first threshold for prosody boundary probability according to the target speech speed, such that the distribution for prosody phrase length of the first corpus matches that of the second corpus; and

carrying out the text analysis step by parsing the text according to the adjusted first corpus, and

wherein the prosody parameter is adjusted according to the target speech speed;

wherein the duration of the prosody parameter is adjusted according to the target speech speed;

wherein the prosody phrase length distribution of the text is adjusted with a curve fitting method;

wherein the prosody phrase length distribution of the text is adjusted by adjusting the distribution of prosody phrase with maximum length or maximum phrase number,

wherein adjusting the prosody structure of the text further comprises adjusting the intonation phrase of the text.

Assignments (8)
RELEASE (REEL 052935 / FRAME 0584) Recorded Jan 2, 2025
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: CERENCE OPERATING COMPANY
Reel/Frame 069797/0818 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REPLACE THE CONVEYANCE DOCUMENT WITH THE NEW ASSIGNMENT PREVIOUSLY RECORDED AT REEL: 050836 FRAME: 0191. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 19, 2022
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 059804/0186 →
SECURITY AGREEMENT Recorded Jun 15, 2020
From: CERENCE OPERATING COMPANY
To: WELLS FARGO BANK, N.A.
Reel/Frame 052935/0584 →
RELEASE OF SECURITY INTEREST Recorded Jun 12, 2020
From: BARCLAYS BANK PLC
To: CERENCE OPERATING COMPANY
Reel/Frame 052927/0335 →
SECURITY AGREEMENT Recorded Nov 7, 2019
From: CERENCE OPERATING COMPANY
To: BARCLAYS BANK PLC
Reel/Frame 050953/0133 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED AT REEL: 050836 FRAME: 0191. ASSIGNOR(S) HEREBY CONFIRMS THE INTELLECTUAL PROPERTY AGREEMENT. Recorded Oct 29, 2019
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 050871/0001 →
INTELLECTUAL PROPERTY AGREEMENT Recorded Oct 23, 2019
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE INC.
Reel/Frame 050836/0191 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 13, 2009
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 022689/0317 →