IP Library › Granted Patent US 10,535,335
Granted Patent B2
US 10,535,335 · App. 15/256,220 · Granted Jan 14, 2020

Voice synthesizing device, voice synthesizing method, and computer program product

Inventors: Kouichirou Mori (Kawasaki Kanagawa, JP); Yamato Ohtani (Kawasaki Kanagawa, JP)
Assignees: Kabushiki Kaisha Toshiba; Toshiba Digital Solutions Corporation
G10L13/033
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,535,335
App. No.
15/256,220
Granted
Jan 14, 2020
Kind
B2
Abstract

According to one embodiment, a voice synthesizing device includes a first operation receiving unit, a score transforming unit, and a voice synthesizing unit. The first operation receiving unit configured to receive a first operation specifying voice quality of a desired voice based on one or more upper level expressions indicating the voice quality. The score transforming unit configured to transform, based on a score transformation model that transforms a score of the upper level expression into a score of a lower level expression which is less abstract than the upper level expression, the score of the upper level expression corresponding to the first operation into a score of one or more lower level expressions. The voice synthesizing unit configured to generate a synthetic sound corresponding to a certain text based on the score of the lower level expression.

Claims (42)

1. A voice synthesizing device comprising:

a first operation receiving unit configured to receive a first user operation specifying voice quality of a desired voice based on one or more upper level expressions;

a score transforming unit configured to transform a score vector of the upper level-expressions corresponding to the first user operation into a score vector of one or more lower level expressions that are closer to parameters of an acoustic model than the upper level expressions are to the parameters;

a second operation receiving unit configured to receive a second user operation to change the score vector of the lower level expressions resulting from the transformation; and

a voice synthesizing unit configured to generate a synthetic sound corresponding to a certain text based on the score vector of the lower level expressions resulting from transformation, wherein

when the second user operation is received by the second operation receiving unit, the voice synthesizing unit generates the synthetic sound based on the score vector of the lower level expressions changed based on the second user operation.

2. The voice synthesizing device according to claim 1 , further comprising

a display control unit configured to cause a display device to display an edit screen that exhibits a score of a lower level expression that is an element of the score vector of the lower level expressions resulting from the transformation and receives the second user operation, wherein

the second operation receiving unit receives the second user operation input on the edit screen.

3. The voice synthesizing device according to claim 2 , further comprising

a range calculating unit configured to calculate a range of the score of the lower level expression capable of maintaining a characteristic of the voice quality specified by the first user operation, wherein

the display control unit causes the display device to display the edit screen that exhibits the score of the lower level expression together with the range.

4. The voice synthesizing device according to claim 2 , further comprising

a direction calculating unit configured to calculate a direction of changing the score of the lower level expression so as to enhance a characteristic of the voice quality specified by the first user operation and a degree of enhancement, wherein

the display control unit causes the display device to display the edit screen that exhibits the score of the lower level expression together with the direction and the degree of enhancement.

5. The voice synthesizing device according to claim 2 , further comprising

a range calculating unit configured to calculate a range of the score of the lower level expression capable of maintaining a characteristic of the voice quality specified by the first user operation; and

a setting unit configured to randomly set the score of the lower level expression within the range based on the second user operation.

6. The voice synthesizing device according to claim 2 , wherein

the display control unit causes the display device to display the edit screen including a first area that receives the first user operation and a second area that exhibits a score of the lower level expression that is an element of the score vector of the lower level expressions resulting from the transformation and that receives the second user operation,

the first operation receiving unit receives the first user operation input on the first area, and

the second operation receiving unit receives the second user operation input on the second area.

7. The voice synthesizing device according to claim 1 , wherein the voice synthesizing unit generates the synthetic sound corresponding to the score vector of the lower level expressions resulting from the transformation using the acoustic model.

8. The voice synthesizing device according to claim 1 , further comprising

a model storage unit configured to retain a score transformation model that is used for transforming a score vector of one or more upper level expressions into a score vector of one or more lower level expressions, wherein

the score transforming unit transforms the score vector of the upper level expressions corresponding to the first user operation into the score vector of the lower level expressions based on the score transformation model retained in the model storage unit.

9. The voice synthesizing device according to claim 1 , wherein the score transformation model is a statistical model obtained by learning using, as learning data, a score vector of one or more upper level expressions and a score vector of one or more lower level expressions acquired as a result of evaluation of a certain voice.

10. The voice synthesizing device according to claim 9 , further comprising a model learning unit configured to learn the score transformation model, using the score vector of the upper level expressions and the score vector of the lower level expressions acquired as the result of evaluation of the certain voice, as the learning data.

11. The voice synthesizing device according to claim 1 , wherein the upper level expressions include at least one of calm, intellectual, gentle, cute, elegant, and fresh.

12. A voice synthesizing method performed by a voice synthesizing device, the voice synthesizing method comprising:

receiving a first user operation specifying voice quality of a desired voice based on one or more upper level expressions;

transforming a score vector of the upper level expressions corresponding to the first user operation into a score vector of one or more lower level expressions that are closer to parameters of an acoustic model than the upper level expressions are to the parameters; and

generating a synthetic sound corresponding to a certain text based on the score vector of the lower level expressions resulting from transformation, wherein

when a second user operation to change the score vector of the lower level expressions resulting from the transformation is received, the generating generates the synthetic sound based on the score vector of the lower level expressions changed based on the second user operation.

13. The voice synthesizing method according to claim 12 , wherein the upper level expressions include at least one of calm, intellectual, gentle, cute, elegant, and fresh.

14. A computer program product having a non-transitory computer readable medium including programmed instructions, wherein the instructions, when executed by a computer, cause the computer to perform:

a function of receiving a first user operation specifying voice quality of a desired voice based on one or more upper level expressions;

a function of transforming a score vector of the upper level expressions corresponding to the first user operation into a score vector of one or more lower level expressions that are closer to parameters of an acoustic model than the upper level expressions are to the parameters;

a function of receiving a second user operation to change the score vector of the lower level expressions resulting from the transformation; and

a function of generating a synthetic sound corresponding to a certain text based on the score vector of the lower level expressions resulting from transformation, wherein

when the second user operation is received, the function of generating the synthetic sound generates the synthetic sound based on the score vector of the lower level expressions changed based on the second user operation.

15. The computer program product according to claim 14 , wherein the upper level expressions include at least one of calm, intellectual, gentle, cute, elegant, and fresh.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 9, 2019
From: KABUSHIKI KAISHA TOSHIBA
To: TOSHIBA DIGITAL SOLUTIONS CORPORATION
Reel/Frame 050671/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2016
From: MORI, KOUICHIROU; OHTANI, YAMATO
To: KABUSHIKI KAISHA TOSHIBA
Reel/Frame 040309/0738 →
Priority Claims (1)
JP 2015-181038 · Sep 14, 2015 · national
Continuity (1)
Related Publication 20170076714A1 · Mar 16, 2017