Method and system for generating synthetic speech for text through user interface

1. A method for generating a synthetic speech for text through a user interface, the method comprising:

receiving a plurality of sentences;

displaying the plurality of sentences in a first font style on the user interface;

determining a speech style characteristic for the received plurality of sentences, wherein the determining the speech style characteristic for the received plurality of sentences includes determining the speech style characteristic for a set of sentences among the plurality of sentences as a specific speech style characteristic;

receiving a change of a font style of text for a part of the set of sentences being displayed from the first font style to a second font style through the user interface;

in response to receiving the change of the font style of text for the part of the set of sentences from the first font style to the second font style through the user interface:

displaying the text for the part of the set of sentences in the second font style; and

modifying the part of detailed characteristics of the specific speech style characteristic for the part of the set of sentences to obtain a modified specific speech style characteristic based on the change of the font style, wherein other part of the detailed characteristics of the specific speech style characteristic for remaining part of the set of sentences are maintained;

obtaining an embedding vector related to the specific speech style characteristics;

obtaining another embedding vector related to the modified specific speech style characteristics;

outputting a synthetic speech for the part of the set of sentences based on the another embedding vector and another character embeddings generated based on the part of the set of sentences; and

outputting another synthetic speech for the remaining part of the set of sentences based on the embedding vector and character embeddings generated based on the remaining part of the set of sentences,

wherein the determined speech style characteristic for the set of sentences includes the modified detailed characteristics for the part of the set of sentences and original detailed characteristics for other part of the set of sentences, and

the plurality of sentences and the determined speech style characteristic are inputted to an artificial neural network text-to-speech synthesis model and the synthetic speech is generated based on speech data outputted from the artificial neural network text-to-speech synthesis model.

2. The method of claim 1 , further comprising outputting the received plurality of sentences,

wherein the determining the speech style characteristics of the received plurality of sentences includes changing setting information for at least a part of the outputted plurality of sentences,

the speech style characteristic applied to the part of the plurality of sentences is changed based on the changed setting information, and

the part of the plurality of sentences and the changed speech style characteristic are inputted to the artificial neural network text-to-speech synthesis model and the synthetic speech is changed based on speech data outputted from the artificial neural network text-to-speech synthesis model.

3. The method of claim 2 , wherein the changing the setting information for the part of the outputted plurality of sentences includes changing setting information for visual representation of the part of the outputted plurality of sentences.

4. The method of claim 2 , further comprising adding a visual representation indicative of characteristic of an effect to be inserted between the plurality of sentences,

wherein the synthetic speech includes a sound effect generated based on the characteristic of the effect included in the added visual representation.

5. The method of claim 4 , wherein the effect to be inserted between the plurality of sentences includes a silence, and

the adding the visual representation indicative of the characteristic of the effect to be inserted between the plurality of sentences includes adding a visual representation indicative of a time of the silence to be inserted between the plurality of sentences.

6. The method of claim 1 , further comprising dividing the plurality of sentences into one or more sets of sentences,

wherein the determining the speech style characteristic for the received plurality of sentences includes:

determining a role corresponding to the divided one or more sets of sentences; and

setting a predetermined speech style characteristic corresponding to the determined role.

7. The method of claim 6 , wherein an analysis result is generated by analyzing the divided one or more sets of sentences using natural language processing, and

the determining the role corresponding to the divided one or more sets of sentences includes:

outputting one or more role candidates recommended based on the analysis result of the one or more sets of sentences; and

selecting at least a part of the outputted one or more role candidates.

8. The method of claim 7 , wherein the divided one or more sets of sentences are grouped based on the analysis result, and

the determining the role corresponding to the divided one or more sets of sentences includes:

outputting one or more role candidates corresponding to each of the grouped sets of sentences recommended based on the analysis result; and

selecting at least a part of the outputted one or more role candidates.

9. The method of claim 7 , wherein the determining the speech style characteristic for the received plurality of sentences includes:

outputting one or more speech style characteristic candidates recommended based on the analysis result of the one or more sets of sentences; and

selecting at least a part of the outputted one or more speech style characteristic candidates.

10. The method of claim 1 , wherein an inspection result is generated by inspecting the synthetic speech for the plurality of sentences, and

the method further includes changing the speech style characteristic applied to the synthetic speech based on the inspection result.

11. The method of claim 1 , wherein an audio content including the synthetic speech is generated.

12. The method of claim 11 , further comprising, in response to a request to download the generated audio content, receiving the generated audio content.

13. The method of claim 11 , further comprising, in response to a request to stream the generated audio content, playing back the generated audio content in real time.

14. The method of claim 11 , further comprising mixing the generated audio content with a video content.

15. The method of claim 1 , further comprising outputting the received plurality of sentences,

wherein the determining the speech style characteristic for the received plurality of sentences includes:

selecting a part of the outputted plurality of sentences;

outputting an interface for changing the speech style characteristic for the selected part of the outputted plurality of sentences; and

changing a value indicative of the speech style characteristic for the part through the interface, and

the part of the plurality of sentences and the changed value indicative of the speech style characteristic are inputted to the artificial neural network text-to-speech synthesis model and the synthetic speech is changed based on speech data outputted from the artificial neural network text-to-speech synthesis model.

16. The method of claim 1 , further comprising:

receiving a speaker ID vector; and

obtaining an embedding vector indicative of the speech style characteristic of a single role based on the speaker ID vector,

wherein synthetic speech for the plurality of sentences is generated using the embedding vector.

17. The method of claim 1 , wherein the change of the font style of text for the part of the set of sentences includes change of a font color for the part of the set of sentences.

18. The method of claim 1 , further comprising:

receiving a change of width of the text for the part of the set of sentences being displayed,

wherein a speed of the output synthetic speech for the part of the set of sentences is determined based on the changed width.

19. The method of claim 18 wherein the width of the text for the part of the set of sentences being displayed is increased; and

the modified specific speech style characteristic includes a slower speed than the specific speech style characteristic.

20. A computer program stored on a non-transitory computer-readable recording medium for executing, on a computer, a method for processing synthetic speech for text through a user interface according to claim 1 .