Method for adding realism to synthetic speech
View Patent ↗The present disclosure provides a method for adding realism to synthetic speech. The method includes receiving text ( 218 ) that is to be converted into synthetic speech from a mobile device ( 108 ). The text ( 218 ) may include embedded emoticons indicating a first prosody information and a predefined sound stored in a stored data repository ( 208 ). The method also includes identifying a user associated with the text ( 218 ) based on a comparison between metadata associated with the text ( 218 ) and user profiles stored in the stored data repository ( 208 ); retrieving a speech font from a speech data corpus associated with the user stored in the stored data repository ( 208 ). The speech font includes a second prosody information and a predefined accent of the user. The method further includes converting the text ( 218 ) into synthetic speech based on the retrieved speech font, which is being modulated based on the emoticon.
1. A system using a realistic speech synthesis (RSS) device with one or more mobile devices that are in communication with one or more stored data repositories, that adds realism to synthetic speech, comprising:
a first mobile device, with a processor and a memory, associated with the first user, sending a text to a second mobile device;
a second mobile device, with a processor and a memory, associated with the second user, in communication with said first mobile device and a stored data repository, wherein said second mobile device receives said text from said first mobile device; and
a realistic speech synthesis device in communication with said second mobile device, configured to convert said text to said synthetic speech, wherein said realistic speech synthesis device is configured to:
receive said text from said second mobile device;
identify the first user based on a comparison between metadata associated with said text and user profiles stored in said stored data repository;
retrieve a speech font from a speech data corpus associated with the first user stored in said stored data repository, wherein said speech font includes a second prosody information and a predefined accent of the first user;
convert said text into said synthetic speech based on said retrieved speech font, wherein said speech font is modulated based on said at least one emoticon; and
send said synthetic speech to said second mobile device;
wherein said realistic speech synthesis device is allowed to access said speech font based on a valid authorization key received from said second mobile device, wherein said speech font is embedded with an audio watermark.
2. The claim according to claim 1 , wherein said stored data repository is on said first mobile device, said second mobile device, and/or a server via a network.
3. The claim according to claim 1 , wherein said text is embedded with at least one emoticon indicating a first prosody information and a predefined sound stored in said stored data repository.
4. The claim according to claim 1 , wherein said text is pre-processed to expand one or more abbreviations in said text based on a list of abbreviations stored in said stored data repository.
5. A method to manufacture a system using a realistic speech synthesis (RSS) device with one or more mobile devices that are in communication with one or more stored data repositories, that adds realism to a synthetic speech, comprising:
providing a first mobile device, with a processor and a memory, associated with the first user, sending a text to a second mobile device;
providing a second mobile device, with a processor and a memory, associated with the second user, in communication with said first mobile device and said stored data repository, wherein said second mobile device receives said text from said first mobile device; and
providing a realistic speech synthesis device in communication with said second mobile device, configured to convert said text to said synthetic speech, wherein said realistic speech synthesis device is configured to:
receive said text from said second mobile device;
identify the first user based on a comparison between metadata associated with said text and user profiles stored in said stored data repository;
retrieve a speech font from a speech data corpus associated with the first user stored in said stored data repository, wherein said speech font includes a second prosody information and a predefined accent of said first user;
convert said text into said synthetic speech based on said retrieved speech font, wherein said speech font is modulated based on said at least one emoticon; and
send said synthetic speech to said second mobile device,
wherein said realistic speech synthesis device is allowed to access said speech font based on a valid authorization key received from said second mobile device, wherein said speech font is embedded with an audio watermark.
6. The claim according to claim 5 , wherein stored data repository is on said first mobile device, said second mobile device, and/or a server via a network.
7. The claim according to claim 5 , wherein said text is embedded with at least one emoticon indicating a first prosody information and a predefined sound stored in said stored data repository.
8. The claim according to claim 5 , wherein said text is pre-processed to expand one or more abbreviations in said text based on a list of abbreviations stored in said stored data repository.
9. A method to use a system using a realistic speech synthesis (RSS) device with one or more mobile devices that are in communication with one or more stored data repositories, that adds realism to a synthetic speech, comprising:
providing a first mobile device, with a processor and a memory, associated with the first user, sending a text to a second mobile device;
providing a second mobile device, with a processor and a memory, associated with the second user, in communication with said first mobile device and said stored data repository, wherein said second mobile device receives said text from said first mobile device; and
using a realistic speech synthesis device in communication with said second mobile device, configured to convert said text to said synthetic speech, wherein said realistic speech synthesis device is configured to:
receive said text from said second mobile device;
identify the first user based on a comparison between metadata associated with said text and user profiles stored in said stored data repository;
retrieve a speech font from a speech data corpus associated with the first user stored in said stored data repository, wherein said speech font includes a second prosody information and a predefined accent of said first user;
convert said text into said synthetic speech based on said retrieved speech font, wherein said speech font is modulated based on said at least one emoticon; and
send said synthetic speech to said second mobile device,
wherein said speech font is being accessed based on a valid authorization key received from said mobile device, wherein said speech font is embedded with an audio watermark.
10. The claim according to claim 9 , wherein stored data repository is on said mobile device and/or a server via a network.
11. The claim according to claim 9 , wherein said text is embedded with at least one emoticon indicating a first prosody information and a predefined sound stored in said stored data repository.
12. The claim according to claim 9 , wherein said text is pre-processed to expand one or more abbreviations in said text based on a list of abbreviations stored in said stored data repository.
13. A non-transitory program storage device readable by a computing device that tangibly embodies a program of instructions executable by said computing device to perform a method to implement a system using a realistic speech synthesis (RSS) device with one or more mobile devices that are in communication with one or more stored data repositories, that adds realism to a synthetic speech, comprising:
providing a first mobile device, with a processor and a memory, associated with the first user, sending a text to a second mobile device;
providing a second mobile device, with a processor and a memory, associated with the second user, in communication with said first mobile device and said stored data repository, wherein said second mobile device receives said text from said first mobile device; and
using a realistic speech synthesis device in communication with said second mobile device, configured to convert said text to said synthetic speech, wherein said realistic speech synthesis device is configured to:
receive said text from said second mobile device;
identify the first user based on a comparison between metadata associated with said text and user profiles stored in said stored data repository;
retrieve a speech font from a speech data corpus associated with the first user stored in said stored data repository, wherein said speech font includes a second prosody information and a predefined accent of said first user;
convert said text into said synthetic speech based on said retrieved speech font, wherein said speech font is modulated based on said at least one emoticon; and
send said synthetic speech to said second mobile device;
wherein said speech font is being accessed based on a valid authorization key received from said mobile device, wherein said speech font is embedded with an audio watermark.
14. The claim according to claim 13 , wherein stored data repository is on said mobile device and/or a server via a network.
15. The claim according to claim 13 , wherein said text is embedded with at least one emoticon indicating a first prosody information and a predefined sound stored in said stored data repository.
16. The claim according to claim 13 , wherein said text is pre-processed to expand one or more abbreviations in said text based on a list of abbreviations stored in said stored data repository.