Method and apparatus for using a vocal sample to customize text to speech applications
Apparatus and methods consistent with the present invention measure one or more of the characteristics of a voice recording and use such measurements to create a synthetic voice that approximates the recorded voice and uses such created synthetic voice to verbalize the content of an electronically conveyed written message such as an SMS text message. The vocal characteristics measured may include frequency, timbre, intensity, rhythm, and rate of speech as well as others.
1. A method comprising:
receiving, via a client application interface, a recorded sample of a sender's voice, wherein said sample comprises the sender's voicemail greeting;
measuring the vocal characteristics of the recorded sample of the sender's voice including its frequency, intensity, rhythm and rate of speech, wherein the sample of the sender's voice is searched for words or phrases commonly used in the context of a voicemail greeting and the sample of the sender's voice is subjected to measurement of frequency and intensity characteristics is limited to such commonly used words or phrases;
receiving a text-based message originating from the sender;
converting the text-based message to a speech format wherein the measured vocal characteristics are used to form a synthetic voice that approximates the voice of the sender;
sending an audio file of the sender's message as converted to an address that corresponds to the address of the text-based message.
2. A method, comprising:
receiving at a server a sample of a sender's voice as recorded, digitized and compressed at and wirelessly transmitted from a device of the sender to the server, wherein the sample of the sender's voice comprises a sequence of predetermined words having at least 20 syllables and is recorded at a rate of at least 44,100 Hz, and wherein the server is remote from the sender's device;
measuring at the server the frequency, timbre, intensity, rhythm and rate of speech of the sample of the sender's voice;
identifying at the server differences between the frequency, timbre, intensity, rhythm and rate of speech of the sample of the sender's voice and the frequency, timbre, intensity, rhythm and rate of speech of a neutral voice speaking the sequence of predetermined words;
modifying the frequency, timbre, intensity, rhythm and rate of speech of a neutral, speech-to-text voice model by adding the differences between the frequency, timbre, intensity, rhythm and rate of speech of the sample of the sender's voice and of the neutral voice to the frequency, timbre, intensity, rhythm and rate of speech of a neutral, speech-to-text voice model, respectively, thereby creating a synthetic speech-to-text voice model approximating the sender's voice;
receiving at the server a text-based message addressed to a recipient, wherein the text-based message is sent from the sender's device;
converting at the server the text-based message into an audio file using the synthetic speech-to-text voice model; and
transmitting from the server the audio file to a device of the recipient, wherein the recipient's device is remote from both the sender's device and the server.
3. The method of claim 2 , wherein the sample of the sender's voice comprises a voicemail greeting of the sender.
4. The method of claim 3 , further comprising:
telephonically receiving at the remote server the sender's voicemail greeting.
5. The method of claim 4 , further comprising:
searching the sample of the sender's voice for words or phrases commonly used in the context of a voicemail greeting.
6. The method of claim 2 , further comprising:
converting acronyms in the text-based message to articulated words in the audio file.
7. The method of claim 2 , further comprising:
converting the text-based message to a speech format using formant synthesis.