IP Library Granted Patent US 8,594,995
Granted Patent B2
US 8,594,995 · App. 12/108,726 · Granted Nov 26, 2013

Multilingual asynchronous communications of speech messages recorded in digital media files

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,594,995
App. No.
12/108,726
Granted
Nov 26, 2013
Kind
B2
Abstract

Methods, systems, and computer program products are provided multilingual for asynchronous communications. Embodiments include recording a speech message in a digital media file; transmitting, from a sender multilingual communications application to a recipient multilingual communications application, the speech message in the digital media file; receiving, in the recipient multilingual communications application, the recorded speech message in the digital media file; converting, by the recipient multilingual communications application, the recorded speech message to text; identifying, by the recipient multilingual communications application, that the text of the recorded speech message is in a source language that is not a predetermined target language; translating, by the recipient multilingual communications application, the text in the source language to translated text in the target language; converting, by the recipient multilingual communications application, the translated text to synthesized speech in the target language; recording, by the recipient multilingual communications application, the synthesized speech in the target language in a digital media file; and playing the media file thereby rendering the synthesized speech.

Claims (60)

1. A method for multilingual asynchronous communications, the method comprising:

receiving, by a recipient multilingual communications application of a recipient computing device, from a sender multilingual communications application of a sender computing device, a first speech message recorded in a first digital media file, wherein the first speech message is received via the sender multilingual communications application from a first user;

converting, by the recipient multilingual communications application, the first speech message to a text representation of the first speech message;

identifying, by the recipient multilingual communications application, that the text representation of the first speech message is in a source language that is not a predetermined target language;

translating, by the recipient multilingual communications application in the recipient computing device of a second user, the text representation of the first speech message in the source language to a translated text representation of the first speech message in the target language, wherein the recipient multilingual communications application in the recipient computing device of the second user translates the text representation of the first speech message to the translated text representation of the first speech message in the target language based on the received first digital media file;

converting, by the recipient multilingual communications application, the translated text representation of the first speech message to synthesized speech in the target language;

recording, by the recipient multilingual communications application, the synthesized speech in the target language in a second digital media file;

playing the second digital media file thereby rendering the synthesized speech to the second user;

receiving, by the recipient multilingual communications application, from the second user, a second speech message in the target language comprising a response to the synthesized speech; and

transmitting the second speech message to the sender multilingual communications application.

2. The method of claim 1 , wherein playing the second digital media file further comprises:

storing the second digital media file on a digital audio player; and

playing the second digital media file on the digital audio player thereby rendering the synthesized speech in the target language.

3. The method of claim 1 , further comprising:

recording the second speech message in the target language.

4. The method of claim 1 wherein the first speech message includes a user's speech recorded on a digital audio recorder.

5. The method of claim 1 wherein translating the text in the source language to translated text in the target language further comprises prompting a user to select a target language.

6. The method of claim 1 wherein translating the text in the source language to translated text in the target language further comprises translating the text in the source language to translated text in a default target language.

7. The method of claim 1 , wherein transmitting the second speech message to the sender multilingual communications application comprises transmitting to the sender multilingual communications application a third digital media file, the method further comprising:

converting, by the recipient multilingual communications application, the second speech message in the target language to second text;

translating, by the recipient multilingual communications application, the second text to second translated text in the source language;

converting, by the recipient multilingual communications application, the translated second text to synthesized second speech in the source language; and

recording, by the recipient multilingual communications application, the synthesized second speech in the third digital media file.

8. A system for multilingual asynchronous communications, the system comprising a computer processor, a computer memory operatively coupled to the computer processor, the computer memory having disposed thereon computer program instructions capable of:

receiving, by a recipient multilingual communications application of a recipient computing device, from a sender multilingual communications application of a sender computing device, a first speech message recorded in a first digital media file, wherein the first speech message is received via the sender multilingual communications application from a first user;

converting, by the recipient multilingual communications application, the first speech message to a text representation of the first speech message;

identifying, by the recipient multilingual communications application, that the text representation of the first speech message is in a source language that is not a predetermined target language;

translating, by the recipient multilingual communications application in the recipient computing device of a second user, the text representation of the first speech message in the source language to a translated text representation of the first speech message in the target language, wherein the recipient multilingual communications application in the recipient computing device of the second user translates the text representation of the first speech message to the translated text representation of the first speech message in the target language based on the received first digital media file;

converting, by the recipient multilingual communications application, the translated text representation of the first speech message to synthesized speech in the target language;

recording, by the recipient multilingual communications application, the synthesized speech in the target language in a second digital media file;

playing the second digital media file thereby rendering the synthesized speech to the second user;

receiving, by the recipient multilingual communications application, from the second user, a second speech message in the target language comprising a response to the synthesized speech; and

transmitting the second speech message to the sender multilingual communications application.

9. The system of claim 8 , wherein computer program instructions capable of playing the second digital media file further comprise computer program instructions capable of:

storing the second digital media file on a digital audio player; and

playing the second digital media file on the digital audio player thereby rendering the synthesized speech in the target language.

10. The system of claim 8 , wherein the computer memory has further disposed thereon computer program instructions capable of:

recording the second speech message in the target language.

11. The system of claim 8 , wherein the first speech message includes a user's speech recorded on a digital audio recorder.

12. The system of claim 8 , wherein computer program instructions capable of translating the text in the source language to translated text in the target language further comprise computer program instructions capable of prompting a user to select a target language.

13. The system of claim 8 , wherein computer program instructions capable of translating the text in the source language to translated text in the target language further comprise computer program instructions capable of translating the text in the source language to translated text in a default target language.

14. A computer-readable storage device having stored thereon computer-executable instructions that, when executed by at least one processor, perform a method of multilingual asynchronous communications, the method comprising:

receiving, by a recipient multilingual communications application of a recipient computing device, from a sender multilingual communications application of a sender computing device, a first speech message recorded in a first digital media file, wherein the first speech message is received via the sender multilingual communications application from a first user;

converting, by the recipient multilingual communications application, the first speech message to a text representation of the first speech message;

identifying, by the recipient multilingual communications application, that the text representation of the first speech message is in a source language that is not a predetermined target language;

translating, by the recipient multilingual communications application in the recipient computing device of a second user, the text representation of the first speech message in the source language to a translated text representation of the first speech message in the target language, wherein the recipient multilingual communications application in the recipient computing device of the second user translates the text representation of the first speech message to the translated text representation of the first speech message in the target language based on the received first digital media file;

converting, by the recipient multilingual communications application, the translated text representation of the first speech message to synthesized speech in the target language;

recording, by the recipient multilingual communications application, the synthesized speech in the target language in a second digital media file;

playing the second digital media file thereby rendering the synthesized speech to the second user,

receiving, by the recipient multilingual communications application, from the second user, a second speech message in the target language comprising a response to the synthesized speech; and

transmitting the second speech message to the sender multilingual communications application.

15. The computer-readable storage device of claim 14 , wherein the method further comprises:

storing the second digital media file on a digital audio player; and

playing the second digital media file on the digital audio player thereby rendering the synthesized speech in the target language.

16. The computer-readable storage device of claim 14 , wherein the method further comprises:

recording the second speech response message in the target language.

17. The computer-readable storage device of claim 14 , wherein the first speech message includes a user's speech recorded on a digital audio recorder.

18. The computer-readable storage device of claim 14 , wherein translating the text in the source language to translated text in the target language comprises prompting a user to select a target language.

19. The computer-readable storage device of claim 14 , wherein translating the text in the source language to translated text in the target language comprises translating the text in the source language to translated text in a default target language.

20. The computer-readable storage device of claim 14 , wherein the computer readable medium comprises a recordable medium.

Assignments (9)
RELEASE (REEL 052935 / FRAME 0584) Recorded Jan 2, 2025
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: CERENCE OPERATING COMPANY
Reel/Frame 069797/0818 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REPLACE THE CONVEYANCE DOCUMENT WITH THE NEW ASSIGNMENT PREVIOUSLY RECORDED AT REEL: 050836 FRAME: 0191. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 19, 2022
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 059804/0186 →
SECURITY AGREEMENT Recorded Jun 15, 2020
From: CERENCE OPERATING COMPANY
To: WELLS FARGO BANK, N.A.
Reel/Frame 052935/0584 →
RELEASE OF SECURITY INTEREST Recorded Jun 12, 2020
From: BARCLAYS BANK PLC
To: CERENCE OPERATING COMPANY
Reel/Frame 052927/0335 →
SECURITY AGREEMENT Recorded Nov 7, 2019
From: CERENCE OPERATING COMPANY
To: BARCLAYS BANK PLC
Reel/Frame 050953/0133 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED AT REEL: 050836 FRAME: 0191. ASSIGNOR(S) HEREBY CONFIRMS THE INTELLECTUAL PROPERTY AGREEMENT. Recorded Oct 29, 2019
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 050871/0001 →
INTELLECTUAL PROPERTY AGREEMENT Recorded Oct 23, 2019
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE INC.
Reel/Frame 050836/0191 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 13, 2009
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 022689/0317 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 14, 2008
From: BODIN, WILLIAM K; JARAMILLO, DAVID; MAYNARD, ANN MARIE G
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 021233/0618 →