IP Library Granted Patent US 10,091,354
Granted Patent B1
US 10,091,354 · App. 15/380,589 · Granted Oct 2, 2018

Transcribing media files

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,091,354
App. No.
15/380,589
Granted
Oct 2, 2018
Kind
B1
Abstract

A computer-implemented method to provide transcripts of multimedia messages is disclosed. The method may include receiving, at a server, a message with an attached media file. The message may be directed to a user device. The server may be configured to receive and direct messages to the user device. The method may further include separating the media file from the message before the message is provided to the user device. The method may also include generating, at a transcription system, a transcript of audio data in the media file. The method may also include providing the message to the user device for presentation of the message on the user device. The method may further include providing the transcript and the media file to the user device for presentation of the transcript and the media file on the user device.

Claims (43)

1. A computer-implemented method to provide transcripts of multimedia messages, the method comprising:

receiving, at a server system, a message with an attached media file, the message directed to a user device and the server system configured to receive and direct messages to the user device;

copying, by the server system, the media file from the message before the message is provided to the user device;

generating a transcript of audio data in the media file using audio data in the copied media file;

before the generation of the transcript is complete, providing, by the server system, the message with the media file to the user device for presentation of the message on the user device; and

in response to a request from the user device, providing the transcript to the user device for presentation of the transcript and the media file on the user device.

2. The method of claim 1 , wherein the media file includes video data and the audio data.

3. The method of claim 1 , further comprising in response to the generation of the transcript, providing to the user device, an indication of the generation of the transcript.

4. The method of claim 3 , further comprising obtaining, from the user device, the request for the transcript in response to providing the indication of the generation of the transcript to the user device.

5. The method of claim 4 , wherein the user device does not indicate receipt of the message to a user of the user device until after receiving the indication of the generation of the transcript from the server system, wherein the request for the transcript and the media file is sent to the server system from the user device in response to user input at the user device.

6. At least one non-transitory computer readable media configured to store one or more instructions that when executed by a system, which includes the server system, causes or directs the system to perform the method of claim 1 .

7. A computer-implemented method to provide transcripts of multimedia messages, the method comprising:

receiving, at a server system, a message including a media link to a media stream, the message directed to a user device and the server system configured to receive and direct messages to the user device;

accessing the media stream using the media link;

obtaining audio data from the media stream;

generating and storing a transcript of the audio data, wherein the media stream is hosted by a media system separate from the server system that generates and stores the transcript;

generating a transcript link to the server system that is associated with the transcript of the audio data;

generating a message link that includes the transcript link and the media link;

modifying the message to include the message link;

after modifying the message to include the message link, providing the message to the user device;

obtaining a request, at the server system from the user device, for the transcript by way of the transcript link, the request occurring in response to the user device accessing the message link, the request not including a request for the media stream; and

in response to the request, providing the transcript to the user device without the media stream such that the user device presents the transcript along with the media stream obtained by the user device from the media system using the media link.

8. The method of claim 7 , wherein the transcript of the audio data is generated using the audio data.

9. The method of claim 7 , wherein the media stream includes video data and the audio data.

10. The method of claim 7 , further comprising:

in response to the generation of the transcript of the audio data, providing an indication on the user device of receipt of the message.

11. At least one non-transitory computer readable media configured to store one or more instructions that when executed by at least one computing system causes or directs the least one computing system to perform the method of claim 7 .

12. A system to provide transcripts of multimedia messages, the system comprising:

a processing system configured to:

receive a message with an attached media file, the message directed to a user device that is separate from the processing system;

separate the media file from the message;

after separating the media file from the message, generate a transcript of audio data of the media file using the audio data in the media file;

before the generation of the transcript is complete, provide the message to the user device;

after generation of the transcript, provide the media file to the user device separately from the message; and

after generation of the transcript, provide the transcript to the user device for output of the transcript by the user device.

13. The system of claim 12 , wherein the processing system, in response to separation of the media file from the message, is further configured to modify the message to include a media tag to the media file before completion of the transcript.

14. The system of claim 12 , wherein the processing system is further configured to:

in response to the generation of the transcript of the audio data, provide, to the user device, an indication of the generation of the transcript; and

receive, from the user device, a request for the transcript and the media file,

wherein the media file is provided to the user device in response to the request from the user device.

15. The system of claim 14 , wherein in response to the request from the user device, the transcript is provided to the user device.

16. The system of claim 14 , wherein the user device does not indicate receipt of the message to a user of the user device until after receiving the indication of the generation of the transcript from the system, wherein the request for the transcript and the media file is sent to the system from the user device in response to user input at the user device.

17. The system of claim 12 , wherein the media file includes video data and the audio data.

Assignments (13)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY DATA THE NAME OF THE LAST RECEIVING PARTY SHOULD BE CAPTIONCALL, LLC PREVIOUSLY RECORDED ON REEL 67190 FRAME 517. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded May 31, 2024
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
To: SORENSON IP HOLDINGS, LLC; SORENSON COMMUNICATIONS, LLC; CAPTIONCALL, LLC
Reel/Frame 067591/0675 →
SECURITY INTEREST Recorded Apr 23, 2024
From: SORENSON COMMUNICATIONS, LLC; INTERACTIVECARE, LLC; CAPTIONCALL, LLC
To: OAKTREE FUND ADMINISTRATION, LLC, AS COLLATERAL AGENT
Reel/Frame 067573/0201 →
RELEASE OF SECURITY INTEREST Recorded Apr 23, 2024
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
To: SORENSON IP HOLDINGS, LLC; SORENSON COMMUNICATIONS, LLC; CAPTIONALCALL, LLC
Reel/Frame 067190/0517 →
RELEASE OF SECURITY INTEREST Recorded Dec 16, 2021
From: CORTLAND CAPITAL MARKET SERVICES LLC
To: SORENSON COMMUNICATIONS, LLC; CAPTIONCALL, LLC
Reel/Frame 058533/0467 →
JOINDER NO. 1 TO THE FIRST LIEN PATENT SECURITY AGREEMENT Recorded Apr 22, 2021
From: SORENSON IP HOLDINGS, LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 056019/0204 →
LIEN Recorded Feb 11, 2020
From: SORENSON COMMUNICATIONS, LLC; CAPTIONCALL, LLC
To: CORTLAND CAPITAL MARKET SERVICES LLC
Reel/Frame 051894/0665 →
RELEASE OF SECURITY INTEREST Recorded May 8, 2019
From: U.S. BANK NATIONAL ASSOCIATION
To: SORENSON COMMUNICATIONS, LLC; SORENSON IP HOLDINGS, LLC; CAPTIONCALL, LLC; INTERACTIVECARE, LLC
Reel/Frame 049115/0468 →
RELEASE OF SECURITY INTEREST Recorded May 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: SORENSON COMMUNICATIONS, LLC; SORENSON IP HOLDINGS, LLC; CAPTIONCALL, LLC; INTERACTIVECARE, LLC
Reel/Frame 049109/0752 →
PATENT SECURITY AGREEMENT Recorded Apr 29, 2019
From: SORENSEN COMMUNICATIONS, LLC; CAPTIONCALL, LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 050084/0793 →
SECURITY INTEREST Recorded Apr 5, 2017
From: SORENSON IP HOLDINGS, LLC
To: U.S. BANK NATIONAL ASSOCIATION
Reel/Frame 041866/0631 →
SECURITY INTEREST Recorded Apr 5, 2017
From: SORENSON IP HOLDINGS, LLC
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 041866/0423 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 11, 2017
From: CAPTIONCALL LLC
To: SORENSON IP HOLDINGS, LLC
Reel/Frame 040950/0601 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 15, 2016
From: ROYLANCE, SHANE; BOEHME, KENNETH
To: CAPTIONCALL LLC
Reel/Frame 040636/0923 →
Cited By (1)
US 12,254,874