IP Library Granted Patent US 10,051,207
Granted Patent B1
US 10,051,207 · App. 15/369,582 · Granted Aug 14, 2018

Captioning communication systems

Inventors: Shane Roylance (Farmington, UT); Kenneth Boehme (South Jordan, UT); Pat Nola (Salt Lake City, UT); Merle Lamar Walker, III (Sandy, UT)
Assignee: Sorenson IP Holdings, LLC
H04N5/278H04L67/2804H04N7/147
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,051,207
App. No.
15/369,582
Granted
Aug 14, 2018
Kind
B1
Abstract

A method to generate a contact list may include receiving an identifier of a first communication device at a captioning system. The first communication device may be configured to provide first audio data to a second communication device. The second communication device may be configured to receive first text data of the first audio data from the captioning system. The method may further include receiving and storing contact data from each of multiple communication devices at the captioning system. The method may further include selecting the contact data from the multiple communication devices that include the identifier of the first communication device as selected contact data and generating a contact list based on the selected contact data. The method may also include sending the contact list to the first communication device to provide the contact list as contacts for presentation on an electronic display of the first communication device.

Claims (59)

1. A method to transcribe videos in a video communication system, the method comprising:

obtaining, at a first communication device, a notification from a message server regarding a video message that includes video data and audio data and is provided to the message server from a second communication device, the video message provided to the message server from the second communication device in response to the first communication device not participating in a video communication with the second communication device;

sending, to the message server from the first communication device, a request for the video message;

in response to the request for the video message, obtaining the video message at the first communication device from the message server;

presenting, by the first communication device, the video message, the presenting including presenting the video data and the audio data;

sending, from the first communication device to a transcription system, the audio data from the video message without sending the video data from the video message to the transcription system;

in response to sending the audio data, obtaining, at the first communication device, text data from the transcription system, the text data including a transcription of the audio data and being generated by the transcription system; and

presenting, by the first communication device, the text data concurrently with the video message.

2. The method of claim 1 , wherein the video message and the text data are presented by the first communication device to a hearing-impaired user of the second communication device.

3. The method of claim 1 , further comprising:

storing the text data;

presenting, by the first communication device, the video message a second time; and

in response to presenting the video message the second time, presenting the stored text data by the first communication device.

4. The method of claim 3 , wherein the text data is stored by the first communication device.

5. The method of claim 3 , wherein the text data is stored by the message server or the transcription system.

6. The method of claim 3 , wherein the text data is stored embedded in the video message.

7. The method of claim 1 , wherein the text data is first text data, the method further comprising:

sending, to the message server from the first communication device, a second request for the video message;

in response to the second request, obtaining the video message at the first communication device from the message server a second time;

presenting, by the first communication device, the video message for a second time;

sending, from the first communication device to the transcription system, the audio data from the video message for a second time without sending the video data to the transcription system;

in response to sending the audio data for the second time, obtaining, at the first communication device, second text data from the transcription system; and

presenting, by the first communication device, the second text data concurrently with the presentation of the video message for the second time.

8. The method of claim 7 , wherein the second text data includes an edited block of text different from a corresponding block of text in the first text data such that the second text data is different from the first text data.

9. The method of claim 1 , wherein the text data is generated at the transcription system with assistance of a live call assistant.

10. The method of claim 1 , wherein the transcription system includes the message server.

11. At least one non-transitory computer readable media configured to store one or more instructions that when executed by at least one computing system cause the at least one computing system to perform the method of claim 1 .

12. A method to transcribe videos in a video communication system, the method comprising:

obtaining, at a first communication device, a video that includes video data and audio data, the video provided to the first communication device from a storage server, the video provided to the storage server from a second communication device;

sending, from the first communication device to a transcription system, the audio data from the video without sending the video data to the transcription system;

in response to sending the audio data, obtaining, at the first communication device, text data from the transcription system, the text data including a transcription of the audio data; and

presenting, by the first communication device, the video, including the video data and the audio data, concurrently with the text data.

13. The method of claim 12 , further comprising:

storing the text data;

presenting, by the first communication device, the video a second time; and

in response to presenting the video the second time, presenting the stored text data.

14. The method of claim 13 , wherein the text data is stored in the first communication device.

15. The method of claim 12 , wherein the text data is first text data and the video is provided to the storage server from the second communication device in response to the first communication device not participating in a video communication with the second communication device, wherein the method further comprises:

obtaining the video at the first communication device from the storage server a second time;

sending, from the first communication device to the transcription system, the audio data from the video for a second time without sending the video data to the transcription system;

in response to sending the audio data for the second time, obtaining, at the first communication device, second text data from the transcription system; and

presenting, by the first communication device, the second text data concurrently with the presentation of the video for the second time.

16. The method of claim 15 , wherein the second text data includes an edited block of text different from a corresponding block of text in the first text data such that the second text data is different from the first text data.

17. At least one non-transitory computer readable media configured to store one or more instructions that when executed by at least one computing system cause the at least one computing system to perform the method of claim 12 .

18. A method to transcribe videos in a video communication system, the method comprising:

obtaining, at a message server, a video message that includes video data and audio data from a first communication device, the video message provided to the message server from the first communication device in response to a second communication device not participating in a video communication with the first communication device;

sending a notification to the second communication device from the message server regarding the video message;

obtaining a request for the video message from the second communication device;

in response to the request for the video message, sending the video message to the second communication device;

after sending the video message, obtaining, from the second communication device, the audio data from the video at a transcription system without the video data;

generating text data of the audio data, the text data including a transcription of the audio data; and

sending the text data from the transcription system to the second communication device, the second communication device configured to present the text data concurrently with the video message.

19. The method of claim 18 , wherein the text data is first text data, the method further comprising:

obtaining, at the message server from the second communication device, a second request for the video message;

in response to the request for the video message, sending the video message to the second communication device for a second time;

after sending the video message, obtaining, from the second communication device, the audio data from the video at the transcription system without the video data for a second time;

generating second text data of the audio data, the second text data including a transcription of the audio data; and

sending the second text data from the transcription system to the second communication device, the second communication device configured to present the second text data concurrently with the video message.

20. At least one non-transitory computer readable media configured to store one or more instructions that when executed by at least one computing system cause the at least one computing system to perform the method of claim 18 .

Assignments (11)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY DATA THE NAME OF THE LAST RECEIVING PARTY SHOULD BE CAPTIONCALL, LLC PREVIOUSLY RECORDED ON REEL 67190 FRAME 517. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded May 31, 2024
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
To: SORENSON IP HOLDINGS, LLC; SORENSON COMMUNICATIONS, LLC; CAPTIONCALL, LLC
Reel/Frame 067591/0675 →
SECURITY INTEREST Recorded Apr 23, 2024
From: SORENSON COMMUNICATIONS, LLC; INTERACTIVECARE, LLC; CAPTIONCALL, LLC
To: OAKTREE FUND ADMINISTRATION, LLC, AS COLLATERAL AGENT
Reel/Frame 067573/0201 →
RELEASE OF SECURITY INTEREST Recorded Apr 23, 2024
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
To: SORENSON IP HOLDINGS, LLC; SORENSON COMMUNICATIONS, LLC; CAPTIONALCALL, LLC
Reel/Frame 067190/0517 →
RELEASE OF SECURITY INTEREST Recorded Dec 16, 2021
From: CORTLAND CAPITAL MARKET SERVICES LLC
To: CAPTIONCALL, LLC; SORENSON COMMUNICATIONS, LLC
Reel/Frame 058533/0467 →
JOINDER NO. 1 TO THE FIRST LIEN PATENT SECURITY AGREEMENT Recorded Apr 22, 2021
From: SORENSON IP HOLDINGS, LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 056019/0204 →
LIEN Recorded Feb 11, 2020
From: SORENSON COMMUNICATIONS, LLC; CAPTIONCALL, LLC
To: CORTLAND CAPITAL MARKET SERVICES LLC
Reel/Frame 051894/0665 →
RELEASE OF SECURITY INTEREST Recorded May 8, 2019
From: U.S. BANK NATIONAL ASSOCIATION
To: SORENSON COMMUNICATIONS, LLC; SORENSON IP HOLDINGS, LLC; CAPTIONCALL, LLC; INTERACTIVECARE, LLC
Reel/Frame 049115/0468 →
RELEASE OF SECURITY INTEREST Recorded May 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: SORENSON COMMUNICATIONS, LLC; SORENSON IP HOLDINGS, LLC; CAPTIONCALL, LLC; INTERACTIVECARE, LLC
Reel/Frame 049109/0752 →
PATENT SECURITY AGREEMENT Recorded Apr 29, 2019
From: SORENSEN COMMUNICATIONS, LLC; CAPTIONCALL, LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 050084/0793 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2017
From: CAPTIONCALL, LLC
To: SORENSON IP HOLDINGS, LLC
Reel/Frame 041122/0682 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 5, 2016
From: WALKER, MERLE L, III; BOEHME, KENNETH; NOLA, PAT; ROYLANCE, SHANE
To: CAPTIONCALL LLC
Reel/Frame 040528/0809 →
Continuity (2)
Continuation 15185459 · Jun 17, 2016
Continuation In Part 14939831 · Nov 12, 2015