IP Library Granted Patent US 10,972,683
Granted Patent B2
US 10,972,683 · App. 16/101,115 · Granted Apr 6, 2021

Captioning communication systems

Inventors: Shane Roylance (Farmington, UT); Kenneth Boehme (South Jordan, UT); Pat Nola (Salt Lake City, UT); Merle L. Walker, III (Sandy, UT)
Assignee: Sorenson IP Holdings, LLC
H04N5/278G09B21/009H04L61/1594H04L65/1069H04L65/60H04L67/2804H04M1/72591H04N7/141H04N7/147H04M1/2757
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,972,683
App. No.
16/101,115
Granted
Apr 6, 2021
Kind
B2
Abstract

A method to generate a contact list may include receiving an identifier of a first communication device at a captioning system. The first communication device may be configured to provide first audio data to a second communication device. The second communication device may be configured to receive first text data of the first audio data from the captioning system. The method may further include receiving and storing contact data from each of multiple communication devices at the captioning system. The method may further include selecting the contact data from the multiple communication devices that include the identifier of the first communication device as selected contact data and generating a contact list based on the selected contact data. The method may also include sending the contact list to the first communication device to provide the contact list as contacts for presentation on an electronic display of the first communication device.

Claims (37)

1. A method to transcribe videos, the method comprising:

obtaining, at a first communication device, a video that includes video data and audio data, the video originating at a second communication device and provided to the first communication device as part of a communication session between the first communication device and the second communication device;

separating, by the first communication device, the audio data from the video;

sending, to a remote system from the first communication device, the audio data from the video without sending the video data to the remote system, wherein the video is obtained at the first communication device through a point-to-point connection between the first communication device and the second communication device without the video passing through the remote system;

in response to sending the audio data, obtaining, at the first communication device, text data originating from the remote system, the text data including a transcription of at least a portion of the audio data; and

presenting, by the first communication device, the video, including the video data and the audio data, concurrently with the text data in real-time during the communication session.

2. The method of claim 1 , wherein the text data is obtained at the first communication device through a connection between the remote system and the first communication device that does not include the second communication device.

3. The method of claim 1 , further comprising:

obtaining second text data that includes a second transcription of the audio data; and

sending, to the remote system, the second text data, such that the remote system receives the second text data and the audio data, wherein the text data originating from the remote system includes corrections to the second text data.

4. The method of claim 3 , wherein the second text data is generated by the first communication device using speech recognition software.

5. The method of claim 3 , wherein the video is presented concurrently with the second text data and the text data.

6. At least one non-transitory computer readable media configured to store one or more instructions that when executed by at least one computing system cause or direct the at least one computing system to perform the method of claim 1 .

7. A device comprising:

one or more processors;

one or more computer-readable media coupled to the one or more processors, the one or more computer-readable media including instructions, that in response to being executed by the one or more processors, cause or direct the device to perform operations, the operations comprising:

obtain a video that includes video data and audio data, the video originating at a remote device and provided to the device as part of a communication session between the remote device and the device;

separate the audio data from the video;

send, to a remote system, the audio data from the video without sending the video data to the remote system, wherein the video is obtained at the device through a point-to-point connection between the device and the remote device without the video passing through the remote system; and

obtain text data originating from the remote system, the text data including a transcription of at least a portion of the audio data; and

a display configured to present the video data concurrently with the text data in real-time during the communication session.

8. The device of claim 7 , wherein the operations further comprise send, to the remote system, second text data that includes a second transcription of the audio data, such that the remote system receives the second text data and the audio data, wherein the text data originating from the remote system includes corrections to the second text data.

9. The device of claim 8 , wherein the operations further comprise generate the second text data using speech recognition software.

10. The device of claim 8 , wherein the display is configured to present the video concurrently with the second text data and the text data.

11. The device of claim 7 , further comprising:

a camera configured to capture second video data; and

a microphone configured to capture second audio data, the second video data and the second audio data forming second video,

wherein the operations further comprise send the second video to the remote device as part of the communication session between the remote device and the device.

12. A transcription service comprising:

one or more processors;

one or more computer-readable media coupled to the one or more processors, the one or more computer-readable media including instructions, that in response to being executed by the one or more processors, cause or direct the transcription service to perform operations, the operations comprising:

establish a point-to-point video communication session between a first communication device and a second communication device that are separate from the transcription service, wherein second video obtained by the first communication device during the video communication session does not pass through the transcription service;

obtain, at the transcription service from the first communication device, second audio data of the second video without second video data of the second video;

obtain text data of the second audio data, the text data including a transcription of the second audio data; and

direct the text data to the first communication device for presentation of the text data by the first communication device concurrently with presentation of the second video by the first communication device in real-time during the video communication session.

13. The transcription service of claim 12 , wherein the second audio data of the second video is obtained at the transcription service from the first communication device through a connection between the transcription service and the first communication device that is separate from the point-to-point video communication session between the first communication device and the second communication device.

14. The transcription service of claim 12 , wherein obtaining the text data includes generating the text data based on the second audio data using speech recognition software.

Assignments (11)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY DATA THE NAME OF THE LAST RECEIVING PARTY SHOULD BE CAPTIONCALL, LLC PREVIOUSLY RECORDED ON REEL 67190 FRAME 517. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded May 31, 2024
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
To: SORENSON IP HOLDINGS, LLC; SORENSON COMMUNICATIONS, LLC; CAPTIONCALL, LLC
Reel/Frame 067591/0675 →
SECURITY INTEREST Recorded Apr 23, 2024
From: SORENSON COMMUNICATIONS, LLC; INTERACTIVECARE, LLC; CAPTIONCALL, LLC
To: OAKTREE FUND ADMINISTRATION, LLC, AS COLLATERAL AGENT
Reel/Frame 067573/0201 →
RELEASE OF SECURITY INTEREST Recorded Apr 23, 2024
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
To: SORENSON IP HOLDINGS, LLC; SORENSON COMMUNICATIONS, LLC; CAPTIONALCALL, LLC
Reel/Frame 067190/0517 →
RELEASE OF SECURITY INTEREST Recorded Dec 16, 2021
From: CORTLAND CAPITAL MARKET SERVICES LLC
To: SORENSON COMMUNICATIONS, LLC; CAPTIONCALL, LLC
Reel/Frame 058533/0467 →
JOINDER NO. 1 TO THE FIRST LIEN PATENT SECURITY AGREEMENT Recorded Apr 22, 2021
From: SORENSON IP HOLDINGS, LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 056019/0204 →
LIEN Recorded Feb 11, 2020
From: SORENSON COMMUNICATIONS, LLC; CAPTIONCALL, LLC
To: CORTLAND CAPITAL MARKET SERVICES LLC
Reel/Frame 051894/0665 →
RELEASE OF SECURITY INTEREST Recorded May 8, 2019
From: U.S. BANK NATIONAL ASSOCIATION
To: SORENSON COMMUNICATIONS, LLC; SORENSON IP HOLDINGS, LLC; CAPTIONCALL, LLC; INTERACTIVECARE, LLC
Reel/Frame 049115/0468 →
RELEASE OF SECURITY INTEREST Recorded May 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: SORENSON COMMUNICATIONS, LLC; SORENSON IP HOLDINGS, LLC; CAPTIONCALL, LLC; INTERACTIVECARE, LLC
Reel/Frame 049109/0752 →
PATENT SECURITY AGREEMENT Recorded Apr 29, 2019
From: SORENSEN COMMUNICATIONS, LLC; CAPTIONCALL, LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 050084/0793 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2018
From: CAPTIONCALL, LLC
To: SORENSON IP HOLDINGS, LLC
Reel/Frame 046662/0569 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 10, 2018
From: WALKER, MERLE L, III; BOEHME, KENNETH; NOLA, PAT; ROYLANCE, SHANE
To: CAPTIONCALL, LLC
Reel/Frame 046618/0212 →