IP Library Granted Patent US 10,304,459
Granted Patent B2
US 10,304,459 · App. 15/782,728 · Granted May 28, 2019

Transcription presentation of communication sessions

Inventors: Michael Holm (Bountiful, UT); Jasper C. Pan (Draper, UT)
Assignee: Sorenson IP Holdings, LLC
G10L15/26G10L15/01G10L15/18G10L15/265G10L15/28G10L15/30H04M1/2473H04M1/2475H04M1/2535H04M3/42391H04M7/0036H04M1/7253H04M3/42221H04M2201/40H04M2201/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,304,459
App. No.
15/782,728
Granted
May 28, 2019
Kind
B2
Abstract

A method may include establishing a communication session with a remote device over a network. After establishing the communication session with the remote device, the method may include obtaining remote audio from the remote device that is provided by the remote device as part of the communication session. The method may also include directing the remote audio received from the remote device to a local device participating in the communication session and to a remote transcription system and obtaining transcript data from the remote transcription system based on the remote audio. The transcript data may include a transcription of the remote audio. The method may further include directing the transcript data to a television for presentation of the transcription of the remote audio by the television such that the transcription of the remote audio is presented substantially aligned with presentation of the remote audio by the local device.

Claims (45)

1. A method to present transcripts of a communication, the method comprising:

establishing, by a device associated with a user, a communication session with a remote device over a public switched telephone network;

after establishing the communication session with the remote device, obtaining, at the device, remote audio from the remote device that is provided by the remote device as part of the communication session;

directing, by the device and during the communication session, the remote audio received from the remote device to a local device associated with the user and configured to broadcast the remote audio to the user and to a remote transcription system, the local device and the remote transcription system only receiving the remote audio by way of the device;

obtaining, at the device, transcript data from the remote transcription system based on the remote audio, the transcript data including a transcription of the remote audio; and

directing, by the device and during the communication session, the transcript data to a television associated with the user for presentation of the transcription of the remote audio by the television such that the transcription of the remote audio is presented substantially aligned with the broadcasting of the remote audio by the local device, the device, the television, and the local device each being a separate distinct device that is associated with the user.

2. The method of claim 1 , wherein the transcript data is directed to the television by way of an adapter device.

3. The method of claim 1 , further comprising:

combining the transcript data with a television video stream; and

providing the combined transcript data and television video stream to the television to present the transcription of the remote audio.

4. The method of claim 3 , wherein the combining of the transcript data and the television video stream includes overlaying the transcription of the remote audio on the television video stream.

5. The method of claim 1 , further comprising, in response to directing the transcript data to the television, reducing a level of television audio output by the television.

6. The method of claim 1 , further comprising, in response to directing the transcript data to the television, directing the television to come to an awake state.

7. The method of claim 1 , further comprising:

obtaining local audio from the local device; and

directing the local audio to the remote device over the public switched telephone network.

8. A system that includes at least one non-transitory computer-readable media configured to store one or more instructions that, in response to being executed by one or more processors, cause the system to perform the method of claim 1 .

9. A method to present transcripts of a communication, the method comprising:

establishing, by a device associated with a user, a communication session with a remote device over a network;

after establishing the communication session with the remote device, obtaining, by the device, remote audio from the remote device that is provided by the remote device as part of the communication session;

directing, by the device and during the communication session, the remote audio received from the remote device to a local device associated with the user and configured to broadcast the remote audio to the user and to a remote transcription system, the local device and the remote transcription system only receiving the remote audio by way of the device;

obtaining, at the device, transcript data from the remote transcription system based on the remote audio, the transcript data including a transcription of the remote audio; and

directing, by the device and during the communication session, the transcript data to a television associated with the user for presentation of the transcription of the remote audio by the television such that the transcription of the remote audio is presented substantially aligned with the broadcasting of the remote audio by the local device, the device, the television, and the local device each being a separate distinct device that is associated with the user.

10. The method of claim 9 , wherein the network is selected from a group comprising: a cellular network, a public switched telephone network, and an Internet Protocol (IP) network.

11. The method of claim 9 , wherein the transcript data is directed to the television by way of an adapter device.

12. The method of claim 9 , further comprising combining the transcript data with a television video stream to present the transcription of the remote audio by the television.

13. The method of claim 9 , further comprising, in response to directing the transcript data to the television, directing the television to reduce a level of television audio output by the television.

14. The method of claim 9 , further comprising, in response to directing the transcript data to the television, directing the television to come to an awake state.

15. A system that includes at least one non-transitory computer-readable media configured to store one or more instructions that, in response to being executed by one or more processors, cause the system to perform the method of claim 9 .

16. A device comprising:

one or more computer-readable media configured to store instructions; and

at least one processor communicatively coupled to the computer-readable media, the at least one processor configured to execute the instructions to cause the device to perform operations, the operations comprising:

establish, by the device, which is associated with a user, a communication session with a remote device over a network;

after establishing the communication session with the remote device, obtain, at the device, remote audio from the remote device that is provided by the remote device as part of the communication session;

direct, by the device and during the communication session, the remote audio received from the remote device to a local device associated with the user and configured to broadcast the remote audio to the user and to a remote transcription system, the local device and the remote transcription system only receiving the remote audio by way of the device;

obtain, at the device, transcript data from the remote transcription system based on the remote audio, the transcript data including a transcription of the remote audio; and

direct, by the device and during the communication session, the transcript data to a television associated with the user for presentation of the transcription of the remote audio by the television such that the transcription of the remote audio is presented substantially aligned with the broadcasting of the remote audio by the local device, the device, the television, and the local device each being a separate distinct device that is associated with the user.

17. The device of claim 16 , wherein the network is selected from a group comprising: a cellular network, a public switched telephone network, and an Internet Protocol (IP) network.

18. The device of claim 16 , wherein the communication session enables a remote user of the remote device to audibly communicate with the user of the device through the remote device and the device, by exchange of the remote audio and audio from the device.

19. The device of claim 16 , wherein the communication session is a video communication session and the operations further comprise:

obtain remote video from the remote device that is provided by the remote device as part of the communication session; and

direct the remote video received from the remote device to the television for presentation of the remote video.

20. The device of claim 16 , wherein the operations further comprise:

obtaining local audio from the local device; and

directing the local audio to the remote device as part of the communication session.

Assignments (11)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY DATA THE NAME OF THE LAST RECEIVING PARTY SHOULD BE CAPTIONCALL, LLC PREVIOUSLY RECORDED ON REEL 67190 FRAME 517. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded May 31, 2024
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
To: SORENSON IP HOLDINGS, LLC; SORENSON COMMUNICATIONS, LLC; CAPTIONCALL, LLC
Reel/Frame 067591/0675 →
SECURITY INTEREST Recorded Apr 23, 2024
From: SORENSON COMMUNICATIONS, LLC; INTERACTIVECARE, LLC; CAPTIONCALL, LLC
To: OAKTREE FUND ADMINISTRATION, LLC, AS COLLATERAL AGENT
Reel/Frame 067573/0201 →
RELEASE OF SECURITY INTEREST Recorded Apr 23, 2024
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
To: SORENSON IP HOLDINGS, LLC; SORENSON COMMUNICATIONS, LLC; CAPTIONALCALL, LLC
Reel/Frame 067190/0517 →
RELEASE OF SECURITY INTEREST Recorded Dec 16, 2021
From: CORTLAND CAPITAL MARKET SERVICES LLC
To: CAPTIONCALL, LLC; SORENSON COMMUNICATIONS, LLC
Reel/Frame 058533/0467 →
JOINDER NO. 1 TO THE FIRST LIEN PATENT SECURITY AGREEMENT Recorded Apr 22, 2021
From: SORENSON IP HOLDINGS, LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 056019/0204 →
LIEN Recorded Feb 11, 2020
From: SORENSON COMMUNICATIONS, LLC; CAPTIONCALL, LLC
To: CORTLAND CAPITAL MARKET SERVICES LLC
Reel/Frame 051894/0665 →
RELEASE OF SECURITY INTEREST Recorded May 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: SORENSON COMMUNICATIONS, LLC; SORENSON IP HOLDINGS, LLC; CAPTIONCALL, LLC; INTERACTIVECARE, LLC
Reel/Frame 049109/0752 →
PATENT SECURITY AGREEMENT Recorded Apr 29, 2019
From: SORENSEN COMMUNICATIONS, LLC; CAPTIONCALL, LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 050084/0793 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 20, 2019
From: CAPTIONCALL, LLC
To: SORENSON IP HOLDINGS, LLC
Reel/Frame 048388/0064 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 11, 2019
From: HOLM, MICHAEL; PAN, JASPER C.
To: CAPTIONCALL, LLC
Reel/Frame 048298/0594 →
SECURITY INTEREST Recorded Apr 30, 2018
From: SORENSON COMMUNICATIONS, LLC; INTERACTIVECARE, LLC; CAPTIONCALL, LLC
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 046416/0166 →
Continuity (2)
Provisional Application 62407302 · Oct 12, 2016
Related Publication 20180103136A1 · Apr 12, 2018