IP Library Granted Patent US 10,468,028
Granted Patent B2
US 10,468,028 · App. 15/782,734 · Granted Nov 5, 2019

Transcription presentation of communication sessions

Inventors: Michael Holm (Bountiful, UT); Jasper C. Pan (Draper, UT)
Assignee: Sorenson IP Holdings, LLC
G10L15/26G10L15/01G10L15/18G10L15/265G10L15/28G10L15/30H04M1/2473H04M1/2475H04M1/2535H04M3/42391H04M7/0036H04M1/7253H04M3/42221H04M2201/40H04M2201/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,468,028
App. No.
15/782,734
Granted
Nov 5, 2019
Kind
B2
Abstract

A system is provided that includes a first network interface for a first network type and a second network interface for a second network type that is different from the first network type. The system also includes at least one processor configured to cause the system to perform operations. The operations may include obtaining, from the first network interface, audio from a communication session with a remote device established over the first network and obtaining an indication of a communication device available to participate in the communication session and direct audio obtained from the communication session to a remote transcription system. The operations may also include directing the audio to the second network interface for transmission to the communication device, obtaining transcript data from the remote transcription system based on the audio, and directing the transcript data to the second network interface for transmission to the communication device.

Claims (54)

1. A device comprising:

a first network interface configured to direct first network traffic over a first network of a first network type;

a second network interface configured to direct second network traffic over a second network of a second network type that is different from the first network type;

one or more computer-readable media configured to store instructions; and

at least one processor communicatively coupled to the first network interface, the second network interface, and the computer-readable media, the at least one processor configured to execute the instructions to cause the device to perform operations, the operations comprising:

direct, from the device, to a remote transcription system, audio obtained from a single communication session with a remote device established over the first network interface;

direct the audio to the second network interface for transmission from the device to at least a first one of a plurality of communication devices;

obtain, at the device, transcript data from the remote transcription system based on the audio, the transcript data including a transcription of the audio; and

direct the transcript data to the second network interface for transmission from the device to at least a second one of the plurality of communication devices, the second one of the plurality of communication devices obtaining the transcript data of the single communication session only from the device.

2. The device of claim 1 , wherein the second network is a local wireless network and the first network is selected from a group comprising: a cellular network, an Internet Protocol (IP) network, and a public switched telephone network.

3. The device of claim 1 , wherein the remote transcription system obtains the audio of the single communication session directly from the device without the audio passing through any of the plurality of communication devices.

4. The device of claim 1 , wherein the first one of the plurality of communication devices is configured to broadcast the audio to a user of the first one of the plurality of communication devices and the device does not broadcast the audio to the user.

5. The device of claim 1 , wherein the single communication session is a video communication session.

6. The device of claim 1 , further comprising a third network interface configured to direct third network traffic over a third network of a third network type that is different from the first network type and the second network type, wherein the audio is directed to the remote transcription system over the third network by the third network interface.

7. The device of claim 1 , wherein the first one of the plurality of communication devices and the second one of the plurality of communication devices are selected from a group comprising: a television, a set-top box, a smart phone, a tablet, a personal health care device, and a telephone console.

8. The device of claim 1 , wherein the operations further comprise:

obtain second audio from a second communication session separate from the single communication session over the first network interface;

direct the second audio to the remote transcription system;

obtain a second indication of a second plurality of communication devices available to participate in the second communication session;

direct the second audio to the second network interface for transmission to at least a first one of the second plurality of communication devices, the first one of the second plurality of communication devices being different than the first one of the plurality of communication devices;

obtain second transcript data from the remote transcription system of the second audio, the second transcript data including a transcription of the second audio; and

direct the second transcript data to the second network interface for transmission to at least a second one of the second plurality of communication devices.

9. The device of claim 8 , wherein the second one of the plurality of communication devices is different than the second one of the second plurality of communication devices.

10. A device comprising:

a first network interface configured to direct first network traffic over a first network of a first network type;

a second network interface configured to direct second network traffic over a second network of a second network type that is different from the first network type;

one or more computer-readable media configured to store instructions; and

at least one processor communicatively coupled to the first network interface, the second network interface, and the computer-readable media, the at least one processor configured to execute the instructions to cause the device to perform operations, the operations comprising:

obtain, from the first network interface at the device, audio from a remote device from a single communication session with the remote device established over the first network;

direct, from the device, the audio obtained from the single communication session with the remote device to a remote transcription system, the remote transcription system obtaining the audio of the single communication session only from the device;

direct the audio to the second network interface for transmission from the device to a communication device;

obtain, at the device, transcript data from the remote transcription system based on the audio of the single communication session, the transcript data including a transcription of the audio; and

direct the transcript data to the second network interface for transmission from the device to the communication device, the communication device obtaining the transcript data of the single communication session only from the device.

11. The device of claim 10 , wherein the remote transcription system obtains the audio of the single communication session directly from the device without the audio passing through the communication device.

12. The device of claim 10 , wherein the single communication session is a video communication session including video and the audio, wherein the video is directed to the second network interface for transmission to the communication device.

13. The device of claim 10 , wherein the second network is a local wireless network and the first network is selected from a group comprising: a cellular network, public switched telephone network, and an Internet Protocol (IP) network.

14. The device of claim 10 , wherein the operations further comprise:

obtain, during the single communication session, a second indication of a second communication device available to participate in the single communication session; and

after obtaining the second indication, directing one or more of the audio and the transcript data to the second network interface for transmission to the second communication device.

15. The device of claim 14 , wherein only the audio and not the transcript data is directed to the second network interface for transmission to the second communication device.

16. The device of claim 14 , wherein only the transcript data and not the audio is directed to the second network interface for transmission to the second communication device.

17. A device comprising:

a first network interface configured to direct first network traffic over a first network of a first network type;

a second network interface configured to direct second network traffic over a second network of a second network type that is different from the first network type;

one or more computer-readable media configured to store instructions; and

at least one processor communicatively coupled to the first network interface, the second network interface, and the computer-readable media, the at least one processor configured to execute the instructions to cause the device to perform operations, the operations comprising:

direct, from the device, first audio obtained from a single communication session established over the first network interface to a remote transcription system, the first audio originating from a remote device participating in the single communication session;

obtain, at the device, second audio from the second network interface received over the second network from a first one of a plurality of communication devices participating in the single communication session;

direct the second audio to the first network interface for transmission from the device to the remote device;

obtain, at the device, transcript data from the remote transcription system based on the first audio, the transcript data including a transcription of the first audio; and

direct the first audio and the transcript data to the second network interface for transmission from the device to at least a second one of the plurality of communication devices, the second one of the plurality of communication devices obtaining the transcript data of the single communication session only from the device.

18. The device of claim 17 , wherein the first network is selected from a group comprising: a public switched telephone network, a cellular network, and an Internet Protocol (IP) network and the second network is a local wireless network.

19. The device of claim 17 , wherein the operations further comprise direct the first audio and the transcript data to the second network interface for transmission to the first one of the plurality of communication devices.

20. The device of claim 17 , wherein the first one of the plurality of communication devices and the second one of the plurality of communication devices are selected from a group comprising: a television, a set-top box, a smart phone, a tablet, a personal health care device, and a telephone console.

Assignments (11)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY DATA THE NAME OF THE LAST RECEIVING PARTY SHOULD BE CAPTIONCALL, LLC PREVIOUSLY RECORDED ON REEL 67190 FRAME 517. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded May 31, 2024
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
To: SORENSON IP HOLDINGS, LLC; SORENSON COMMUNICATIONS, LLC; CAPTIONCALL, LLC
Reel/Frame 067591/0675 →
SECURITY INTEREST Recorded Apr 23, 2024
From: SORENSON COMMUNICATIONS, LLC; INTERACTIVECARE, LLC; CAPTIONCALL, LLC
To: OAKTREE FUND ADMINISTRATION, LLC, AS COLLATERAL AGENT
Reel/Frame 067573/0201 →
RELEASE OF SECURITY INTEREST Recorded Apr 23, 2024
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
To: SORENSON IP HOLDINGS, LLC; SORENSON COMMUNICATIONS, LLC; CAPTIONALCALL, LLC
Reel/Frame 067190/0517 →
RELEASE OF SECURITY INTEREST Recorded Dec 16, 2021
From: CORTLAND CAPITAL MARKET SERVICES LLC
To: CAPTIONCALL, LLC; SORENSON COMMUNICATIONS, LLC
Reel/Frame 058533/0467 →
JOINDER NO. 1 TO THE FIRST LIEN PATENT SECURITY AGREEMENT Recorded Apr 22, 2021
From: SORENSON IP HOLDINGS, LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 056019/0204 →
LIEN Recorded Feb 11, 2020
From: SORENSON COMMUNICATIONS, LLC; CAPTIONCALL, LLC
To: CORTLAND CAPITAL MARKET SERVICES LLC
Reel/Frame 051894/0665 →
RELEASE OF SECURITY INTEREST Recorded May 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: SORENSON COMMUNICATIONS, LLC; SORENSON IP HOLDINGS, LLC; CAPTIONCALL, LLC; INTERACTIVECARE, LLC
Reel/Frame 049109/0752 →
PATENT SECURITY AGREEMENT Recorded Apr 29, 2019
From: SORENSEN COMMUNICATIONS, LLC; CAPTIONCALL, LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 050084/0793 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 20, 2019
From: CAPTIONCALL, LLC
To: SORENSON IP HOLDINGS, LLC
Reel/Frame 048388/0061 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 11, 2019
From: HOLM, MICHAEL; PAN, JASPER C.
To: CAPTIONCALL, LLC
Reel/Frame 048298/0602 →
SECURITY INTEREST Recorded Apr 30, 2018
From: SORENSON COMMUNICATIONS, LLC; INTERACTIVECARE, LLC; CAPTIONCALL, LLC
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 046416/0166 →
Continuity (2)
Provisional Application 62407302 · Oct 12, 2016
Related Publication 20180102130A1 · Apr 12, 2018