Granted Patent B2

US 10,332,521 · App. 15/782,719 · Granted Jun 25, 2019

Inventors: Michael Holm (Bountiful, UT); Jasper C. Pan (Draper, UT)

Assignee: Sorenson IP Holdings, LLC

G10L15/26G10L15/01G10L15/18G10L15/265G10L15/28G10L15/30H04M1/2473H04M1/2475H04M1/2535H04M3/42221H04M3/42391H04M1/7253H04M2201/40H04M2201/60

Abstract

Claims (61)

1. A method to provide transcripts of a communication, the method comprising:

obtaining, at a device associated with a user, a request for a communication session from a remote device;

in response to obtaining the request, sending, from the device, a communication session notification to a first local device associated with the user;

obtaining, at the device, a communication session initiation indication for the communication session from the first local device based on user input of the user obtained by the first local device;

in response to obtaining the communication session initiation indication, establishing the communication session with the remote device;

after establishing the communication session with the remote device, obtaining, at the device, remote audio of the communication session from the remote device;

directing, from the device and during the communication session, the remote audio received from the remote device to a remote transcription system and to a second local device associated with the user;

obtaining, at the device, transcript data from the remote transcription system based on the remote audio, the transcript data including a transcription of the remote audio; and

directing, from the device and during the communication session, the transcript data to a third local device associated with the user.

2. The method of claim 1 , further comprising:

obtaining first audio of the communication session from a fourth local device associated with the user that does not obtain the transcript data; and

directing the first audio to the remote device as part of the communication session with the remote device.

3. The method of claim 2 , further comprising directing the first audio obtained from the fourth local device to the second local device.

4. The method of claim 1 , wherein the transcript data is not directed to the second local device.

5. The method of claim 1 , further comprising:

obtaining second audio from one or more of: the first local device, the second local device, and the third local device; and

directing the second audio to the remote device as part of the communication session with the remote device.

6. The method of claim 1 , wherein the communication session is a video communication session and the method further comprises:

after establishing the communication session with the remote device, obtaining remote video from the remote device; and

directing the remote video to the second local device.

7. A system that includes at least one non-transitory computer-readable media configured to store one or more instructions that, in response to being executed by one or more processors, cause the system to perform the method of claim 1 .

8. A method to provide transcripts of a communication, the method comprising:

obtaining, at a device associated with a user, information from a plurality of local devices each associated with the user, the information indicating a configuration of each of the plurality of local devices with respect to a capability to: receive and broadcast remote audio and display transcriptions of the remote audio;

establishing a communication session with a remote device;

after establishing the communication session with the remote device, obtaining, at the device, the remote audio of the communication session from the remote device;

directing, from the device during the communication session, the remote audio to a first local device of the plurality of local devices based on the first local device being configured to receive and broadcast remote audio; and

directing, from the device during the communication session, transcript data that includes a transcription of the remote audio to a second local device of the plurality of local devices based on the second local device being configured to display transcriptions of the remote device audio.

9. The method of claim 8 , further comprising:

directing the remote audio received from the remote device to a remote transcription system; and

obtaining the transcript data from the remote transcription system based on the remote audio.

10. The method of claim 8 , wherein the first local device is not configured to display transcriptions of the remote device audio such that the transcript data is not directed to the first local device.

11. The method of claim 8 , wherein the communication session is a video communication session and the information indicates the configuration of each of the plurality of local devices with respect to a capability to: receive and broadcast remote audio, receive and display remote video, and display transcriptions of the remote device audio, and the method further comprises:

after establishing the communication session with the remote device, obtaining remote video from the remote device; and

directing the remote video to the second local device based on the second local device being configured to receive and display remote video.

12. The method of claim 8 , wherein the information indicates the configuration of each of the plurality of local devices with respect to a capability to: receive and broadcast remote audio, receive and transmit local audio, and display transcriptions of the remote device audio, and the method further comprises:

after establishing the communication session with the remote device, obtaining local audio from a third local device of the plurality of local devices that is configured to receive and transmit local audio; and

directing the local audio to the remote device.

13. The method of claim 8 , further comprising:

detecting the plurality of local devices; and

after detecting the plurality of local devices, establishing a network connection with each of the plurality of local devices, wherein the information indicating the configuration of each of the plurality of local devices is obtained after establishing the network connection with each of the plurality of local devices.

14. A system that includes at least one non-transitory computer-readable media configured to store one or more instructions that, in response to being executed by one or more processors, cause the system to perform the method of claim 8 .

15. A device comprising:

one or more computer-readable media configured to store instructions; and

at least one processor communicatively coupled to the computer-readable media, the at least one processor configured to execute the instructions to cause the device to perform operations, the operations comprising:

obtain, at the device, which is associated with a user, information from a plurality of local devices each associated with the user, the information indicating a configuration of each of the plurality of local devices with respect to a capability to: receive and broadcast remote audio and display transcriptions of the remote audio;

establish a communication session between the device and a remote device;

after establishing the communication session with the remote device, obtain, at the device, the remote audio of the communication session from the remote device;

direct, from the device, the remote audio of the communication session to a first local device of the plurality of local devices based on the first local device being configured to receive and broadcast remote audio; and

direct, from the device, transcript data that includes a transcription of the remote audio of the communication session to a second local device of the plurality of local devices based on the second local device being configured to display transcriptions of the remote device audio.

16. The device of claim 15 , wherein the operations further comprise:

direct the remote audio received from the remote device to a remote transcription system; and

obtain the transcript data from the remote transcription system based on the remote audio.

17. The device of claim 15 , wherein the first local device is not configured to display transcriptions of the remote device audio such that the transcript data is not directed to the first local device.

18. The device of claim 15 , wherein the communication session is a video communication session and the information indicates the configuration of each of the plurality of local devices with respect to a capability to: receive and broadcast remote audio, receive and display remote video, and display transcriptions of the remote device audio, and the operations further comprise:

after establishing the communication session with the remote device, obtain remote video from the remote device; and

direct the remote video to the second local device based on the second local device being configured to receive and display remote video.

19. The device of claim 15 , wherein the information indicates the configuration of each of the plurality of local devices with respect to a capability to: receive and broadcast remote audio, receive and transmit local audio, and display transcriptions of the remote device audio, and the operations further comprise:

after establishing the communication session with the remote device, obtain local audio from a third local device of the plurality of local devices that is configured to receive and transmit local audio; and

direct the local audio to the remote device.

20. The device of claim 15 , wherein the operations further comprise: detect the plurality of local devices; and

after detecting the plurality of local devices, establish a network connection with each of the plurality of local devices, wherein the information indicating the configuration of each of the plurality of local devices is obtained after establishing the network connection with each of the plurality of local devices.

Assignments (13)

Continuity (1)