IP Library Granted Patent US 11,636,859
Granted Patent B2
US 11,636,859 · App. 17/526,757 · Granted Apr 25, 2023

Transcription summary presentation

Inventors: Scott Boekweg (South Jordan, UT); David Thomson (North Salt Lake, UT)
G10L15/26G10L15/30G10L21/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,636,859
App. No.
17/526,757
Granted
Apr 25, 2023
Kind
B2
Abstract

A method to present a summary of a transcription may include obtaining, at a first device, audio directed to the first device from a second device during a communication session between the first device and the second device. Additionally, the method may include sending, from the first device, the audio to a transcription system. The method may include obtaining, at the first device, a transcription during the communication session from the transcription system based on the audio. Additionally, the method may include obtaining, at the first device, a summary of the transcription during the communication session. Additionally, the method may include presenting, on a display, both the summary and the transcription simultaneously during the communication session.

Claims (41)

1. A method comprising:

obtaining, at a first device, a transcription of audio of a communication session involving the first device;

obtaining a level of user understanding of the transcription, the level of the user understanding of the transcription being determined based on behavior of the user;

in response to the level of user understanding satisfying a threshold, obtaining, at the first device, a summary of the transcription; and

presenting, on a display, at least one of the summary and the transcription.

2. The method of claim 1 , wherein obtaining the summary of the transcription includes the first device generating the summary during the communication session using the transcription of the communication session.

3. The method of claim 1 , wherein both the summary and the transcription are presented on the display simultaneously.

4. The method of claim 1 , further comprising:

obtaining, at the first device, the audio of the communication session; and

sending, from the first device, the audio to a transcription system, wherein the first device obtains the transcription from the transcription system.

5. The method of claim 1 , wherein the behavior of the user used to determine the level of the user understanding of the transcription includes one or more of: image data of the user and sound data from the audio.

6. The method of claim 5 , wherein the image data includes one or more of facial expressions of the user and a location of focus of eyes of the user.

7. The method of claim 5 , wherein the sound data includes one or more of words spoken by the user and audio characteristics of speech of the user.

8. The method of claim 1 , further comprising ceasing to present the summary in response to an indication of an occurrence of an event associated with the communication session.

9. A system comprising:

a display;

at least one processor coupled to the display and configured to direct data to be presented on the display; and

at least one computer-readable media coupled to the processor and configured to store one or more instructions that when executed by the processor cause or direct the system to perform operations comprising:

obtaining a transcription of audio of a communication session involving the system;

obtaining a level of user understanding of the transcription, the level of the user understanding of the transcription being determined based on behavior of the user;

in response to the level of user understanding satisfying a threshold, obtaining a summary of the transcription; and

directing presentation on the display of at least one of the summary and the transcription.

10. The system of claim 9 , wherein obtaining the summary of the transcription includes generating the summary during the communication session using the transcription of the communication session.

11. The system of claim 9 , wherein both the summary and the transcription are directed to be presented on the display simultaneously.

12. The system of claim 9 , wherein the behavior of the user used to determine the level of the user understanding of the transcription includes one or more of: image data of the user and sound data from the audio.

13. The system of claim 12 , wherein the image data includes one or more of facial expressions of the user and a location of focus of eyes of the user.

14. The system of claim 12 , wherein the sound data includes one or more of words spoken by the user and audio characteristics of speech of the user.

15. The system of claim 9 , wherein the operations further comprise:

obtaining the audio of the communication session; and

sending the audio to a transcription system, wherein the system obtains the transcription from the transcription system.

16. A system comprising:

at least one processor; and

at least one computer-readable media coupled to the processor and configured to store one or more instructions that when executed by the processor cause or direct the system to perform operations, the operations comprising:

obtaining a transcription of audio of a communication session involving a first device;

obtaining a level of user understanding of the transcription, the level of the user understanding of the transcription being determined based on behavior of the user;

in response to the level of user understanding satisfying a threshold, obtaining a summary of the transcription; and

providing one or more of the transcription and the summary to the first device for presentation.

17. The system of claim 16 , wherein the operations to provide one or more of the transcription and the summary includes providing both the transcription and the summary to the first device for presentation during the communication session.

18. The system of claim 16 , wherein the behavior of the user used to determine the level of the user understanding of the transcription includes one or more of: image data of the user and sound data from the audio.

19. The system of claim 18 , wherein the image data includes one or more of facial expressions of the user and a location of focus of eyes of the user.

20. The system of claim 18 , wherein the sound data includes one or more of words spoken by the user and audio characteristics of speech of the user.

Assignments (3)
SECURITY INTEREST Recorded Apr 23, 2024
From: SORENSON COMMUNICATIONS, LLC; INTERACTIVECARE, LLC; CAPTIONCALL, LLC
To: OAKTREE FUND ADMINISTRATION, LLC, AS COLLATERAL AGENT
Reel/Frame 067573/0201 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 19, 2021
From: CAPTIONCALL, LLC
To: SORENSON IP HOLDINGS, LLC
Reel/Frame 058168/0504 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 19, 2021
From: THOMSON, DAVID; BOEKWEG, SCOTT
To: CAPTIONCALL, LLC
Reel/Frame 058168/0517 →