IP Library Granted Patent US 12,132,855
Granted Patent B2
US 12,132,855 · App. 18/298,276 · Granted Oct 29, 2024

Presentation of communications

Inventors: Adam Montero (Midvale, UT); Ji Liang (Millcreek, UT)
Assignee: Sorenson IP Holdings, LLC
H04M1/72478G10L13/02G10L15/26H04M1/2475H04M2201/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,132,855
App. No.
18/298,276
Granted
Oct 29, 2024
Kind
B2
Abstract

A method to present communications may include captioning, by a human assistant during a call between a first user using a first captioning telephone device and a second user using a second telephone device, words spoken by the second user into the second telephone device. The method may also include presenting the captioned words on a first display of the first captioning telephone device, receiving text typed into the second telephone device by the second user, and presenting the received text on the first display of the first captioning telephone device.

Claims (44)

1. A method to present communications, the method comprising:

directing, from a device to a transcription system, audio data that includes spoken words of a person;

obtaining, at the device, a transcription of the audio data from the transcription system;

presenting the transcription on a display of the device with a first indicator that indicates that the transcription originated from the audio data spoken by the person;

obtaining typed text by the person at the device; and

presenting the typed text on the display of the device with a second indicator that indicates that the typed text originates from text typed by the person and does not originate from audio data during simultaneous presentation of the typed text and the transcription on the display.

2. The method of claim 1 , wherein:

the device comprises a smartphone device having a touchscreen display and running an application; and

the typed text comprises text typed into the application via the touchscreen display.

3. The method of claim 1 , wherein the transcription is generated using a fully machine-based automatic speech recognition (ASR) process.

4. The method of claim 1 , wherein the transcription is generated using a human assistant.

5. The method of claim 1 , wherein the device includes credentials to allow the device to communicate with and receive transcription services from the transcription system.

6. The method of claim 1 , further comprising directing the typed text to the transcription system.

7. The method of claim 1 , wherein the audio data originates at a second device and the audio data is provided to the device from the second device.

8. At least one non-transitory computer-readable media configured to store one or more instructions that in response to being executed by a device cause the device to perform operations comprising:

directing, from the device to a transcription system, audio data that includes spoken words of a person;

obtaining, at the device, a transcription of the audio data from the transcription system;

presenting the transcription on a display of the device with a first indicator that indicates that the transcription originated from the audio data spoken by the person;

obtaining typed text by the person at the device; and

presenting the typed text on the display of the device with a second indicator that indicates that the typed text originates from text typed by the person and does not originate from audio data during simultaneous presentation of the typed text and the transcription on the display.

9. The non-transitory computer-readable media of claim 8 , wherein:

the device comprises a smartphone device having a touchscreen display and running an application; and

the typed text comprises text typed into the application via the touchscreen display.

10. The non-transitory computer-readable media of claim 8 , wherein the transcription is generated using a fully machine-based automatic speech recognition (ASR) process.

11. The non-transitory computer-readable media of claim 8 , wherein the transcription is generated using a human assistant.

12. The non-transitory computer-readable media of claim 8 , wherein the device includes credentials to allow the device to communicate with and receive transcription services from the transcription system.

13. The non-transitory computer-readable media of claim 8 , wherein the operations further comprise directing the typed text to the transcription system.

14. The non-transitory computer-readable media of claim 8 , wherein the audio data originates at a second device and the audio data is provided to the device from the second device.

15. A device comprising:

a display;

a processor communicatively coupled to the display; and

at least one non-transitory computer-readable media communicatively coupled to the processor and configured to store one or more instructions that, when executed by the processor, cause the device to perform operations comprising:

directing, from the device to a transcription system, audio data that includes spoken words of a person;

obtaining, at the device, a transcription of the audio data from the transcription system;

presenting the transcription on the display with a first indicator that indicates that the transcription originated from the audio data spoken by the person;

obtaining typed text by the person at the device; and

presenting the typed text on the display with a second indicator that indicates that the typed text originates from text typed by the person and does not originate from audio data during simultaneous presentation of the typed text and the transcription on the display.

16. The device of claim 15 , wherein:

the device comprises a smartphone device running an application and the display is a touchscreen display; and

the typed text comprises text typed into the application via the touchscreen display.

17. The device of claim 15 , wherein the transcription is generated using a fully machine-based automatic speech recognition (ASR) process.

18. The device of claim 15 , wherein the transcription is generated using a human assistant.

19. The device of claim 15 , wherein the device includes credentials to allow the device to communicate with and receive transcription services from the transcription system.

20. The device of claim 15 , wherein the operations further comprise directing the typed text to the transcription system.

Assignments (3)
SECURITY INTEREST Recorded Apr 23, 2024
From: SORENSON COMMUNICATIONS, LLC; INTERACTIVECARE, LLC; CAPTIONCALL, LLC
To: OAKTREE FUND ADMINISTRATION, LLC, AS COLLATERAL AGENT
Reel/Frame 067573/0201 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 11, 2023
From: CAPTIONCALL, LLC
To: SORENSON IP HOLDINGS, LLC
Reel/Frame 063284/0669 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 11, 2023
From: MONTERO, ADAM; LIANG, JI
To: CAPTIONCALL, LLC
Reel/Frame 063284/0702 →
Continuity (2)
Continuation 17074277 · Oct 19, 2020
Related Publication 20230247131A1 · Aug 3, 2023