IP Library Granted Patent US 11,659,078
Granted Patent B2
US 11,659,078 · App. 17/074,277 · Granted May 23, 2023

Presentation of communications

Inventors: Adam Montero (Midvale, UT); Ji Liang (Millcreek, UT)
Assignee: Sorenson IP Holdings, LLC
H04M1/72478G10L13/02G10L15/26H04M1/2475H04M2201/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,659,078
App. No.
17/074,277
Granted
May 23, 2023
Kind
B2
Abstract

A method to present communications may include captioning, by a human assistant during a call between a first user using a first captioning telephone device and a second user using a second telephone device, words spoken by the second user into the second telephone device. The method may also include presenting the captioned words on a first display of the first captioning telephone device, receiving text typed into the second telephone device by the second user, and presenting the received text on the first display of the first captioning telephone device.

Claims (68)

1. A method to present communications, the method comprising:

captioning, by a transcription system during a call between a first user using a first captioning telephone device and a second user using a second telephone device, words in audio spoken by the second user into the second telephone device, the captioning involving a human assistant;

presenting the captioned words on a first display of the first captioning telephone device with a first indicator that indicates that the captioned words were spoken by the second user;

receiving text typed into the second telephone device by the second user; and

presenting the received text on the first display of the first captioning telephone device with a second indicator that indicates that the received text was typed by the second user.

2. The method of claim 1 , wherein:

the first user is a hearing-impaired user; and

the second user is a hearing user.

3. The method of claim 1 , wherein:

the second telephone device comprises a smartphone device having a touchscreen display and running a captioning app; and

the text typed into the smartphone device comprises text typed into the captioning app via the touchscreen display.

4. The method of claim 3 , further comprising:

receiving second text typed into the first captioning telephone device by the first user; and

presenting the second text in the captioning app on the touchscreen display of the smartphone device.

5. The method of claim 1 , wherein:

the second telephone device comprises a Voice-over-IP (VoIP) telephone device having a second display and running a captioning app; and

the text typed into the VoIP telephone device comprises text typed into the captioning app.

6. The method of claim 5 , further comprising:

receiving second text typed into the first captioning telephone device by the first user; and

presenting the received second text in the captioning app on the second display of the VoIP telephone device.

7. The method of claim 1 , wherein:

the second telephone device comprises a dual-tone multi-frequency signaling (DTMF) telephone device including a telephone keypad and a speaker; and

the text typed into the DTMF telephone device by the second user comprises text typed into the telephone keypad.

8. The method of claim 7 , further comprising:

receiving second text typed into the first captioning telephone device by the first user;

converting the second text into second audio using a text-to-speech conversion; and

sending the second audio to the speaker of the DTMF telephone device.

9. The method of claim 1 , further comprising:

presenting the received text on a display of a computing device of the human assistant.

10. At least one non-transitory computer-readable media configured to store one or more instructions that in response to being executed by at least one computing system cause performance of the method of claim 1 .

11. A captioning telephone device comprising:

a display;

a speaker;

a processor communicatively coupled to the display and to the speaker; and

at least one non-transitory computer-readable media communicatively coupled to the processor and configured to store one or more instructions that, when executed by the processor, cause the captioning telephone device to perform operations comprising:

receiving, from a transcription system during a call between a first user using the captioning telephone device and a second user using a second telephone device, captions of words in audio spoken by the second user into the second telephone device, the generation of captions by the transcription system involving a human assistant;

presenting the captioned words on the display with a first indicator that indicates that the captioned words were spoken by the second user;

receiving text typed into the second telephone device by the second user; and

presenting the received text on the display with a second indicator that indicates that the received text was typed by the second user.

12. The captioning telephone device of claim 11 , wherein:

the first user is a hearing-impaired user; and

the second user is a hearing user.

13. The captioning telephone device of claim 11 , wherein:

the second telephone device comprises a smartphone device having a touchscreen display and running a captioning app; and

the text typed into the smartphone device comprises text typed into the captioning app via the touchscreen display.

14. The captioning telephone device of claim 13 , wherein:

the captioning telephone device further comprises a telephone keypad;

the operations further comprise receiving second text typed into the telephone keypad of the captioning telephone device by the first user; and

the operations further comprise sending the second text for presentation in the captioning app on the touchscreen display of the smartphone device.

15. The captioning telephone device of claim 11 , wherein:

the second telephone device comprises a Voice-over-IP (VoIP) telephone device having a second display and running a captioning app; and

the text typed into the VoIP telephone device comprises text typed into the captioning app.

16. The captioning telephone device of claim 15 , wherein the operations further comprise:

receiving second text typed into the captioning telephone device by the first user; and

sending the second text for presentation in the captioning app on the second display of the VoIP telephone device.

17. The captioning telephone device of claim 11 , wherein:

the second telephone device comprises a dual-tone multi-frequency signaling (DTMF) telephone device including a telephone keypad and a second speaker; and

the text typed into the DTMF telephone device by the second user comprises text typed into the telephone keypad.

18. The captioning telephone device of claim 17 , further comprising:

receiving second text typed into the captioning telephone device by the first user;

converting the second text into audio using a text-to-speech conversion; and

sending the audio to the second speaker of the DTMF telephone device.

19. A method to present communications, the method comprising:

obtaining, from a transcription system, a transcription of audio spoken by a first user into a first device during a communication session between the first user using the first device and a second user using a second device;

presenting the transcription on a display of the first device with a first indicator that indicates that the transcription was spoken by the second user;

obtaining text typed into the second device by the second user; and

presenting the obtained text on the display of the first device with a second indicator that indicates that the obtained text was typed by the second user.

20. The method of claim 19 , further comprising directing the obtained text from the second device to the transcription system.

Assignments (6)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY DATA THE NAME OF THE LAST RECEIVING PARTY SHOULD BE CAPTIONCALL, LLC PREVIOUSLY RECORDED ON REEL 67190 FRAME 517. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded May 31, 2024
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
To: SORENSON IP HOLDINGS, LLC; SORENSON COMMUNICATIONS, LLC; CAPTIONCALL, LLC
Reel/Frame 067591/0675 →
RELEASE OF SECURITY INTEREST Recorded Apr 23, 2024
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
To: SORENSON IP HOLDINGS, LLC; SORENSON COMMUNICATIONS, LLC; CAPTIONALCALL, LLC
Reel/Frame 067190/0517 →
SECURITY INTEREST Recorded Apr 23, 2024
From: SORENSON COMMUNICATIONS, LLC; INTERACTIVECARE, LLC; CAPTIONCALL, LLC
To: OAKTREE FUND ADMINISTRATION, LLC, AS COLLATERAL AGENT
Reel/Frame 067573/0201 →
JOINDER NO. 1 TO THE FIRST LIEN PATENT SECURITY AGREEMENT Recorded Apr 22, 2021
From: SORENSON IP HOLDINGS, LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 056019/0204 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 30, 2020
From: CAPTIONCALL, LLC
To: SORENSON IP HOLDINGS, LLC
Reel/Frame 054222/0585 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 20, 2020
From: LIANG, JI; MONTERO, ADAM
To: CAPTIONCALL, LLC
Reel/Frame 054103/0344 →