IP Library Granted Patent US 11,935,540
Granted Patent B2
US 11,935,540 · App. 17/450,030 · Granted Mar 19, 2024

Switching between speech recognition systems

Inventors: David Thomson (North Salt Lake, UT); David Black (West Valley City, UT); Jonathan Skaggs (Provo, UT); Kenneth Boehme (South Jordan, UT); Shane Roylance (Farmington, UT)
Assignee: Sorenson IP Holdings, LLC
G10L15/32G10L15/22G10L15/26G10L15/28H04M3/42382H04M3/42391H04M2201/39H04M2201/40H04M2203/552
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,935,540
App. No.
17/450,030
Granted
Mar 19, 2024
Kind
B2
Abstract

A method may include obtaining first audio data originating at a first device during a communication session between the first device and a second device. The method may also include obtaining an availability of revoiced transcription units in a transcription system and in response to establishment of the communication session, selecting, based on the availability of revoiced transcription units, a revoiced transcription unit instead of a non-revoiced transcription unit to generate a transcript of the first audio data. The method may also include obtaining revoiced audio generated by a revoicing of the first audio data by a captioning assistant and generating a transcription of the revoiced audio using an automatic speech recognition system. The method may further include in response to selecting the revoiced transcription unit, directing the transcription of the revoiced audio to the second device as the transcript of the first audio data.

Claims (36)

1. A method comprising

obtaining, at a system, first audio data during a first communication session that includes a device and a second device;

selecting, automatically and independently by the system based on a first number of a plurality of first transcription units that are available, one of the plurality of first transcription units instead of one of a plurality of second transcription units to generate a transcription of the first audio data to direct to the device, wherein the plurality of first transcription units use a first process to generate transcripts and the plurality of second transcription units use a second process to generate transcripts that is different than the first process;

obtaining, by the system, second audio data during a second communication session that includes the device and that is different from the first communication session; and

selecting, automatically and independently by the system based on one or more features of the second communication session, the one or more features including the second device being associated with a business and a second number of the plurality of first transcription units that are available, one of the plurality of second transcription units instead of one of the plurality of first transcription units to generate a transcription of the second audio data to direct to the device.

2. The method of claim 1 , further comprising directing the transcription generated by the selected transcription unit to the device.

3. The method of claim 2 , wherein the one or more features include a preference of a user of the second device.

4. The method of claim 2 , wherein the one or more features include estimated accuracy of the plurality of second transcription units during one or more previous communication sessions between the device and the second device.

5. The method of claim 1 , wherein the availability of the second number of the plurality of first transcription units indicates that the second number of the plurality of first transcription units that are idle and available to generate transcriptions of audio is below or estimated to be below a threshold.

6. The method of claim 1 , wherein the one or more features include an estimated accuracy of the plurality of second transcription units for the second communication session.

7. The method of claim 1 , wherein the second number is less than the first number.

8. The method of claim 1 , further comprising:

obtaining, by the system, third audio data during a third communication session that includes the device and that is different from the first communication session and the second communication session; and

selecting, automatically and independently by the system based on a third number of the plurality of first transcription units that are available, one of the plurality of second transcription units instead of one of the plurality of first transcription units to generate a transcription of the second audio data to direct to the device, wherein the third number is less than the first number and the second number.

9. At least one non-transitory computer-readable media configured to store one or more instructions that in response to being executed by at least one computing system cause performance of the method of claim 1 .

10. A method comprising:

obtaining, at a system, first audio data during a communication session; and

selecting, automatically and independently by the system based on one or more features of the communication session and an availability of a plurality of first transcription units, a transcription unit of a plurality of second transcription units instead of one of the plurality of first transcription units to generate a transcription of the first audio data, wherein the plurality of first transcription units use a first process to generate transcripts and the plurality of second transcription units use a second process to generate transcripts that is different than the first process, wherein the availability of the plurality of first transcription units indicates that a number of the plurality of first transcription units that are idle and available to generate transcriptions of audio is below or estimated to be below a threshold.

11. The method of claim 10 , wherein the communication session includes a first device and a second device, the method further comprising directing the transcription generated by the selected transcription unit to the first device.

12. The method of claim 11 , wherein the one or more features include a preference of a user of the second device.

13. The method of claim 11 , wherein the one or more features include estimated accuracy of the plurality of second transcription units during one or more previous communication sessions between the first device and the second device.

14. The method of claim 11 , wherein the one or more features include the second device being associated with a business.

15. The method of claim 10 , wherein the one or more features include an estimated accuracy of the plurality of second transcription units for the communication session.

16. The method of claim 10 , further comprising:

obtaining, by the system, second audio data during a second communication session that is different from the communication session; and

selecting, automatically and independently by the system based on a second number of the plurality of first transcription units that are available, one of the plurality of first transcription units instead of one of the plurality of second transcription units to generate a transcription of the second audio data.

17. At least one non-transitory computer-readable media configured to store one or more instructions that in response to being executed by at least one computing system cause performance of the method of claim 10 .

18. A system comprising:

at least one computing system; and

at least one computer-readable media coupled to the at least one computing system, the at least one computer-readable media configured to store one or more instructions that in response to being executed by the at least one computing system cause performance of operations, the operations comprising:

obtain first audio data during a communication session; and

select, automatically and independently based on one or more features of the communication session and an availability of a plurality of first transcription units , a transcription unit of a plurality of second transcription units instead of one of the plurality of first transcription units to generate a transcription of the first audio data, wherein the plurality of first transcription units use a first process to generate transcripts and the plurality of second transcription units use a second process to generate transcripts that is different than the first process, wherein the availability of the plurality of first transcription units indicates that a number of the plurality of first transcription units that are idle and available to generate transcriptions of audio is below or estimated to be below a threshold.

19. The system of claim 18 , wherein the one or more features include an estimated accuracy of the plurality of second transcription units for the communication session.

20. The system of claim 18 , wherein the operations further comprise:

obtain second audio data during a second communication session that is different from the communication session; and

select, automatically and independently based on a second number of the plurality of first transcription units that are available, a transcription unit of the plurality of first transcription units instead of one of the plurality of second transcription units to generate a transcription of the second audio data.

Assignments (3)
SECURITY INTEREST Recorded Apr 23, 2024
From: SORENSON COMMUNICATIONS, LLC; INTERACTIVECARE, LLC; CAPTIONCALL, LLC
To: OAKTREE FUND ADMINISTRATION, LLC, AS COLLATERAL AGENT
Reel/Frame 067573/0201 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 7, 2021
From: HOLM, MICHAEL; BLACK, DAVID; BAROCIO, JESSE; THOMSON, DAVID; BOEKWEG, SCOTT; ROYLANCE, SHANE; CLEMENTS, KIERSTEN; BOEHME, KENNETH; ADAMS, JADIE; SKAGGS, JONATHAN; ORZECHOWSKI, GRZEGORZ; MCCLELLAN, JOSHUA
To: CAPTIONCALL, LLC
Reel/Frame 057728/0780 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 7, 2021
From: CAPTIONCALL, LLC
To: SORENSON IP HOLDINGS, LLC
Reel/Frame 057728/0809 →
Continuity (3)
Continuation 16847200 · Apr 13, 2020
Continuation 16209594 · Dec 4, 2018
Related Publication 20220028397A1 · Jan 27, 2022
Cited By (4)
US 12,407,777 US 12,488,799 US 12,567,418 US 12,585,821