IP Library Granted Patent US 11,721,344
Granted Patent B2
US 11,721,344 · App. 18/101,301 · Granted Aug 8, 2023

Automated audio-to-text transcription in multi-device teleconferences

Inventors: Tomas Gorny (Scottsdale, AZ); Jean-Baptiste Martinoli (St Anaclet de Lesard, CA); Tracy Conrad (Scottsdale, AZ); Lukas Gorny (Scottsdale, AZ)
Assignee: Nextiva, Inc.
G10L15/26G10L17/00H04M3/568
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,721,344
App. No.
18/101,301
Granted
Aug 8, 2023
Kind
B2
Abstract

A system and method are disclosed for generating a teleconference space for two or more communication devices using a computer coupled with a database and comprising a processor and memory. The computer generates a teleconference space and transmits requests to join the teleconference space to the two or more communication devices. The computer stores in memory identification information, and audiovisual data associated with one or more users, for each of the two or more communication devices. The computer stores audio transcription data, transmitted to the computer by each of the two or more communication devices and associated with one or more communication device users, in the computer memory. The computer merges the audio transcription data from each of the two or more communication devices into a master audio transcript, and transmits the master audio transcript to each of the two or more communication devices.

Claims (57)

1. A system, comprising:

two or more communication devices, each of the two or more communication devices configured to receive inbound audio and visual data from at least one other communication device and generate a selectable display of a teleconference view or a transcript view; and

a computer coupled with a database and comprising a processor and memory, the computer configured to:

generate a teleconference space;

identify two or more users based on corresponding communication device data gathered from the two or more communication devices participating in the teleconference space;

transmit a master audio transcript to each of the two or more communication devices; and

display, in response to a selection of the selectable display, the transcript view of the master audio transcript from each of the two or more telecommunication devices or the teleconference view of the visual data.

2. The system of claim 1 , wherein the computer is further configured to:

separate spoken words from background noises in the received inbound audio data.

3. The system of claim 1 , wherein the computer is further configured to:

analyze voice pitch or sound frequency to associate each transcribed word with a particular user associated with one of the two or more communication devices.

4. The system of claim 1 , wherein the computer is further configured to:

sort transcribed words into punctuated sentences; and

interpret pauses in spoken words as breaks between transcribed sentences.

5. The system of claim 1 , wherein the computer is further configured to:

associate chronological information with each transcribed word; and

store the chronological information in local device text transcript data.

6. The system of claim 1 , wherein the computer is further configured to:

transmit the master audio transcript to each of the two or more communication devices once every second or once every five seconds.

7. The system of claim 1 , wherein the computer is further configured to:

transmit visual data comprising a video file, a real-visual stream or one or more image snapshots.

8. A computer-implemented method, comprising:

configuring each of two or more communication devices to receive inbound audio and visual data from at least one other communication device and generate a selectable display of a transcript view or a teleconference view;

generating, using a computer coupled with a database and comprising a processor and memory, a teleconference space in which the two or more communication devices participate;

identifying, by the computer, two or more users based on corresponding communication device data gathered from the two or more communication devices participating in the teleconference space;

transmitting a master audio transcript to each of the two or more communication devices; and

displaying, in response to a selection of the selectable display, the transcript view of the master audio transcript from each of the two or more telecommunication devices or the teleconference view of the visual data.

9. The computer-implemented method of claim 8 , further comprising separating, by the computer, spoken words from background noises in the received inbound audio data.

10. The computer-implemented method of claim 8 , further comprising analyzing, by the computer, voice pitch or sound frequency to associate each transcribed word with a particular user associated with one of the two or more communication devices.

11. The computer-implemented method of claim 8 , further comprising:

sorting, by the computer, transcribed words into punctuated sentences; and

interpreting, by the computer, pauses in spoken words as breaks between transcribed sentences.

12. The computer-implemented method of claim 8 , further comprising:

associating, by the computer, chronological information with each transcribed word; and

storing, by the computer, the chronological information in local device text transcript data.

13. The computer-implemented method of claim 8 , further comprising:

transmitting, by the computer, the master audio transcript to each of the two or more communication devices once every second or once every five seconds.

14. The computer-implemented method of claim 8 , further comprising:

transmitting, by the computer, visual data comprising a video file, a real-visual stream or one or more image snapshots.

15. A non-transitory computer-readable storage medium embodied with software, the software when executed:

configures each of two or more communication devices to receive inbound audio and visual data from at least one other communication device and generate a selectable display of a transcript view or a teleconference view;

generates, using a computer coupled with a database and comprising a processor and memory, a teleconference space in which the two or more communication devices participate;

identifies, by the computer, two or more users based on corresponding communication device data gathered from the two or more communication devices participating in the teleconference space;

transmits a master audio transcript to each of the two or more communication devices; and

displays, in response to a selection of the selectable display, the transcript view of the master audio transcript from each of the two or more telecommunication devices or the teleconference view of the visual data.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the software when executed further:

separates spoken words from background noises in the received inbound audio data.

17. The non-transitory computer-readable storage medium of claim 15 , wherein the software when executed further:

analyzes voice pitch or sound frequency to associate each transcribed word with a particular user associated with one of the two or more communication devices.

18. The non-transitory computer-readable storage medium of claim 15 , wherein the software when executed further:

sorts transcribed words into punctuated sentences; and

interprets pauses in spoken words as breaks between transcribed sentences.

19. The non-transitory computer-readable storage medium of claim 15 , wherein the software when executed further:

associates chronological information with each transcribed word; and

stores the chronological information in local device text transcript data.

20. The non-transitory computer-readable storage medium of claim 19 , wherein the software when executed is further:

transmits visual data comprising a video file, a real-visual stream or one or more image snapshots.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE CORRECT THE PROPERTY NUMBERS PREVIOUSLY RECORDED AT REEL: 67172 FRAME: 404. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 23, 2024
From: NEXTIVA, INC.; THRIO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS ADMINISTRATIVE AGENT
Reel/Frame 067308/0183 →
SECURITY INTEREST Recorded Apr 19, 2024
From: NEXTIVA, INC.; THRIO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS ADMINISTRATIVE AGENT
Reel/Frame 067172/0404 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 26, 2023
From: GORNY, TOMAS; MARTINOLI, JEAN-BAPTISTE; CONRAD, TRACY; GORNY, LUKAS
To: NEXTIVA, INC.
Reel/Frame 062521/0387 →
Continuity (4)
Continuation 17739868 · May 9, 2022
Continuation 16861929 · Apr 29, 2020
Provisional Application 62876401 · Jul 19, 2019
Related Publication 20230169978A1 · Jun 1, 2023