Mixing and transmitting multiplex audiovisual information

Inventors: Tomas Gorny (Scottsdale, AZ); Jean-Baptiste Martinoli (St Anaclet de Lesard, CA); Tracy Conrad (Scottsdale, AZ); Lukas Gorny (Scottsdale, AZ)

Assignee: Nextiva, Inc.

H04L65/403 H04L65/1069 H04L65/1096

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 11,765,213
App. No.: 16/836,282
Granted: Sep 19, 2023
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

A system and method are disclosed for generating a teleconference space for two or more communication devices using a computer coupled with a database and comprising a processor and memory. The computer generates a teleconference space and transmits requests to join the teleconference space to the two or more communication devices. The computer stores in memory identification information for each of the two or more communication devices. Each of the two or more communication devices transmits a communication system stream, comprising audiovisual information recorded by each communication device, to the computer. The computer stores each of the communication system streams in memory, and generates an outbound teleconference stream comprising at least one of the two or more communication system streams. The computer transmits the outbound teleconference stream to each of the two or more communication devices.

Claims (100)

1. A system, comprising:

two or more communication devices; and

a computer coupled with a database and comprising a processor and memory, the computer configured to generate a teleconference space in which the two or more communication devices participate by:

generating a teleconference space;

transmitting requests to join the teleconference space to the two or more communication devices;

storing in the computer memory identification information for each of the two or more communication devices;

storing two or more communication system streams, transmitted to the computer by each of the two or more communication devices, in the computer memory, wherein at least one of the two or more communication system streams further comprises a visual component and an audio component;

autonomously generating a customizable outbound teleconference stream comprising at least one of the two or more communication system streams and one or more user-selectable outbound teleconference stream display parameters;

transmitting the outbound teleconference stream to each of the two or more communication devices;

arranging visual components of the at least one of the two or more communication system streams, the arranging comprising expanding display windows associated with users who have most recently spoken;

receiving from each of the two or more communication devices a priority signal which specifies whether an audiovisual recording device is currently detecting audible sound input;

receiving a selection from each of the two or more communication devices to customize a display corresponding to each of the two or more communication devices, wherein the selection indicates:

which visual components out of available visual components in the outbound teleconference stream are to be displayed on the display corresponding to each of the two or more communication devices; and

a resizing of a display of one or more visual components out of the displayed visual components; and

in response to the selection indicating the resizing of the display of the one or more visual components, resizing a remainder of the displayed visual components accordingly; and

continuously determining, in response at least in part to the audio component of at least one of the two or more communication system streams, which of the at least one of the two or more communication system streams comprises the outbound teleconference stream.

2. The system of claim 1 , further comprising the computer using one or more evaluation criteria stored in the computer memory to select at least one of the two or more communication system streams to comprise the outbound teleconference stream.

3. The system of claim 2 , further comprising the computer, after transmitting the outbound teleconference stream to each of the two or more communication devices:

adjusting the outbound teleconference stream to include one or more new communication system streams transmitted to the computer by one or more new communication devices.

4. The system of claim 3 , further comprising the computer generating an outbound teleconference stream comprising a mixture of two or more communication system streams.

5. The system of claim 2 , wherein the evaluation criteria comprise one or more of:

a priority signal;

a ‘who is speaking’ signal;

a ‘recently joined’ signal; and

wherein the computer is further configured to use a first evaluation criterion to select at the least one of the two or more communication system streams to comprise the outbound teleconference stream, monitor a total number of communication systems participating in the teleconference space, and, in response to detecting the number of separate communication systems participating in the teleconference space exceeds a predetermined quantity, use a second evaluation criterion different than the first evaluation criterion.

6. The system of claim 5 , further comprising each of the two or more communication devices:

displaying, on an associated audiovisual display device, the customizable outbound teleconference stream; and

customizing at least one of the user-selectable outbound teleconference stream display parameters, the user-selectable outbound teleconference stream display parameters comprising one or more parameters selected from the list of:

a resize display parameter;

an expansion display parameter;

a contraction display parameter; and

a removal display parameter.

7. The system of claim 1 , wherein each of the two or more communication devices comprises a communication device selected from the list of:

a computer;

a tablet computer; and

a smartphone.

8. A computer-implemented method, comprising:

generating, using a computer coupled with a database and comprising a processor and memory, a teleconference space in which two or more communication devices participate;