IP Library Granted Patent US 12,026,978
Granted Patent B2
US 12,026,978 · App. 17/827,946 · Granted Jul 2, 2024

Measuring and transmitting emotional feedback in group teleconferences

Inventors: Tomas Gorny (Scottsdale, AZ); Jean-Baptiste Martinoli (St Anaclet de Lesard, CA); Tracy Conrad (Scottsdale, AZ); Lukas Gorny (Scottsdale, AZ)
Assignee: Nextiva, Inc.
G06V40/174H04N7/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,026,978
App. No.
17/827,946
Granted
Jul 2, 2024
Kind
B2
Abstract

A system and method are disclosed for generating a teleconference space for two or more communication devices using a computer coupled with a database and comprising a processor and memory. The computer generates a teleconference space and transmits requests to join the teleconference space to the two or more communication devices. The computer stores in memory identification information for each of the two or more communication devices. Each of the two or more communication devices stores audiovisual data pertaining to one or more users associated with each of the two or more communication devices. Each communication device converts the audiovisual data into facial expressions data, generates emotions data from the facial expressions data, generates attention data from the emotions data, and transmits the attention data from the communication device to the computer. The computer displays the attention data.

Claims (49)

1. A system, comprising:

two or more communication devices; and

a computer coupled with a database and comprising a processor and memory, the computer configured to generate a teleconference space in which the two or more communication devices participate by:

generating a teleconference space;

transmitting requests to join the teleconference space to the two or more communication devices;

storing in the computer memory identification information for each of the two or more communication devices;

storing audiovisual data pertaining to one or more users associated with each of the two or more communication devices;

generating attention data from the audiovisual data based, at least in part, on an interpolation of facial structure data of the one or more users with one or more facial expression templates;

transmitting the attention data from each of the two or more communication devices to the computer;

transmitting teleconference data and the attention data from the computer to each of the two or more communication devices; and

displaying the attention data on each of the two or more communication devices, wherein the attention data is displayed as a plurality of values, wherein each value of the plurality of values corresponds to each of other communication devices participating in the teleconference space.

2. The system of claim 1 , wherein the teleconference data is one or more selected from a group consisting of: a video file, a real-time visual stream, one or more individual image snapshots and audio information.

3. The system of claim 1 , further comprising the system comparing facial expressions data with one or more facial expression templates to interpolate emotions associated with one or more facial expressions.

4. The system of claim 1 , wherein the identification information comprises:

end user ID information, end user personal identification number (PIN) information, communication device ID information or communication device MAC address information.

5. The system of claim 1 , further comprising the system prioritizing the teleconference data transmitted to one or more predetermined communication devices based on the identification information.

6. The system of claim 1 , further comprising displaying on each of the two or more communication devices a participant panel identifying participating communication devices by names of users associated with the participating communication devices or according to a corresponding type of communication device.

7. The system of claim 1 , wherein the computer and the database comprises one or more cloud systems.

8. A computer-implemented method, comprising:

generating, using a computer coupled with a database and comprising a processor and memory, a teleconference space in which two or more communication devices participate;

transmitting requests to join the teleconference space to the two or more communication devices;

storing in the computer memory identification information for each of the two or more communication devices;

storing audiovisual data pertaining to one or more users associated with each of the two or more communication devices;

generating attention data from the audiovisual data based, at least in part, on an interpolation of facial structure data of the one or more users with one or more facial expression templates;

transmitting the attention data from each of the two or more communication devices to the computer;

transmitting teleconference data and the attention data from the computer to each of the two or more communication devices; and

displaying the attention data on each of the two or more communication devices, wherein the attention data is displayed as a plurality of values, wherein each value of the plurality of values corresponds to each of other communication devices participating in the teleconference space.

9. The computer-implemented method of claim 8 , wherein the teleconference data is one or more selected from a group consisting of: a video file, a real-time visual stream, one or more individual image snapshots and audio information.

10. The computer-implemented method of claim 8 , further comprising comparing facial expressions data with one or more facial expression templates to interpolate emotions associated with one or more facial expressions.

11. The computer-implemented method of claim 8 , wherein the identification information comprises:

end user ID information, end user personal identification number (PIN) information, communication device ID information or communication device MAC address information.

12. The computer-implemented method of claim 8 , further comprising prioritizing the teleconference data transmitted to one or more predetermined communication devices based on the identification information.

13. The computer-implemented method of claim 8 , displaying on each of the two or more communication devices a participant panel identifying participating communication devices by names of users associated with the participating communication devices or according to a corresponding type of communication device.

14. The computer-implemented method of claim 8 , wherein the computer and the database comprises one or more cloud systems.

15. A non-transitory computer-readable storage medium embodied with software, the software when executed configured to:

generate, using a computer coupled with a database and comprising a processor and memory, a teleconference space in which two or more communication devices participate;

transmit requests to join the teleconference space to the two or more communication devices;

store in the computer memory identification information for each of the two or more communication devices;

store audiovisual data pertaining to one or more users associated with each of the two or more communication devices;

generate attention data from the audiovisual data based, at least in part, on an interpolation of facial structure data of the one or more users with one or more facial expression templates;

transmit the attention data value from each of the two or more communication devices to the computer;

transmitting teleconference data and the attention data from the computer to each of the two or more communication devices; and

display the attention data on each of the two or more communication devices, wherein the attention data is displayed as a plurality of values, wherein each value of the plurality of values corresponds to each of other communication devices participating in the teleconference space.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the teleconference data is one or more selected from a group consisting of: a video file, a real-time visual stream, one or more individual image snapshots and audio information.

17. The non-transitory computer-readable storage medium of claim 15 , wherein the software when executed is further configured to compare facial expressions data with one or more facial expression templates to interpolate emotions associated with one or more facial expressions.

18. The non-transitory computer-readable storage medium of claim 15 , wherein the identification information comprises:

end user ID information, end user personal identification number (PIN) information, communication device ID information or communication device MAC address information.

19. The non-transitory computer-readable storage medium of claim 15 , wherein the software when executed is further configured to prioritize the teleconference data transmitted to one or more predetermined communication devices based on the identification information.

20. The non-transitory computer-readable storage medium of claim 15 , wherein the software when executed is further configured to display on each of the two or more communication devices a participant panel identifying participating communication devices by names of users associated with the participating communication devices or according to a corresponding type of communication device.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE CORRECT THE PROPERTY NUMBERS PREVIOUSLY RECORDED AT REEL: 67172 FRAME: 404. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 23, 2024
From: NEXTIVA, INC.; THRIO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS ADMINISTRATIVE AGENT
Reel/Frame 067308/0183 →
SECURITY INTEREST Recorded Apr 19, 2024
From: NEXTIVA, INC.; THRIO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS ADMINISTRATIVE AGENT
Reel/Frame 067172/0404 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2023
From: GORNY, TOMAS; MARTINOLI, JEAN-BAPTISTE; CONRAD, TRACY; GORNY, LUKAS
To: NEXTIVA, INC.
Reel/Frame 062336/0532 →
Continuity (3)
Continuation 16845739 · Apr 10, 2020
Provisional Application 62867361 · Jun 27, 2019
Related Publication 20220292879A1 · Sep 15, 2022