IP Library Granted Patent US 11,595,447
Granted Patent B2
US 11,595,447 · App. 17/392,857 · Granted Feb 28, 2023

Alteration of event user interfaces of an online conferencing service

Inventors: Ivo Walter Rothschild (Quebec, CA); Paul Robert Murphy (Bangkok, TH); Asahi Sato (London, GB); Antonia Theodora Hellman (New York, NY); Ethan Duncan He-Li Hellman (New York, NY); Steven Emmanuel Hellman (New York, NY)
Assignee: Toucan Events Inc.
H04L65/1059H04L65/403
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,595,447
App. No.
17/392,857
Granted
Feb 28, 2023
Kind
B2
Abstract

Techniques are disclosed relating to automatically altering a displayed user interface for an event. A server computer system may cause, via a conferencing service, display of a user interface for an event having a group of users accessing the conferencing service via a plurality of user devices, the displayed interface including an indication of a video feed of a user in the group of users that is currently active. The system may store, in a database, data for the event, including content of audio and video feeds of users in the event. The system may analyze a set of characteristics included in the content of the audio and video feeds. The system may alter, while the indication of the video feed of the user is being displayed, aspects of the displayed user interface other than the indication, where the altering is performed based on the analyzing.

Claims (53)

1. A method, comprising:

causing, by a server computer system via a conferencing service, display of a user interface for an event having a group of users accessing the conferencing service via a plurality of user computing devices, the displayed user interface including indications of video feeds of respective users in a particular sub-group of users in the group of users that is currently active;

storing, by the server computer system in a database, event data for the event, including content of audio and video feeds of respective users in the particular sub-group;

analyzing, by the server computer system, a set of characteristics included in the content of the audio and video feeds; and

altering, by the server computer system based on the analyzing and while the indications of the video feeds of users in the particular sub-group are being displayed, one or more aspects of the displayed user interface other than the indications of the video feeds of the particular sub-group, wherein the altering includes updating indications of video feeds of one or more users at least in the particular sub-group of users to display visual indications of speaking time of respective users in the particular sub-group of users relative to other users in the particular sub-group of users based on determined lengths of speaking time for users in the particular sub-group of users.

2. The method of claim 1 , wherein analyzing the set of characteristics included in the content of the audio and video feeds includes:

transcribing audio feeds of one or more users in the group of users;

extracting one or more keywords from the transcript of the audio feeds; and

mapping respective extracted keywords to a first set of user interface elements.

3. The method of claim 2 , wherein the altering includes causing display of the first set of user interface elements, wherein the first set of user interface elements indicates semantics of a current conversation occurring in the event.

4. The method of claim 3 , wherein causing display of the first set of user interface elements includes overlaying one or more of the user interface elements on a display of the particular sub-group of the group of users associated with the current conversation based on analysis of the audio feeds of the particular sub-group, wherein the overlayed display of the one or more user interface elements on the display of the particular sub-group is visible to users in the event outside of the particular sub-group of users.

5. The method of claim 2 , wherein the mapping includes mapping respective extracted keywords to one or more symbols, and wherein the symbols indicate a current topic of a conversation occurring in the event.

6. The method of claim 2 , wherein altering one or more aspects of the displayed user interface includes changing one or more aspects of video feeds of one or more users in the group of users, wherein the one or more aspects include one or more of the following types of aspects: size, shape, color, opacity, and location.

7. The method of claim 1 , wherein causing display of the user interface for the event further includes displaying indications of users included in another sub-group of users, and an indication of a user that is separate from the particular sub-group and the another sub-group.

8. The method of claim 1 , wherein the altering includes:

displaying, based on analyzing the audio feeds of users in the group of users, a user interface element indicating that at least two users in the group of users are speaking at the same time.

9. The method of claim 1 , wherein causing display of the user interface for the event having the group of users includes:

receiving, via the displayed user interface from a non-host user of the group of users, a sub-group request, wherein the sub-group request relates to the particular sub-group and does not require the non-host user to have administrative privileges for the conferencing service;

updating, in response to the sub-group request, the user interface, wherein the updated user interface:

permits the non-host user to perform audio and video interactions with members of the particular sub-group; and

indicates current sub-groups of other users of the group of users but does not permit the non-host user to perform audio and video interactions with users in those other sub-groups.

10. A non-transitory computer-readable medium having program instructions stored thereon that are executable by a server computer system to perform operations comprising:

causing, via a conferencing service, display of a user interface for an event having a group of users accessing the conferencing service via a plurality of user computing devices, the displayed user interface including indications of video feeds of respective users in a particular sub-group of a plurality of sub-groups of users in the group of users that is currently active;

storing, in a database, event data for the event, including content of audio and video feeds of respective users in the particular sub-group;

analyzing a set of characteristics included in the content of the audio and video feeds; and

altering, based on the analyzing and while the video feeds of users in the particular sub-group are being displayed, one or more aspects of the displayed user interface other than the indications of the video feeds of the particular sub-group, wherein the altering includes updating indications of video feeds of one or more users at least in the particular sub-group of users to display visual indications of speaking time of respective users in the particular sub-group of users relative to other users in the particular sub-group of users based on determined lengths of speaking time for users in the particular sub-group of users.

11. The non-transitory computer-readable medium of claim 10 , wherein analyzing the set of characteristics included in the content of the audio and video feeds includes:

transcribing audio feeds of one or more users in the group of users;

extracting one or more keywords from the transcript of the audio feeds; and

mapping respective extracted keywords to a first set of user interface elements.

12. The non-transitory computer-readable medium of claim 11 , wherein the altering includes causing display of the first set of user interface elements, wherein the first set of user interface elements indicates semantics of a current conversation occurring in the event.

13. The non-transitory computer-readable medium of claim 12 , wherein causing display of the first set of user interface elements includes overlaying one or more of the elements on a display of the particular sub-group of the group of users associated with the current conversation based on analysis of the audio feeds of the particular sub-group, wherein the overlayed display of the one or more user interface elements on the display of the particular sub-group is visible to users in the event outside of the particular sub-group of users.

14. The non-transitory computer-readable medium of claim 11 , wherein the mapping includes mapping respective extracted keywords to one or more symbols, and wherein the symbols indicate a current topic of a conversation occurring in the event.

15. The non-transitory computer-readable medium of claim 11 , wherein the altering includes:

displaying, based on analyzing the audio feeds of users in the group of users, a user interface element indicating that at least two users in the group of users are speaking at the same time.

16. A system, comprising:

at least one processor; and

a memory having instructions stored thereon that are executable by the at least one processor to cause the system to:

cause via a conferencing service, display of a user interface for an event having a group of users accessing the conferencing service via a plurality of user computing devices, the displayed user interface including an indication of video feeds of respective users in a particular sub-group of a plurality of sub-groups of users in the group of users that is currently active;

store, in a database, event data for the event, including content of audio and video feeds of respective users in the particular sub-group;

analyze a set of characteristics included in the content of the audio and video feeds; and

alter, based on the analyzing and while the indications of the video feeds of users in the particular sub-group are being displayed, one or more aspects of the displayed user interface other than the indications of the video feeds of the particular sub-group, wherein the altering includes updating indications of video feeds of one or more users at least in the particular sub-group of users to display visual indications of speaking time of respective users in the particular sub-group of users relative to other users in the particular sub-group of users based on determined lengths of speaking time for users in the particular sub-group of users.

17. The system of claim 16 , wherein analyzing the set of characteristics included in the content of the audio and video feeds includes:

transcribing audio feeds of one or more users in the group of users; and

inputting the transcript of the audio feeds into a machine learning model, wherein output of the machine learning model is user interface content, including one or more of the following types of content: image, video, animations, or text.

18. The system of claim 16 , wherein causing display of the user interface for the event having the group of users includes:

receiving, via the displayed user interface from a particular user of the group of users, a sub-group request, wherein the sub-group request relates to the particular sub-group and does not require the particular user to have administrative privileges for the conferencing service;

updating, in response to the sub-group request, the user interface, wherein the updated user interface:

permits the particular user to perform audio and video interactions with members of the particular sub-group; and

indicates current sub-groups of other users of the group of users but does not permit the particular user to perform audio and video interactions with users in those other sub-groups.

19. The system of claim 16 , wherein the set of characteristics included in the content of the audio and video feeds includes one or more of the following types of characteristics: speaking time, speaking volume, semantics of sub-group conversations, and user distraction.

20. The system of claim 16 , wherein the altering includes:

displaying, based on analyzing the audio feeds of users in the group of users, a user interface element indicating that at least two users in the group of users are speaking at the same time.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 2, 2026
From: TOUCAN EVENTS INC.
To: HELLMAN, ANTONIA
Reel/Frame 073654/0566 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 3, 2021
From: ROTHSCHILD, IVO WALTER; MURPHY, PAUL ROBERT; SATO, ASAHI; HELLMAN, ANTONIA THEODORA; HELLMAN, ETHAN DUNCAN HE-LI; HELLMAN, STEVEN EMMANUEL
To: TOUCAN EVENTS INC.
Reel/Frame 057069/0021 →
Continuity (3)
Provisional Application 63180342 · Apr 27, 2021
Provisional Application 63061576 · Aug 5, 2020
Related Publication 20220046066A1 · Feb 10, 2022