IP Library Granted Patent US 11,871,151
Granted Patent B2
US 11,871,151 · App. 17/472,572 · Granted Jan 9, 2024

Spatialized display of chat messages

Inventors: Oded Gal (Palo Alto, CA); Andrew Law (Los Gatos, CA); Sally Lu (Los Angeles, CA); Ping Luo (Pleasanton, CA); Sharvari Nerurkar (Redmond, WA); Archil Vardidze (Austin, TX); Zheng Yuan (Santa Clara, CA)
Assignee: Zoom Video Communications, Inc.
H04N7/157H04L12/1822H04L51/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,871,151
App. No.
17/472,572
Granted
Jan 9, 2024
Kind
B2
Abstract

Methods and systems provide for a spatialized display of chat messages within a messaging platform. First, the system displays, for each of a number of participants within a messaging session, a spatial chat user interface (hereinafter “UI”) consisting of: a virtual background; and one or more spatialized avatars representing the participants. The system receives initial chat messages sent by a participant from the plurality of participants, then displays, adjacent to each of a subset of the spatialized avatars, one or more initial chat bubbles corresponding to messages sent by one or more of the participants represented by the subset of the spatialized avatars. Concurrently or subsequently, the system displays one or more other participant chat bubbles. The system receives additional chat messages sent by the participant, and then displays the additional chat bubbles, repositioning the initial chat bubbles while the additional chat bubbles are displayed in their place.

Claims (71)

1. A method for providing a spatialized display of chat messages within a messaging platform, comprising:

joining a video meeting including a plurality of participants, the video meeting including a messaging session;

determining a virtual background from multiple virtual backgrounds to use for the messaging session during the video meeting, the virtual background comprising a representation of one or more rooms, each of the one or more rooms having a plurality of seating locations, wherein a portion of the virtual background corresponds to a physical space;

determining a respective initial seating location among the plurality of seating locations in the virtual background for each of the plurality of participants, wherein:

a subset of the plurality of participants are in the physical space; and

the respective initial seating location of each participant in the subset corresponds to a location in the physical space;

displaying, for each of the plurality of participants within the messaging session, a spatial chat user interface (UI), the spatial chat UI comprising:

the virtual background; and

one or more spatialized avatar components, each of the spatialized avatar components is a representation of one of the plurality of participants overlaid on the virtual background at the determined respective initial seating location, and each of the spatialized avatar components is positioned in a spatialized fashion throughout the length and width of the virtual background;

receiving one or more initial chat messages sent by a participant from the plurality of participants;

displaying, adjacent to the spatialized avatar component representing the participant, one or more initial chat bubbles corresponding to the one or more initial chat messages sent by the participant;

displaying one or more other participant chat bubbles corresponding to messages sent by participants from the plurality of participants other than the participant;

receiving one or more additional chat messages sent by the participant; and

displaying, adjacent to the spatialized avatar component representing the participant, one or more additional chat bubbles corresponding to the one or more additional chat messages sent by the participant, the one or more initial chat bubbles are repositioned within a prespecified chat bubble area concurrently to the additional chat bubbles being displayed.

2. The method of claim 1 , wherein displaying the spatial chat UI further comprises a messaging composing component configured to receive input from a client device associated with the participant.

3. The method of claim 2 , further comprising:

receiving input within the messaging composing component; and

in response to receiving the input, displaying a chat bubble indicating that a participant is currently typing a message.

4. The method of claim 1 , wherein the repositioned one or more initial chat bubbles are displayed in a semi-transparent fashion.

5. The method of claim 1 , further comprising:

determining that a prespecified expiration window has expired since the one or more initial chat bubbles were displayed; and

removing the one or more initial chat bubbles.

6. The method of claim 1 , wherein the other participant chat bubbles are displayed differently from the initial chat bubbles and the additional chat bubbles to indicate that the other participant chat bubbles do not contain messages sent by the participant.

7. The method of claim 1 , wherein at least one of the initial chat bubbles or the additional chat bubbles comprises, at least in part, a non-text-based expression selected by a participant.

8. The method of claim 1 , further comprising:

receiving an input interaction from the participant with respect to at least one other participant chat bubbles; and

displaying a submenu comprising one or more UI elements for replying to the at least one other participant chat bubbles.

9. The method of claim 8 , wherein the one or more UI elements for replying to the at least one other participant chat bubbles includes at least one message reply UI element for replying to the at least one other participant chat bubbles.

10. The method of claim 9 , further comprising:

receiving a reply within the at least one message reply UI element; and

displaying the reply as a threaded reply to the at least one other participant chat bubbles.

11. The method of claim 1 , wherein at least of the initial chat messages or the additional chat messages comprise one or more of: a still image, an animated image, video, audio, text, and an emoji.

12. The method of claim 1 , further comprising: based on a context of the initial chat messages, repositioning the one or more spatialized avatar components from their respective initial seating location to another seating location about the virtual background.

13. A communication system comprising one or more processors configured to perform the operations of:

joining a video meeting including a plurality of participants, the video meeting including a messaging session;

determining a virtual background from multiple virtual backgrounds to use for the messaging session during the video meeting, the virtual background comprising a representation of one or more rooms, each of the one or more rooms having a plurality of seating locations, wherein a portion of the virtual background corresponds to a physical space;

determining a respective initial seating location among the plurality of seating locations in the virtual background for each of the plurality of participants, wherein:

a subset of the plurality of participants are in the physical space; and

the respective initial seating location of each participant in the subset corresponds to a location in the physical space;

displaying, for each of the plurality of participants within the messaging session, a spatial chat user interface (UI), the spatial chat UI comprising:

the virtual background; and

one or more spatialized avatar components, each of the spatialized avatar components is a representation of one of the plurality of participants overlaid on the virtual background at the determined respective initial seating location, and each of the spatialized avatar components is positioned in a spatialized fashion throughout the length and width of the virtual background;

receiving one or more initial chat messages sent by a participant from the plurality of participants;

displaying, adjacent to the spatialized avatar component representing the participant, one or more initial chat bubbles corresponding to the one or more initial chat messages sent by the participant;

displaying one or more other participant chat bubbles corresponding to messages sent by participants from the plurality of participants other than the participant;

receiving one or more additional chat messages sent by the participant; and

displaying, adjacent to the spatialized avatar component representing the participant, one or more additional chat bubbles corresponding to the one or more additional chat messages sent by the participant, the one or more initial chat bubbles are repositioned within a prespecified chat bubble area concurrently to the additional chat bubbles being displayed.

14. The communication system of claim 13 , wherein displaying the spatial chat UI further comprises a messaging composing component configured to receive input from a client device associated with the participant.

15. The communication system of claim 13 , further comprising:

determining that a prespecified expiration window has expired since the one or more initial chat bubbles were displayed; and

removing the one or more initial chat bubbles.

16. The communication system of claim 13 , wherein the other participant chat bubbles are displayed differently from the initial chat bubbles and the additional chat bubbles to indicate that the other participant chat bubbles do not contain messages sent by the participant.

17. The communication system of claim 13 , wherein at least one of the initial chat bubbles or the additional chat bubbles comprises, at least in part, a non-text-based expression selected by a participant.

18. The communication system of claim 13 , further comprising:

receiving an input interaction from the participant with respect to at least one other participant chat bubbles; and

displaying a submenu comprising one or more UI elements for replying to the at least one other participant chat bubbles.

19. The communication system of claim 13 , further comprising: based on a context of the initial chat messages, repositioning the one or more spatialized avatar components from their respective initial seating location to another seating location about the virtual background.

20. A non-transitory computer-readable medium containing instructions for providing a spatialized display of chat messages within a messaging platform, comprising:

instructions for joining a video meeting including a plurality of participants, the video meeting including a messaging session;

instructions for determining a virtual background from multiple virtual backgrounds to use for the messaging session during the video meeting, the virtual background comprising a representation of one or more rooms, each of the one or more rooms having a plurality of seating locations, wherein a portion of the virtual background corresponds to a physical space;

instructions for determining a respective initial seating location among the plurality of seating locations in the virtual background for each of the plurality of participants, wherein:

a subset of the plurality of participants are in the physical space; and

the respective initial seating location of each participant in the subset corresponds to a location in the physical space;

instructions for displaying, for each of the plurality of participants within the messaging session, a spatial chat user interface (UI), the spatial chat UI comprising:

the virtual background; and

one or more spatialized avatar components, each of the spatialized avatar components is a representation of one of the plurality of participants overlaid on the virtual background at the determined respective initial seating location, and each of the spatialized avatar components is positioned in a spatialized fashion throughout the length and width of the virtual background;

instructions for receiving one or more initial chat messages sent by a participant from the plurality of participants;

instructions for displaying, adjacent to the spatialized avatar component representing the participant, one or more initial chat bubbles corresponding to the one or more initial chat messages sent by the participant;

instructions for displaying one or more other participant chat bubbles corresponding to messages sent by participants from the plurality of participants other than the participant;

instructions for receiving one or more additional chat messages sent by the participant; and

instructions for displaying, adjacent to the spatialized avatar component representing the participant, one or more additional chat bubbles corresponding to the one or more additional chat messages sent by the participant, the one or more initial chat bubbles are repositioned within a prespecified chat bubble area concurrently to the additional chat bubbles being displayed.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 1, 2023
From: GAL, ODED; YUAN, ZHENG
To: ZOOM VIDEO COMMUNICATIONS, INC.
Reel/Frame 063198/0636 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 7, 2022
From: LAW, ANDREW; LU, SALLY; LUO, PING; NERURKAR, SHARVARI; VARDIDZE, ARCHIL
To: ZOOM VIDEO COMMUNICATIONS, INC.
Reel/Frame 061388/0157 →
Continuity (1)
Related Publication 20230082021A1 · Mar 16, 2023
Cited By (1)
US 12,457,188