IP Library › Granted Patent US 11,928,774
Granted Patent B2
US 11,928,774 · App. 17/813,657 · Granted Mar 12, 2024

Multi-screen presentation in a virtual videoconferencing environment

Inventors: Gerard Cornelis Krol (Leiden, NL); Erik Stuart Braund (Saugerties, NY)
Assignee: KATMAI TECH INC.
G06T15/20H04N7/157
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,928,774
App. No.
17/813,657
Granted
Mar 12, 2024
Kind
B2
Abstract

Disclosed herein is a web-based videoconference system that allows for multi-screen sharing. In some embodiments, data specifying a three-dimensional virtual space is received. The three-dimensional virtual space comprises a plurality of participants and an avatar representing each of the plurality of participants and three-dimensional models of a plurality of presentation screens. Multiple presentation streams may be shared on different presentation screens simultaneously.

Claims (39)

1. A computer-implemented method for presenting in a virtual conference including a plurality of participants, comprising:

receiving data specifying a three-dimensional virtual space, wherein the three-dimensional virtual space comprises the plurality of participants each having an avatar, wherein the avatar further comprises a live video-stream of a participant mapped thereon;

receiving a plurality of three-dimensional models of a plurality of presentation screens;

receiving a first selection of a first three-dimensional model of the plurality of three-dimensional models of a first presentation screen of the plurality of presentation screens;

receiving a first presentation stream from a first client device of a first participant of the plurality of participants;

mapping the first presentation stream onto the first three-dimensional model of the first presentation screen;

receiving a second selection of a second three-dimensional model of the plurality of three-dimensional models of a second presentation screen of the plurality of presentation screens;

receiving a second presentation stream, wherein the second presentation stream is received from a second client device of a second participant;

mapping the second presentation stream onto the second three-dimensional model of the second presentation screen while the first presentation stream is mapped on the first three-dimensional model of the first presentation screen; and

from a perspective of a virtual camera of each of the first participant and the second participant, continuously rendering for display the three-dimensional virtual space with the first three-dimensional model of the first presentation screen including the first presentation stream and the second three-dimensional model of the second presentation screen including the second presentation stream simultaneously, wherein the rendering is performed from the perspective of the virtual camera of each of the first participant and the second participant as the perspective of the first participant and the second participant is continuously updated as each moves about the three-dimensional virtual space.

2. The computer-implemented method of claim 1 , further comprising identifying a set of participants from the plurality of participants allowed to consume the first presentation stream based on security parameters or a position of a respective avatar of each of the set of participants with respect to the first three-dimensional model of the first presentation screen in the three-dimensional virtual space.

3. The computer-implemented method of claim 1 , wherein receiving the first selection based on an input received by the first client device, availability of the first three-dimensional model of the first presentation screen, or a position of a first avatar of the first participant in the three-dimensional virtual space.

4. The computer-implemented method of claim 1 , wherein the first presentation screen comprises audio and video data captured by the first client device.

5. The computer-implemented method of claim 1 , further comprising removing the first presentation stream from the first three-dimensional model of the first presentation screen based on a position of a first avatar of the of the first participant in the three-dimensional virtual space with respect to the first three-dimensional model of the first presentation screen or an input received by the first client device.

6. The computer-implemented method of claim 1 , wherein the plurality of three-dimensional models of the plurality of presentation screens are of varying sizes.

7. The computer-implemented method of claim 1 , wherein the first and second presentation stream are both received from the first client device of the first participant.

8. A non-transitory, tangible computer-readable device having instructions stored thereon that, when executed by at least one computing device, causes the at least one computing device to perform operations for presenting in a virtual conference including a plurality of participants, the operations comprising:

receiving data specifying a three-dimensional virtual space, wherein the three-dimensional virtual space comprises the plurality of participants each having an avatar, wherein the avatar further comprises a live video-stream of a participant mapped thereon,

receiving a plurality of three-dimensional models of a plurality of presentation screens;

receiving a first selection of a first three-dimensional model of the plurality of three-dimensional models of a first presentation screen of the plurality of presentation screens;

receiving a first presentation stream from a first client device of a first participant of the plurality of participants;

mapping the first presentation stream onto the first three-dimensional model of the first presentation screen;

receiving a second selection of a second three-dimensional model of the plurality of three-dimensional models of a second presentation screen of the plurality of presentation screens;

receiving a second presentation stream, wherein the second presentation stream is received from a second client device of a second participant;

mapping the second presentation stream onto the second three-dimensional model of the second presentation screen while the first presentation stream is mapped on the first three-dimensional model of the first presentation screen; and

from a perspective of a virtual camera of each of the first participant and the second participant, continuously rendering for display the three-dimensional virtual space with the first three-dimensional model of the first presentation screen including the first presentation stream and the second three-dimensional model of the second presentation screen including the second presentation stream simultaneously, wherein the rendering is performed from the perspective of the virtual camera of each of the first participant and the second participant as the perspective of the first participant and the second participant is continuously updated as each moves about the three-dimensional virtual space.

9. The device of claim 8 , wherein the operations further comprise identifying a set of participants from the plurality of participants allowed to consume the first presentation stream based on security parameters or a position of a respective avatar of each of the set of participants with respect to the first three-dimensional model of the first presentation screen in the three-dimensional virtual space.

10. The device of claim 8 , wherein receiving the first selection based on an input received by the first client device, availability of the first three-dimensional model of the first presentation screen, or a position of a first avatar of the first participant in the three-dimensional virtual space.

11. The device of claim 8 , wherein the first presentation screen comprises audio and video data captured by the first client device.

12. The device of claim 8 , wherein the operations further comprise removing the first presentation stream from the first three-dimensional model of the first presentation screen based on a position of a first avatar of the of the first participant in the three-dimensional virtual space with respect to the first three-dimensional model of the first presentation screen or an input received by the first client device.

13. The device of claim 8 , wherein the plurality of three-dimensional models of the plurality of presentation screens are of varying sizes.

14. A system for presenting in a virtual conference including a plurality of participants, comprising:

a processor coupled to a memory;

a network interface configured to (i) receive data specifying a three-dimensional virtual space, wherein the three-dimensional virtual space comprises the plurality of participants each having an avatar, wherein the avatar further comprises a live video-stream of a participant mapped thereon, (ii) receive a plurality of three-dimensional models of a plurality of presentation screens; (iii) receive a first selection of a first three-dimensional model of the plurality of three-dimensional models of a first presentation screen of the plurality of presentation screens, (iv) receive a first presentation stream from a first client device of a first participant of the plurality of participants, (v) receive a second selection of a second three-dimensional model of the plurality of three-dimensional models of a second presentation screen of the plurality of presentation screens, and (vi) receive a second presentation stream from a second client device of a second participant;

a mapper, implemented on the processor, configured to (i) map the first presentation stream onto the first three-dimensional model of the first presentation screen, and (ii) map the second presentation stream onto the second three-dimensional model of the second presentation screen while the first presentation stream is mapped on the first three-dimensional model of the first presentation screen; and

a renderer, implemented on the processor, configured to render for display to the second participant, from a perspective of a virtual camera of each of the first participant and the second participant, continuously rendering for display the three-dimensional virtual space with the first three-dimensional model of the first presentation screen including the first presentation stream and the second three-dimensional model of the second presentation screen including the second presentation stream simultaneously, wherein the rendering is performed from the perspective of the virtual camera of each of the first participant and the second participant as the perspective of the first participant and the second participant is continuously updated as each moves about the three-dimensional virtual space.

15. The system of claim 14 , wherein the network interface is further configured to (vii) identify a set of participants from the plurality of participants allowed to consume the first presentation stream based on security parameters or a position of a respective avatar of each of the set of participants with respect to the first three-dimensional model of the first presentation screen in the three-dimensional virtual space.

16. The system of claim 14 , wherein receiving the first selection based on an input received by the first client device, availability of the first three-dimensional model of the first presentation screen, or a position of a first avatar of the first participant in the three-dimensional virtual space.

17. The system of claim 14 , wherein the first presentation screen comprises audio and video data captured by the first client device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 1, 2022
From: KROL, GERARD CORNELIS; BRAUND, ERIK STUART
To: KATMAI TECH INC.
Reel/Frame 060685/0258 →
Continuity (1)
Related Publication 20240029339A1 · Jan 25, 2024