IP Library Granted Patent US 12,225,242
Granted Patent B2
US 12,225,242 · App. 18/059,314 · Granted Feb 11, 2025

System and method enabling live broadcasting sessions in virtual environments

Inventor: Cevat Yerli (Dubai, AE)
Assignee: TMRW FOUNDATION IP S.ÀR.L.
H04N21/21805H04N21/25808H04N21/8146
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,225,242
App. No.
18/059,314
Granted
Feb 11, 2025
Kind
B2
Abstract

A method for providing live broadcasting sessions in virtual environments includes creating a virtual environment based on virtual environment creation instructions; connecting the virtual environment to an event that is broadcast through the virtual environment; setting up a live broadcasting session from the virtual environment comprising the event broadcast; sending an invitation to at least one invitee client device, wherein the invitation comprises 3D coordinates of the virtual environment specified for at least one invitee; opening up a communication channel enabling access to the at least one invitee to the virtual environment, wherein the invitee client device accesses the virtual environment through a user graphical representation that is positioned at the specified 3D coordinate of the virtual environment; and streaming the live broadcasting session to the at least one invitee client device. Corresponding systems and computer-readable media are also provided.

Claims (44)

1. A system providing live broadcasting sessions in virtual environments, comprising:

at least one server computer comprising at least one processor and memory storing instructions implementing a virtual environment streaming application configured to, when the instructions are executed by the at least one processor, cause the at least one server computer to:

create a virtual environment based on virtual environment creation instructions from a host client device connected to the at least one server computer via a network;

connect the virtual environment to an event that is broadcast through the virtual environment, the event being a live real-world event;

set up a live broadcasting session from the virtual environment comprising a broadcast of the event;

send an invitation to at least one invitee client device, wherein the invitation comprises 3D coordinates of the virtual environment specified for at least one invitee;

upon the at least one invitee accepting the invitation, open up a communication channel enabling access to the at least one invitee to the virtual environment, wherein the invitee client device accesses the virtual environment through a user graphical representation that is positioned at the specified 3D coordinates of the virtual environment; and

stream the live broadcasting session to the at least one invitee client device;

wherein the virtual environment streaming application selects between a selective forwarding unit (SFU) architecture to forward individual live streams from transmitting client devices to receiving client devices, and a multipoint control unit (MCU) architecture to forward a combined live stream of the live streams from the transmitting client devices to the receiving client devices, wherein the selecting is based on a threshold number of live streams from the transmitting client devices.

2. The system of claim 1 , wherein the virtual environment streaming application enables invitees to interact with each other by exchanging real-time audio and video.

3. The system of claim 1 , wherein the virtual environment streaming application enables a selection of an exclusive number of invitee user graphical representations to be visible to at least one host of the live broadcasting session, wherein at least one of the selected invitees is enabled to interact with the at least one host of the live broadcasting session.

4. The system of claim 3 , wherein the virtual environment streaming platform enables said interactions with the at least one host to become part of a public video stream that is shared with other client devices.

5. The system of claim 3 , wherein the virtual environment streaming application further displays a symbolic graphical representation of invitees not comprised within the selection of the exclusive number of invitees.

6. The system of claim 3 , wherein the virtual environment streaming application further enables displaying graphical representations of reactions of invitees.

7. The system of claim 3 , wherein the virtual environment streaming application enables the audience to explore the virtual environment by moving in the virtual environment.

8. The system of claim 7 , wherein the presentation of movement by at least some of the audience members is disabled for the view of the at least one host.

9. The system of claim 1 , wherein the field of view of users including hosts and invitees is calculated from the specified 3D coordinate of the virtual environment where the corresponding user graphical representation is positioned.

10. A method executed by at least one processor implementing instructions in memory of at least one server computer, comprising:

creating a virtual environment based on virtual environment creation instructions from a host client device connected to the at least one server computer via a network;

connecting the virtual environment to an event that is broadcast through the virtual environment, the event being a live real-world event;

setting up a live broadcasting session that is broadcast from the virtual environment comprising a broadcast of the event;

sending an invitation to at least one invitee client device, wherein the invitation comprises 3D coordinates of the virtual environment specified for at least one invitee;

upon the at least one invitee accepting the invitation, opening up a communication channel enabling access to the at least one invitee to the virtual environment, wherein the invitee client device accesses the virtual environment through a user graphical representation that is positioned at the specified 3D coordinates of the virtual environment;

streaming the live broadcasting session to the at least one invitee client device; and

selecting between a selective forwarding unit (SFU) architecture to forward individual live streams from transmitting client devices to receiving client devices, and a multipoint control unit (MCU) architecture to forward a combined live stream of the live streams from the transmitting client devices to the receiving client devices, wherein the selecting is based on a threshold number of live streams from the transmitting client devices.

11. The method of claim 10 further comprising enabling invitees to interact with each other by exchanging real-time audio and video.

12. The method of claim 10 further comprising selecting an exclusive number of invitee user graphical representations to be visible to at least one host of the live broadcasting session, wherein at least one of the selected invitees is enabled to interact with the at least one host of the live broadcasting session.

13. The method of claim 12 further comprising enabling said interactions with the at least one host to become part of a public video stream that is shared with other client devices.

14. The method of claim 12 further comprising displaying a symbolic graphical representation of invitees not comprised within the selection of the exclusive number of invitees.

15. The method of claim 12 further comprising displaying graphical representations of reactions of invitees.

16. The method of claim 10 , wherein creating the virtual environment comprises:

retrieving user preference data; and

using the user preference data to customize the virtual environment.

17. The method of claim 10 , wherein the field of view of the invitee is calculated from the specified 3D coordinate of the virtual environment.

18. A non-transitory computer readable medium comprising instructions stored in memory which, when executed by at least one processor, cause at least one server computer to perform steps comprising:

creating a virtual environment based on virtual environment creation instructions from a host client device connected to the at least one server computer via a network;

connecting the virtual environment to an event that is broadcast through the virtual environment, the event being a live real-world event;

setting up a live broadcasting session that is broadcast from the virtual environment comprising a broadcast of the event;

sending an invitation to at least one invitee client device, wherein the invitation comprises 3D coordinates of the virtual environment specified for at least one invitee;

upon the at least one invitee accepting the invitation, opening up a communication channel enabling access to the at least one invitee to the virtual environment, wherein the invitee client device accesses the virtual environment through a user graphical representation that is positioned at the specified 3D coordinates of the virtual environment;

streaming the live broadcasting session to the at least one invitee client device, wherein a field of view of the invitee is calculated from the specified 3D coordinates of the virtual environment; and

selecting between a selective forwarding unit (SFU) architecture to forward individual live streams from transmitting client devices to receiving client devices, and a multipoint control unit (MCU) architecture to forward a combined live stream of the live streams from the transmitting client devices to the receiving client devices, wherein the selecting is based on a threshold number of live streams from the transmitting client devices.

19. The non-transitory computer readable medium of claim 18 , wherein the steps further comprise enabling invitees to interact with each other by exchanging real-time audio and video.

20. The non-transitory computer readable medium of claim 18 , wherein the steps further comprise selecting an exclusive number of invitee user graphical representations to be visible to at least one host of the live broadcasting session, wherein at least one of the selected invitees is enabled to interact with the at least one host of the live broadcasting session.

Assignments (3)
CHANGE OF NAME Recorded Apr 18, 2025
From: TMRW FOUNDATION IP S.À R.L.
To: TMRW GROUP IP
Reel/Frame 070891/0012 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 15, 2024
From: YERLI, CEVAT
To: TMRW FOUNDATION IP S.ÀR.L.
Reel/Frame 068903/0411 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 28, 2022
From: YERLI, CEVAT
To: TMRW FOUNDATION IP S. À R.L.
Reel/Frame 061895/0344 →
Continuity (1)
Related Publication 20240179354A1 · May 30, 2024
References Cited (17)
US 9292163B2 · Goldman et al. · 2016 [cited by applicant]
US 9306880B1 · Hyndman et al. · 2016 [cited by applicant]
US 11838336B2 · Young · 2023 [cited by examiner]
US 20110225039A1 · Goldman et al. · 2011 [cited by applicant]
US 20110244954A1 · Goldman · 2011 [cited by examiner]
US 20110246908A1 · Akram · 2011 [cited by examiner]
US 20120079046A1 · Murphy · 2012 [cited by examiner]
US 20150088622A1 · Ganschow · 2015 [cited by applicant]
US 20150256351A1 · Murphy et al. · 2015 [cited by applicant]
US 20150356693A1 · Wiseman et al. · 2015 [cited by applicant]
US 20190206129A1 · Khalid · 2019 [cited by examiner]
US 20200099891A1 · Valli et al. · 2020 [cited by applicant]
US 20220070241A1 · Yerli · 2022 [cited by applicant]
US 20230163987A1 · Young · 2023 [cited by examiner]
US 20230316663A1 · Yerli · 2023 [cited by examiner]
US 20230326208A1 · Cooley-White · 2023 [cited by examiner]
JP 2022042980A · 2022 [cited by applicant]