IP Library › Granted Patent US 11,516,518
Granted Patent B2
US 11,516,518 · App. 17/351,713 · Granted Nov 29, 2022

Live streaming with live video production and commentary

Inventors: Bert De Decker (Hasselt, BE); Tom Cuypers (Tongeren, BE); Wim Sweldens (Summit, NJ); Francis X. Zane (New Providence, NJ); Thomas J. Janiszewski (Andover, NJ); Yung-Lung Ho (Bethesda, MD)
Assignee: Kiswe Mobile Inc.
H04N21/2187H04N21/231H04N21/234H04N21/44H04N21/4788H04N21/4884H04N21/643
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,516,518
App. No.
17/351,713
Granted
Nov 29, 2022
Kind
B2
Abstract

A method comprises receiving from each of a plurality of commentator applications respective distinct streams of media content comprising commentary information, combining at least portions of selected ones of the distinct streams of media content comprising commentary information in a mixer associated with a media server to generate a composite media content stream, and providing the composite media content stream generated by the mixer to one or more servers of a content delivery network for delivery to one or more viewer devices. The commentary information of a given one of the distinct streams of media content received from a corresponding one of the commentator applications illustratively comprises at least one of audio content, video content, image content, social media posting content, chat text and closed caption text. The mixer may comprise a post-mixer coupled to the media server.

Claims (48)

1. A method comprising:

receiving from each of a plurality of commentator applications respective distinct streams of media content comprising commentary information;

combining at least portions of selected ones of the distinct streams of media content comprising commentary information in a mixer associated with a media server to generate a composite media content stream; and

providing the composite media content stream generated by the mixer to one or more servers of a content delivery network for delivery to one or more viewer devices;

wherein combining at least portions of selected ones of the distinct streams of media content comprising commentary information to generate the composite media content stream comprises:

storing a plurality of distinct layouts each specifying a different arrangement of the commentator information in the composite media content stream; and

dynamically switching between at least a subset of the distinct layouts over time in generating the composite media content stream;

wherein the method is performed by at least one processing device comprising a processor coupled to a memory.

2. The method of claim 1 wherein the composite media content stream comprises live video from at least one live video source.

3. The method of claim 1 wherein the commentator applications are implemented on respective commentator devices.

4. The method of claim 3 wherein the commentator devices are deployed at respective different geographic locations.

5. The method of claim 3 wherein the commentator devices are separate from the at least one processing device that performs the method.

6. The method of claim 1 wherein the commentary information of a given one of the distinct streams of media content received from a corresponding one of the commentator applications comprises at least one of audio content, video content, image content, social media posting content, chat text and closed caption text.

7. The method of claim 1 wherein the mixer comprises a post-mixer coupled to the media server.

8. The method of claim 1 wherein the media server is configured to receive the respective distinct streams of media content comprising commentary information from each of the plurality of commentator applications.

9. The method of claim 8 wherein the media server is configured to interact with respective web browsers of respective commentator devices in receiving the respective distinct streams of media content comprising commentary information from each of the plurality of commentator applications.

10. The method of claim 1 wherein the media server and the mixer are part of a media processor implemented by the at least one processing device.

11. The method of claim 1 wherein combining at least portions of selected ones of the distinct streams of media content comprising commentary information in the mixer associated with the media server to generate a composite media content stream comprises combining commentator video from the selected ones of the distinct streams of media content in accordance with a designated picture-in-picture (PIP) layout.

12. The method of claim 11 wherein the PIP layout utilized in generating the composite media content stream dynamically varies as a function of time during a live event.

13. The method of claim 1 wherein

a given one of the distinct layouts specifies for each of one or more of the commentator applications at least a positioning of corresponding commentator information in the composite media content stream.

14. The method of claim 1 wherein the distinct layouts are stored in a layout data store that is accessible to one or more of:

a pre-mixer used to generate a first resolution version of video content received by the commentator applications;

a plurality of instances of a commentary mixer associated with respective ones of the commentator applications; and

a post-mixer configured to generate the composite media content stream utilizing a second resolution version of the video content and the commentary information received from the commentator applications;

wherein the second resolution version has a higher resolution than the first resolution version.

15. An article of manufacture comprising a non-transitory computer-readable storage medium having computer program code embodied therein, wherein the computer program code when executed in at least one processing device causes said at least one processing device:

to receive from each of a plurality of commentator applications respective distinct streams of media content comprising commentary information;

to combine at least portions of selected ones of the distinct streams of media content comprising commentary information in a mixer associated with a media server to generate a composite media content stream; and

to provide the composite media content stream generated by the mixer to one or more servers of a content delivery network for delivery to one or more viewer devices;

wherein combining at least portions of selected ones of the distinct streams of media content comprising commentary information to generate the composite media content stream comprises:

storing a plurality of distinct layouts each specifying a different arrangement of the commentator information in the composite media content stream; and

dynamically switching between at least a subset of the distinct layouts over time in generating the composite media content stream.

16. The article of manufacture of claim 15 wherein the mixer comprises a post-mixer coupled to the media server.

17. The article of manufacture of claim 15 wherein

a given one of the distinct layouts specifies for each of one or more of the commentator applications at least a positioning of corresponding commentator information in the composite media content stream.

18. An apparatus comprising:

at least one processing device comprising a processor coupled to a memory;

wherein said at least one processing device is configured:

to receive from each of a plurality of commentator applications respective distinct streams of media content comprising commentary information;

to combine at least portions of selected ones of the distinct streams of media content comprising commentary information in a mixer associated with a media server to generate a composite media content stream; and

to provide the composite media content stream generated by the mixer to one or more servers of a content delivery network for delivery to one or more viewer devices;

wherein combining at least portions of selected ones of the distinct streams of media content comprising commentary information to generate the composite media content stream comprises:

storing a plurality of distinct layouts each specifying a different arrangement of the commentator information in the composite media content stream; and

dynamically switching between at least a subset of the distinct layouts over time in generating the composite media content stream.

19. The apparatus of claim 18 wherein the mixer comprises a post-mixer coupled to the media server.

20. The apparatus of claim 18 wherein

a given one of the distinct layouts specifies for each of one or more of the commentator applications at least a positioning of corresponding commentator information in the composite media content stream.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 18, 2021
From: DE DECKER, BERT; CUYPERS, TOM; SWELDENS, WIM; ZANE, FRANCIS X.; JANISZEWSKI, THOMAS J.; HO, YUNG-LUNG
To: KISWE MOBILE INC.
Reel/Frame 056586/0642 →
Continuity (5)
Continuation 16709174 · Dec 10, 2019
Continuation In Part 16225335 · Dec 19, 2018
Provisional Application 62883732 · Aug 7, 2019
Provisional Application 62719278 · Aug 17, 2018
Related Publication 20210314632A1 · Oct 7, 2021