IP Library Granted Patent US 11,716,494
Granted Patent B2
US 11,716,494 · App. 17/830,587 · Granted Aug 1, 2023

Publishing a disparate live media output stream manifest that includes one or more media segments corresponding to key events

Inventors: Donald Jude Loheide (Mableton, GA); Nishith Kumar Sinha (Mableton, GA); Nicolas Paul Webb (McDonough, GA)
Assignee: Turner Broadcasting System, Inc.
H04N21/2353H04L65/70H04N21/2187H04N21/23614
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,716,494
App. No.
17/830,587
Granted
Aug 1, 2023
Kind
B2
Abstract

A system is provided for publishing a disparate live media output stream manifest that includes media segments corresponding to key events. A live production and playout system of disparate sub-systems is synchronized to a reference clock. A timecode from the reference clock is used as a reference time to log content related to key events that occur within the live production and playout system. A live event logging system is synchronized to the reference clock same as the live production and playout system. Based on location of the live event logging system, a time offset is introduced to compensate for a delay. When delay is variable, the reference clock is decoded from a live input stream to associate each key event with a corresponding timecode. Based on a programming schedule comprising the key events that occurred in the live input stream, the disparate live media output stream manifest is published.

Claims (70)

1. A system, comprising:

a memory for storing instructions; and

a processor for executing the instructions to perform operations, the operations include:

synchronize a live production and playout system of one or more disparate sub-systems to a reference clock,

wherein a timecode from the reference clock is used as a reference time to log content related to one or more key events that occur within the live production and playout system of the one or more disparate sub-systems;

synchronize a live event logging system to the reference clock same as the live production and playout system;

introduce a time offset to compensate for a delay based on a location of the live event logging system;

decode, when the delay is variable, the reference clock from a live input stream to associate each of the one or more key events with corresponding timecodes; and

publish, based on a programming schedule, a disparate live media output stream manifest that includes one or more media segments corresponding to the one or more key events,

wherein the programming schedule includes the one or more key events that occurred in the live input stream.

2. The system according to claim 1 , wherein the operations further include:

generate the programming schedule based on the synchronization of the one or more disparate sub-systems,

wherein the synchronization of the one or more disparate sub-systems is based on the reference time provided by the reference clock; and

insert, based on the programming schedule, the one or more media segments corresponding to the one or more key events that occurred prior to a current live point included in a live input stream manifest into the disparate live media output stream manifest.

3. The system according to claim 1 , wherein the timecode from the reference clock is embedded in the live production and playout system of the one or more disparate sub-systems and available for distribution, and

wherein the live production and playout system is configured to generate the live input stream.

4. The system according to claim 1 , wherein the timecode from the reference clock is recovered and re-embedded in one or more downstream sub-systems of the one or more disparate sub-systems,

wherein a first downstream sub-system uses the reference clock as a time source that indicates in the disparate live media output stream manifest when each media segment was published, and

wherein a second downstream sub-system embeds the reference clock as metadata along with the one or more media segments for delivery to one or more consumer devices.

5. The system according to claim 1 , wherein the operations further include:

associate the one or more key events with additional information regarding the one or more key events; and

generate a normalized event metadata scheme based on a list of the one or more key events with associated timecode, rating, and the additional information or links for media or data.

6. The system according to claim 5 , wherein a normalized event metadata is received by a consumer device to build a timeline for the additional information that enhances consumer experience, and

wherein the timeline is based on the reference clock present in a disparate live media output stream and used to timestamp events in the normalized event metadata.

7. The system according to claim 6 , wherein the links for the media or the data are identified by the consumer device in the normalized event metadata, based on which the media or the data along with other specified data is presented at a correct point in the timeline.

8. The system according to claim 1 , wherein the operations further include:

determine an inclusion of the one or more key events in the disparate live media output stream manifest that includes the one or more key events prior to a current live point.

9. The system according to claim 1 , wherein the operations further include:

limit number of the one or more key events to be included based on a maximum time threshold; and

include the one or more key events with a rating that exceeds a threshold rating.

10. The system according to claim 1 , wherein the operations further include:

associate the timecode of each of the one or more key events with corresponding media segments in the live input stream that are determined based on an indication by the reference clock about publish time of each of the corresponding media segments.

11. A method, comprising:

synchronizing, by a processor, a live production and playout system of one or more disparate sub-systems to a reference clock,

wherein a timecode from the reference clock is used as a reference time to log content related to one or more key events that occur within the live production and playout system of the one or more disparate sub-systems;

synchronizing, by the processor, a live event logging system to the reference clock same as the live production and playout system;

introducing, by the processor, a time offset to compensate for a delay based on a location of the live event logging system;

decoding, by the processor, the reference clock from a live input stream to associate each of the one or more key events with corresponding timecodes when the delay is variable; and

publishing, by the processor, a disparate live media output stream manifest that includes one or more media segments corresponding to the one or more key events based on a programming schedule,

wherein the programming schedule includes the one or more key events that occurred in the live input stream.

12. The method according to claim 11 , further comprising:

generating, by the processor, the programming schedule based on the synchronization of the one or more disparate sub-systems,

wherein the synchronization of the one or more disparate sub-systems is based on the reference time provided by the reference clock; and

inserting, by the processor, the one or more media segments corresponding to the one or more key events that occurred prior to a current live point included in a live input stream manifest into the disparate live media output stream manifest based on the programming schedule.

13. The method according to claim 11 , wherein the timecode from the reference clock is embedded in the live production and playout system of the one or more disparate sub-systems and available for distribution, and

wherein the live production and playout system is configured to generate the live input stream.

14. The method according to claim 11 , wherein the timecode from the reference clock is recovered and re-embedded in one or more downstream sub-systems of the one or more disparate sub-systems,

wherein a first downstream sub-system uses the reference clock as a time source that indicates in the disparate live media output stream manifest when each media segment was published, and

wherein a second downstream sub-system embeds the reference clock as metadata along with the one or more media segments for delivery to one or more consumer devices.

15. The method according to claim 11 , further comprising:

associating, by the processor, the one or more key events with additional information regarding the one or more key events; and

generating, by the processor, a normalized event metadata scheme based on a list of the one or more key events with associated timecode, rating, and the additional information or links for media or data.

16. The method according to claim 15 , wherein a normalized event metadata is received by a consumer device to build a timeline for the additional information that enhances consumer experience,

wherein the timeline is based on the reference clock present in a disparate live media output stream and used to timestamp events in the normalized event metadata, and

wherein the links for the media or the data are identified by the consumer device in the normalized event metadata, based on which the media or the data along with other specified data is presented at a correct point in the timeline.

17. The method according to claim 11 , further comprising:

determining, by the processor, an inclusion of the one or more key events in the disparate live media output stream manifest that includes the one or more key events prior to a current live point.

18. The method according to claim 11 , further comprising:

limiting, by the processor, number of the one or more key events to be included based on a maximum time threshold; and

including, by the processor, the one or more key events with a rating that exceeds a threshold rating.

19. The method according to claim 11 , further comprising:

associating, by the processor, the timecode of each of the one or more key events with corresponding media segments in the live input stream that are determined based on an indication by the reference clock about publish time of each of the corresponding media segments.

20. A non-transitory computer-readable medium having stored thereon, computer implemented instruction that when executed by a processor in a computer, causes the computer to execute operations, the operations comprising:

synchronizing a live production and playout system of one or more disparate sub-systems to a reference clock,

wherein a timecode from the reference clock is used as a reference time to log content related to one or more key events that occur within the live production and playout system of the one or more disparate sub-systems;

synchronizing a live event logging system to the reference clock same as the live production and playout system;

introducing a time offset to compensate for a delay based on a location of the live event logging system;

decoding, when the delay is variable, the reference clock from a live input stream to associate each of the one or more key events with corresponding timecodes; and

publishing, based on a programming schedule, a disparate live media output stream manifest that includes one or more media segments corresponding to the one or more key events,

wherein the programming schedule includes the one or more key events that occurred in the live input stream.

Assignments (2)
SECURITY INTEREST Recorded Oct 1, 2025
From: WARNER BROS. DISCOVERY, INC.; WARNER MEDIA, LLC; TURNER BROADCASTING SYSTEM, INC.; HOME BOX OFFICE, INC.; DISCOVERY COMMUNICATIONS, LLC; WARNERMEDIA DIRECT LLC; DISCOVERY.COM LLC; WARNER BROS. ENTERTAINMENT INC.; CNN INTERACTIVE GROUP, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 072995/0858 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 2, 2022
From: LOHEIDE, DONALD JUDE; SINHA, NISHITH KUMAR; WEBB, NICOLAS PAUL
To: TURNER BROADCASTING SYSTEM, INC.
Reel/Frame 060086/0081 →