IP Library Granted Patent US 10,194,177
Granted Patent B1
US 10,194,177 · App. 14/881,852 · Granted Jan 29, 2019

Interweaving media content

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,194,177
App. No.
14/881,852
Filed
Oct 13, 2015
Granted
Jan 29, 2019
Kind
B1
Art Unit
2421
USPC
725/32
Abstract

An electronic device and method for media content to be replaced other media content is disclosed. The method includes receiving first media content comprising a set of media content segments. The method includes receiving second media content comprising a first media content segment. The method includes receiving scheduling information identifying a second media content segment of the set of media content segments to be replaced with the first media content segment. The method includes determining that the first content feed is transmitted according to a first broadcast timing and that the second content feed is transmitted according to a second broadcast timing. The method includes syncing the first broadcast timing with the second broadcast timing. The method includes replacing the second media content segment with the first media content segment when the first content feed and the second content feed are synced.

Claims (66)

1. An electronic device comprising:

a non-transitory computer-readable storage medium storing instructions; and

at least one processing device in communication with the non-transitory computer-readable storage medium and configured to execute the instructions, the executed instructions causing the at least one processing device to perform operations comprising:

receiving, from a first live content feed, first media content comprising a first set of media content segments;

receiving, from a second live content feed, second media content comprising a second set of media content segments;

receiving, from a server in communication with the at least one processing device, a stored content segment;

determining that the first live content feed and the second live content feed are transmitted to the at least one processing device using a same broadcast timing;

receiving, from a user device in communication with the at least one processing device:

a first insertion rule indicating when to insert a replacement media content segment of the second set of media content segments into the first set of media content segments; and

a second insertion rule indicating when to insert the stored content segment into the first set of media content segments;

creating an augmented output stream from the first media content by:

inserting the replacement media content segment into one content segment of the first set of media content segments when the first insertion rule is satisfied and when the first live content feed and the second live content feed are transmitted using the same broadcast timing; and

inserting the stored content segment to replace another content segment of the first set of media content segments when the second insertion rule is satisfied;

creating a transcoded output stream by transcoding the augmented output stream into a media streaming communication protocol; and

delivering the transcoded output stream via a distributed network channel to a client device in communication with the at least one processing device and including a display device, the client device, in response to receiving the transcoded output stream, configured to display the transcoded output stream on the display device.

2. The electronic device of claim 1 , wherein the operations further comprise sending the transcoded output stream to an output stream destination.

3. The electronic device of claim 2 , wherein the output stream destination is a hypertext markup language (HTML) web domain.

4. The electronic device of claim 1 , wherein the operations further comprise receiving the first live content feed and the second live content feed from an ingest device.

5. The electronic device of claim 1 , wherein inserting the replacement media content segment into the first set of media content segments comprises:

determining a segment boundary in the first set of media content segments; and

inserting the replacement media content segment at the segment boundary.

6. The electronic device of claim 1 , wherein the first insertion rule comprises a hypertext transfer protocol live streaming (HLS) index file, the HLS index file comprising:

a first HLS tag before an entry in the HLS index file; and

a second HLS tag after the entry in the HLS index file, wherein the first insertion rule is satisfied between the first HLS tag and the second HLS tag.

7. The electronic device of claim 1 , wherein the replacement media content segment is a blank space.

8. The electronic device of claim 1 , wherein inserting the stored content segment into the first set of media content segments comprises overlaying the first set of media content segments with the stored content segment.

9. The electronic device of claim 1 , wherein the stored content segment is selected using a graphical user interface (GUI) of the user device.

10. A method comprising:

receiving, at a processing device, first media content comprising a first set of media content segments from a first live content feed, the first live content feed transmitted according to a first broadcast timing;

receiving, at the processing device, second media content comprising a second set of media content segments from a second live content feed, the second live content feed transmitted according to a second broadcast timing;

receiving, at the processing device, a stored content segment;

receiving, from a user device in communication with the processing device:

a first insertion rule indicating when to insert a replacement media content segment of the second set of media content segments into the first set of media content segments; and

a second insertion rule indicating when to insert the stored content segment into the first set of media content segments;

synchronizing, by the processing device, the first broadcast timing with the second broadcast timing;

creating an augmented output stream from the first media content, when the first broadcast timing and the second broadcast timing are synchronized, by:

inserting the replacement media content segment into one content segment of the first set of media content segments when the first insertion rule is satisfied; and

inserting the stored content segment to replace another content segment of the first set of media content segments when the second insertion rule is satisfied;

creating a transcoded output stream by transcoding the augmented output stream into a media streaming communication protocol; and

delivering the transcoded output stream via a distributed network channel from the processing device to a client device in communication with the processing device and including a display device, the client device in response to receiving the transcoded output stream, configured to display the transcoded output stream on the display device.

11. The method of claim 10 , wherein:

the first broadcast timing is a measure of time starting at a first time stamp; and

the second broadcast timing is a measure of time starting at a second time stamp.

12. The method of claim 10 , wherein synchronizing the first broadcast timing with the second broadcast timing comprises delaying the first broadcast timing to match the second broadcast timing.

13. The method of claim 10 , further comprising sending the transcoded output stream to an output stream destination.

14. The method of claim 10 , wherein: synchronizing the first broadcast timing with the second broadcast timing comprises:

determining a first segment boundary in the first set of media content segments;

determining a second segment boundary of the replacement media content segment; and

aligning the first segment boundary with the second segment boundary.

15. The method of claim 10 , wherein:

synchronizing the first broadcast timing with the second broadcast timing comprises:

determining a segment boundary of the replacement media content segment;

identifying a first media content segment in the first set of media content segments, the first media content segment spanning the segment boundary;

splitting the first media content segment into a first sub-segment and a second sub-segment at the segment boundary.

16. A method comprising:

receiving, at a processing device, first media content comprising a first set of media content segments from a first live content feed, the first live content feed transmitted according to a first broadcast timing;

receiving, at the processing device, second media content comprising a second set of media content segments from a second live content feed, the second live content feed transmitted according to a second broadcast timing;

receiving, at the processing device, a stored content segment;

receiving, from a user device in communication with the processing device:

a first insertion rule indicating when to insert a replacement media content segment of the second set of media content segments into the first set of media content segments; and

a second insertion rule indicating when to insert the stored content segment into the first set of media content segments;

synchronizing, by the processing device, the first broadcast timing with the second broadcast timing;

creating an augmented output stream from the first media content, when the first broadcast timing and the second broadcast timing are synchronized, by:

inserting the replacement media content segment into one content segment of the first set of media content segments when the first insertion rule is satisfied; and

inserting the stored content segment to replace another content segment of the first set of media content segments when the second insertion rule is satisfied; and

delivering the augmented output stream via a distributed network channel from the processing device to a client device in communication with the processing device and including a display device, the client device, in response to receiving the augmented output stream, configured to display the augmented output stream on the display device.

Assignments (12)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: THE NIELSEN COMPANY (US), LLC
To: ROKU, INC.
Reel/Frame 056106/0376 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 15, 2019
From: SORENSON MEDIA, INC.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 048355/0949 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 24, 2018
From: ASHBACHER, ANDREW L.
To: SORENSON MEDIA, INC.
Reel/Frame 046947/0944 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2015
From: ASHBACHER, ANDREW L.
To: SORENSON MEDIA, INC.
Reel/Frame 036784/0157 →
Cited By (8)
US 12,301,893 US 12,389,051 US 12,413,797 US 12,477,019 US 12,513,349 US 12,556,770 US 12,647,651 US 12,707,104