IP Library Granted Patent US 11,297,356
Granted Patent B2
US 11,297,356 · App. 16/217,852 · Granted Apr 5, 2022

Interweaving media content

Inventor: Andrew L. Ashbacher (Draper, UT)
Assignee: Roku, Inc.
H04N21/23424G11B27/031G11B27/10H04N21/2187H04N21/242H04N21/262H04N21/458H04N21/6587H04N21/812H04N21/8456
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,297,356
App. No.
16/217,852
Granted
Apr 5, 2022
Kind
B2
Abstract

An electronic device and method for media content to be replaced other media content is disclosed. The method includes receiving first media content comprising a set of media content segments. The method includes receiving second media content comprising a first media content segment. The method includes receiving scheduling information identifying a second media content segment of the set of media content segments to be replaced with the first media content segment. The method includes determining that the first content feed is transmitted according to a first broadcast timing and that the second content feed is transmitted according to a second broadcast timing. The method includes syncing the first broadcast timing with the second broadcast timing. The method includes replacing the second media content segment with the first media content segment when the first content feed and the second content feed are synced.

Claims (56)

1. An electronic device comprising:

a non-transitory computer-readable storage medium storing instructions;

at least one processing device in communication with the non-transitory computer-readable storage medium and configured to execute the instructions, the executed instructions causing the at least one processing device to perform operations comprising:

receiving, from a first live content feed, first media content comprising a first set of media content segments;

receiving, from a second live content feed, second media content comprising a second set of media content segments;

receiving a stored content segment;

determining that the first live content feed and the second live content feed are transmitted to the at least one processing device using a same broadcast timing;

creating an augmented output stream from the first media content by (i) inserting a replacement media content segment of the second set of media content segments into a given content segment of the first set of media content segments when the first live content feed and second live content feed are transmitted using the same broadcast timing and (ii) inserting the stored content segment to replace another segment of the first set of media content segments;

creating a transcoded output stream by transcoding the augmented output stream; and

delivering the transcoded output stream over a communication channel for playback.

2. The electronic device of claim 1 , wherein receiving the first live content feed and receiving the second live content feed are both from an ingest device.

3. The electronic device of claim 1 , wherein inserting the replacement media content segment into the first set of media content segments comprises:

determining a segment boundary in the first set of media content segments; and

inserting the replacement media content segment at the segment boundary.

4. The electronic device of claim 1 , wherein the given content segment is a blank space.

5. The electronic device of claim 1 , wherein inserting the stored content segment to replace the other segment of the first set of media content segments comprises overlaying the other segment with the stored content segment.

6. The electronic device of claim 1 , wherein the operations further comprise delaying the delivering of the transcoded output stream in response to at least one synchronization issue.

7. The electronic device of claim 1 , wherein transcoding the augmented output stream comprises transcoding the augmented output stream into a format for cross-platform playback.

8. The electronic device of claim 7 , wherein the format for cross-platform playback comprises a media streaming communications protocol.

9. The electronic device of claim 7 , wherein the format for cross-platform playback comprises a hypertext transfer protocol live streaming (HLS) format.

10. A method comprising:

receiving, at a processing device, first media content comprising a first set of media content segments from a first live content feed, the first live content feed being transmitted according to a first broadcast timing;

receiving, at the processing device, second media content comprising a second set of media content segments from a second live content feed, the first live content feed being transmitted according to a second broadcast timing;

receiving, at the processing device, a stored content segment;

synchronizing, by the processing device, the first broadcast timing with the second broadcast timing;

creating an augmented output stream from the first media content by (i) inserting a replacement media content segment of the second set of media content segments into a given content segment of the first set of media content segments when the first live content feed and second live content feed are transmitted using the same broadcast timing and (ii) inserting the stored content segment to replace another segment of the first set of media content segments;

creating a transcoded output stream by transcoding the augmented output stream; and

delivering the transcoded output stream from the processing device for playback.

11. The method of claim 10 , wherein synchronizing the first broadcast timing with the second broadcast timing comprises delaying the first broadcast timing to match the second broadcast timing.

12. The method of claim 10 , wherein synchronizing the first broadcast timing with the second broadcast timing comprises:

determining a first segment boundary in the first set of media content segments;

determining a second segment boundary of the replacement media content segment; and

aligning the first segment boundary with the second segment boundary.

13. The method of claim 10 , wherein synchronizing the first broadcast timing with the second broadcast timing comprises:

determining a segment boundary of the replacement media content segment;

identifying a first media content segment in the first set of media content segments, the first media content segment spanning the segment boundary;

splitting the first media content segment into a first sub-segment and a second sub-segment at the segment boundary.

14. The method of claim 10 , wherein the given content segment is a blank space.

15. The method of claim 10 , wherein transcoding the augmented output stream comprises transcoding the augmented output stream into a format for cross-platform playback.

16. The method of claim 15 , wherein the format for cross-platform playback is selected from the group consisting of a media streaming communications protocol and a hypertext transfer protocol live streaming (HLS) format.

17. A non-transitory computer-readable medium storing instructions executable by at least one processing device to carry out operations comprising:

receiving first media content comprising a first set of media content segments from a first live content feed, the first live content feed being transmitted according to a first broadcast timing;

receiving second media content comprising a second set of media content segments from a second live content feed, the first live content feed being transmitted according to a second broadcast timing;

receiving a stored content segment;

synchronizing the first broadcast timing with the second broadcast timing;

creating an augmented output stream from the first media content by (i) inserting a replacement media content segment of the second set of media content segments into a given content segment of the first set of media content segments when the first live content feed and second live content feed are transmitted using the same broadcast timing and (ii) inserting the stored content segment to replace another segment of the first set of media content segments;

delivering the augmented output stream to a client device for playback.

18. The non-transitory computer-readable medium of claim 17 , wherein synchronizing the first broadcast timing with the second broadcast timing comprises delaying the first broadcast timing to match the second broadcast timing.

19. The non-transitory computer-readable medium of claim 17 , wherein synchronizing the first broadcast timing with the second broadcast timing comprises:

determining a first segment boundary in the first set of media content segments;

determining a second segment boundary of the replacement media content segment; and

aligning the first segment boundary with the second segment boundary.

20. The non-transitory computer-readable medium of claim 17 , wherein synchronizing the first broadcast timing with the second broadcast timing comprises:

determining a segment boundary of the replacement media content segment;

identifying a first media content segment in the first set of media content segments, the first media content segment spanning the segment boundary;

splitting the first media content segment into a first sub-segment and a second sub-segment at the segment boundary.

Assignments (11)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: GRACENOTE, INC.; A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: THE NIELSEN COMPANY (US), LLC
To: ROKU, INC.
Reel/Frame 056106/0376 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2020
From: ASHBACHER, ANDREW L.
To: SORENSON MEDIA, INC.
Reel/Frame 054170/0599 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 15, 2019
From: SORENSON MEDIA, INC.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 048355/0949 →