IP Library Granted Patent US 11,317,143
Granted Patent B2
US 11,317,143 · App. 16/183,266 · Granted Apr 26, 2022

Dynamic reduction in playout of replacement content to help align end of replacement content with end of replaced content

Inventors: Chung Won Seo (Seoul, KR); Seunghyeong Lee (Goyang, KR)
Assignee: Roku, Inc.
H04N21/44016H04N21/43072H04N21/812H04N21/2187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,317,143
App. No.
16/183,266
Granted
Apr 26, 2022
Kind
B2
Abstract

When a device is playing out a media stream, the device determines a target time at which the device is to start playing out replacement content in place of a portion of the media stream. However, the device then detects that a starting time when the device starts playout of the replacement content is delayed from the target time by a delay period of duration P. In response, the device then reduces its playout of the replacement content by duration P, to help playout of the replacement content end at a desired time. For instance, the device could seek forward in playout of the replacement content by duration P and/or could remove one or more other portions of the replacement content to total a reduction of duration P.

Claims (35)

1. A method for a device to play out replacement content in place of a portion of an underlying media stream, wherein the replacement content and the portion of the underlying media stream are of equal duration D, the method comprising:

while the device is playing out the underlying media stream, determining by the device a target time at which to begin playout of the replacement content;

detecting by the device that a starting time at which the device starts playout of the replacement content is or will be after the determined target time by a delay period of duration P; and

responsive to the detecting, reducing by the device playout of the replacement content to help align an end of playout of the replacement content with an end of the portion of the underlying media stream, wherein reducing playout of the replacement content includes (i) detecting in the replacement content one or more duplicate frames, (ii) responsive to detecting in the replacement content the one or more duplicate frames, skipping playout of the one or more duplicate frames when playing out the replacement content, (iii) detecting by the device that skipping playout of the one or more duplicate frames shortens the playout of the replacement content by less than the duration P, and (iv) responsive to the detecting that the removal of the duplicate frames shortens the playout of the replacement content by less than the delay period of duration P, truncating by the device playout of the replacement content such that the playout of the replacement content lasts a duration D-P to help align the end of playout of the replacement content with the end of the portion of the underlying media stream.

2. The method of claim 1 , wherein the portion of the underlying media stream is an ad in an ad pod, and wherein the replacement content is a replacement ad.

3. The method of claim 1 , further comprising playing out by the device transition frames during the delay period, in place of playout of an initial part of the portion of the underlying media stream.

4. The method of claim 3 , further comprising fading by the device from playout of the transition frames to playout of the replacement content.

5. The method of claim 3 , wherein the underlying media stream comprises video, and wherein the transition frames comprise black frames.

6. The method of claim 3 , wherein the underlying media stream comprises audio, and wherein the transition frames comprise silent frames.

7. The method of claim 1 , wherein the device is a television.

8. The method of claim 1 , wherein the device is a set top box.

9. The method of claim 1 , wherein the media stream comprises watermark data corresponding with an identity of the media stream, wherein the identity of the media stream is associated with the start time, wherein the method further comprises:

determining, by the device from the media stream, the watermark data; and

based on the watermark data, determining by the device the identity of the media stream, wherein detecting that a starting time at which the media client starts playout of the replacement content is or will be after the determined target time by a delay period of duration P is based on the identity of the media stream.

10. The method of claim 1 , further comprising:

buffering by the device for playout a plurality of upcoming frames of the replacement content, wherein detecting in the replacement content one or more duplicate frames comprises detecting the one or more duplicate frames in the plurality of buffered upcoming frames of the replacement content.

11. A media client comprising:

a processing unit;

non-transitory data storage; and

program instructions stored in the non-transitory data storage and executable by the processing unit to cause the media client to carry out operations including:

while the media client is playing out an underlying media stream, determining a target time at which the media client is to begin playout of replacement content in place of a portion of the underlying media stream,

detecting that a starting time at which the media client starts playout of the replacement content is or will be after the determined target time by a delay period of duration P, and

responsive to the detecting, reducing playout of the replacement content to help align an end of playout of the replacement content with an end of the portion of the underlying media stream, wherein reducing playout of the replacement content includes (i) detecting in the replacement content one or more duplicate frames, (ii) responsive to detecting in the replacement content the one or more duplicate frames, skipping playout of the one or more duplicate frames when playing out the replacement content, (iii) detecting by the device that skipping playout of the one or more duplicate frames shortens the playout of the replacement content by less than the duration P, and (iv) responsive to the detecting that the removal of the duplicate frames shortens the playout of the replacement content by less than the delay period of duration P, truncating by the device playout of the replacement content such that the playout of the replacement content lasts a duration D-P to help align the end of playout of the replacement content with the end of the portion of the underlying media stream.

12. The media client of claim 11 , wherein the portion of the underlying media stream is an ad in an ad pod, and wherein the replacement content is a replacement ad.

13. The media client of claim 11 , wherein the operations further include playing out transition frames during the delay period, in place of playout of an initial part of the portion of the underlying media stream.

14. The media client of claim 13 , wherein the operations further include fading by the device from playout of the transition frames to playout of the replacement content.

15. The media client of claim 13 , wherein the underlying media stream comprises video, and wherein the transition frames comprise black frames.

16. The media client of claim 13 , wherein the underlying media stream comprises audio, and wherein the transition frames comprise silent frames.

17. The media client of claim 11 , wherein the media client is a television.

18. The media client of claim 11 , wherein the media client is a set top box.

19. Non-transitory data storage storing program instructions executable by a processing unit to cause a media client to carry out operations including:

while the media client is playing out an underlying media stream, determining a target time at which the media client is to begin playout of replacement content in place of a portion of the underlying media stream;

detecting that a starting time at which the media client starts playout of the replacement content is or will be after the determined target time by a delay period of duration P; and

responsive to the detecting, reducing playout of the replacement content to help align an end of playout of the replacement content with an end of the portion of the underlying media stream, wherein reducing playout of the replacement content includes (i) detecting in the replacement content one or more duplicate frames, (ii) responsive to detecting in the replacement content the one or more duplicate frames, skipping playout of the one or more duplicate frames when playing out the replacement content, (iii) detecting by the device that skipping playout of the one or more duplicate frames shortens the playout of the replacement content by less than the duration P, and (iv) responsive to the detecting that the removal of the duplicate frames shortens the playout of the replacement content by less than the delay period of duration P, truncating by the device playout of the replacement content such that the playout of the replacement content lasts a duration D-P to help align the end of playout of the replacement content with the end of the portion of the underlying media stream.

20. The non-transitory data storage of claim 19 , wherein the portion of the underlying media stream is an ad in an ad pod, and wherein the replacement content is a replacement ad.

Assignments (10)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2018
From: SEO, CHUNG WON; LEE, SEUNGHYEONG
To: GRACENOTE, INC.
Reel/Frame 047499/0381 →