IP Library Granted Patent US 11,265,617
Granted Patent B2
US 11,265,617 · App. 16/779,547 · Granted Mar 1, 2022

Inserting advertisements into video content

Inventors: Peter Dunker (Berkeley, CA); Markus K. Cremer (Orinda, CA); Donald J. Gordon (Mountain View, GA)
Assignee: Roku, Inc.
H04N21/812H04N21/23424H04N21/2668H04N21/6581H04N21/8352H04N21/8455
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,265,617
App. No.
16/779,547
Granted
Mar 1, 2022
Kind
B2
Abstract

Methods and systems to insert advertisements and/or other supplemental or replacement content into a stream of video content are described. In some example embodiments, the methods and systems receive a request to replace a portion of video content currently playing at a client device with supplemental video content, such as an advertisement. In response to the request, the methods and systems determine one or more fingerprints of the video content plating at the client device, identify one or more frames of the video content at which to insert the supplemental video content based on the one or more fingerprints, and insert the supplemental video content at the identified one or more frames of the video content.

Claims (58)

1. A method, comprising:

determining identifying information for video content currently playing at a client device;

by a processor, identifying one or more frames of the video content to be replaced with supplemental video content based on the identifying information determined for the video content playing at the client device, wherein the one or more frames of video content are at least one frame fewer than the supplemental video content; and

replacing the identified one or more frames of the video content and at least one frame adjacent to the identified one or more frames with the supplemental video content.

2. The method of claim 1 , wherein the identifying of the one or more frames of the video content to be replaced with the supplemental video content based on the identifying information includes identifying a frame of the video content that is associated with a black screen inserted into the video content.

3. The method of claim 1 , wherein the identifying of the one or more frames of the video content to be replaced with the supplemental video content based on the identifying information includes identifying content overlaid onto the video content.

4. The method of claim 1 , wherein the identifying of the one or more frames of the video content to be replaced with the supplemental video content based on the identifying information includes:

determining one or more fingerprints of the video content;

comparing the determined one or more fingerprints of the video content to one or more reference fingerprints captured at a broadcaster that provides the video content currently playing at the client device; and

identifying the one or more frames to be replaced with the supplemental video content based on a result of the comparison.

5. The method of claim 1 , wherein the replacing of the identified one or more frames of the video content and at least one frame adjacent to the identified one or more frames replaces at least one frame before the identified one or more frames.

6. The method of claim 1 , wherein:

the one or more frames of video content comprise an advertisement of an advertising break within the video content currently playing at the client device; and

the replacing of the identified one or more frames of the video content and the at least one frame adjacent to the identified one or more frames includes replacing the advertisement with an advertisement that is targeted to a user associated with the client device.

7. The method of claim 1 , wherein:

the one or more frames of video content comprise an advertisement of an advertising break within the video content currently playing at the client device; and

the replacing of the identified one or more frames of the video content and the at least one frame adjacent to the identified one or more frames includes replacing the advertisement with an advertisement that is targeted to a location associated with the client device.

8. The method of claim 1 , wherein:

the identified one or more frames of video content are frames of a first advertisement;

the at least one frame adjacent to the identified one or more frames is at least one frame of a second advertisement; and

the supplemental video content is a third advertisement.

9. A system, comprising:

a memory storing instructions; and

one or more processors configured by the instructions to perform operations comprising:

determining identifying information for video content currently playing at a client device;

identifying one or more frames of the video content to be replaced with supplemental video content based on the identifying information determined for the video content playing at the client device, wherein the one or more frames of video content are at least one frame fewer than the supplemental video content; and

replacing the identified one or more frames of the video content and at least one frame adjacent to the identified one or more frames with the supplemental video content.

10. The system of claim 9 , wherein identifying the one or more frames of the video content to be replaced comprises identifying a frame of the video content that is associated with a black screen within the video content.

11. The system of claim 9 , wherein identifying the one or more frames of the video content to be replaced comprises identifying content overlaid onto the video content.

12. The system of claim 9 , wherein the operations further comprise:

determining one or more fingerprints of the video content;

comparing the determined one or more fingerprints of the video content to one or more reference fingerprints determined at a broadcaster that provides the video content currently playing at the client device; and

identifying the one or more frames to be replaced with the supplemental video content based on a result of the comparison.

13. The system of claim 9 , wherein the replacing of the identified one or more frames of the video content and at least one frame adjacent to the identified one or more frames replaces at least one frame before the identified one or more frames.

14. The system of claim 9 , wherein:

the identified one or more frames of video content are frames of a first advertisement;

the at least one frame adjacent to the identified one or more frames is at least one frame of a second advertisement; and

the supplemental video content is a third advertisement.

15. The system of claim 9 , wherein:

the one or more frames of video content comprise an advertisement of an advertising break within the video content currently playing at the client device; and

the replacing of the identified one or more frames of the video content and the at least one frame adjacent to the identified one or more frames includes replacing the advertisement with an advertisement that is targeted to a user associated with the client device.

16. The system of claim 9 , wherein:

the one or more frames of video content comprise an advertisement of an advertising break within the video content currently playing at the client device; and

the replacing of the identified one or more frames of the video content and the at least one frame adjacent to the identified one or more frames includes replacing the advertisement with an advertisement that is targeted to a location associated with the client device.

17. The system of claim 9 , wherein:

the one or more frames of video content requested to be replaced are one or more frames of a first portion of an advertisement; and

the replacing of the identified one or more frames of the video content and the at least one frame adjacent to the identified one or more frames includes replacing the first portion of the advertisement with a second portion of the advertisement, the second portion being targeted to a location associated with the client device.

18. A non-transitory computer-readable storage medium whose contents, when executed by a computing system, cause the computing system to perform operations, comprising:

determining identifying information for video content currently playing at a client device;

identifying one or more frames of the video content to be replaced with supplemental video content based on the identifying information determined for the video content playing at the client device, wherein the one or more frames of video content are at least one frame fewer than the supplemental video content; and

replacing the identified one or more frames of the video content and at least one frame adjacent to the identified one or more frames with the supplemental video content without shifting the at least one frame adjacent to the identified one or more frames.

19. The non-transitory computer-readable storage medium of claim 18 , wherein:

the identified one or more frames of video content are frames of a first advertisement;

the at least one frame adjacent to the identified one or more frames is at least one frame of a second advertisement; and

the supplemental video content is a third advertisement.

20. The non-transitory computer-readable storage medium of claim 18 , wherein:

the one or more frames of video content comprise an advertisement of an advertising break within the video content currently playing at the client device; and

the replacing of the identified one or more frames of the video content and the at least one frame adjacent to the identified one or more frames includes replacing the advertisement with an advertisement that is targeted to a user associated with the client device.

Assignments (10)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: GRACENOTE, INC.; A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2020
From: DUNKER, PETER; CREMER, MARKUS K; GORDON, DONALD F.
To: GRACENOTE, INC.
Reel/Frame 051775/0642 →