IP Library Granted Patent US 10,728,628
Granted Patent B2
US 10,728,628 · App. 16/399,525 · Granted Jul 28, 2020

Dynamic video advertisement replacement

Inventors: Marcus Liassides (Cardiff, GB); Stefan Liassides (Cardiff, GB)
Assignee: The Nielsen Company (US), LLC
H04N21/812G06Q30/02G06Q30/0241G06Q30/0276G06Q30/0277H04N21/252H04N21/2547H04N21/25841H04N21/25883H04N21/262H04N21/44016H04N21/44204H04N21/44209H04N21/458H04N21/4532H04N21/4667
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,728,628
App. No.
16/399,525
Granted
Jul 28, 2020
Kind
B2
Abstract

A system and method includes an automatic content recognition (ACR) headend to perform ACR recognition on a video stream that is also being streamed to a smart TV, to detect timing of an upcoming ad spot to be delivered within the video stream. An addressable TV (ATV) engine can be in communication with the ACR head end and to: determine, from data of an ad campaign, whether a first ad to be delivered to the ad spot is off target for the ad spot; notify the ad replacer client to replace the first ad with an addressable ad when the first ad is off target for the ad spot; and provide, to the ad replacer client, criteria with which to constrain an ad request to obtain a second ad that is on target for the ad spot.

Claims (36)

1. A system comprising:

an automatic content recognition (ACR) headend configured to:

store a first fingerprint identifying an advertisement (ad) spot;

monitor a video stream prior to delivery of the video stream to a client device;

capture a second fingerprint during monitoring of the video stream;

detect the ad spot in the video stream by comparing the second fingerprint from the video stream with the stored first fingerprint;

monitor the client device for streaming of the video stream on the client device;

notify the client device upon detecting that the ad spot is to arrive during the streaming of the video stream on the client device; and

an addressable television (ATV) engine in operative communication with the ACR headend, the ATV engine configured to:

determine whether a first ad to be delivered to the ad spot is off target for the ad spot;

notify the client device to replace the first ad with a replacement ad when the first ad is off target for the ad spot, wherein the ATV engine is further configured to provide, to the client device, criteria with which to constrain an ad request to make the replacement ad on target for the ad spot.

2. The system of claim 1 , wherein the ATV engine determines whether the first ad is off target for the ad spot based on audience data and/or viewing data associated with the client device.

3. The system of claim 1 , wherein the ATV engine determines whether the first ad is off target for the ad spot based on data from an ad campaign.

4. The system of claim 1 , further comprising an ATV manager configured to receive input to amend the ad campaign.

5. The system of claim 4 , wherein the input amends a target audience for the ad campaign.

6. The system of claim 1 , further comprising a supply side platform (SSP) system configured to receive, from the client device, the ad request for the replacement ad and to deliver the replacement ad to the client device.

7. The system of claim 6 , wherein the SSP system identifies the replacement ad to fulfill the request based on audience data and/or viewing data associated with the client device.

8. The system of claim 6 , wherein the SSP system is configured to hold an auction for bids from advertisers to fulfill the ad request.

9. The system of claim 1 , further comprising an ATV manager configured to monitor a quality of the video stream for capturing the second fingerprint and to report the quality to the client device.

10. A method comprising:

storing a first fingerprint identifying an advertisement (ad) spot;

monitoring a video stream prior to delivery of the video stream to a client device;

capturing a second fingerprint during monitoring of the video stream;

detecting the ad spot in the video stream by comparing the second fingerprint from the video stream with the stored first fingerprint;

monitoring the client device for streaming of the video stream on the client device;

notifying the client device upon detecting that the ad spot is to arrive during the streaming of the video stream on the client device;

determining whether a first ad to be delivered to the ad spot is off target for the ad spot; and

notifying the client device to replace the first ad with a replacement ad when the first ad is off target for the ad spot, wherein the ATV engine is further configured to provide, to the client device, criteria with which to constrain an ad request to make the replacement ad on target for the ad spot.

11. The method of claim 10 , wherein the first ad is determined to be off target for the ad spot based on audience data and/or viewing data associated with the client device.

12. The method of claim 10 , wherein the first ad is determined to be off target for the ad spot based on data from an ad campaign.

13. The method of claim 10 , further comprising receiving amendments to the ad campaign.

14. The method of claim 13 , wherein the amendments amend a target audience for the ad campaign.

15. The method of claim 10 , further comprising, receiving at a supply side platform (SSP) system, the ad request from the client device for the replacement ad and delivering, by the SSP system, the replacement ad to the client device.

16. The methods of claim 15 , wherein the SSP system identifies the replacement ad to fulfill the request based on audience data and/or viewing data associated with the client device.

17. The method of claim 15 , wherein the SSP system is configured to hold an auction for bids from advertisers to fulfill the ad request.

18. The method of claim 10 , further comprising monitoring a quality of the video stream for capturing the second fingerprint and reporting the quality to the client device.

Assignments (11)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: THE NIELSEN COMPANY (US), LLC
To: ROKU, INC.
Reel/Frame 056106/0376 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 6, 2019
From: SORENSON MEDIA, INC.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 049089/0489 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 6, 2019
From: LIASSIDES, MARCUS; LIASSIDES, STEFAN
To: SORENSON MEDIA, INC.
Reel/Frame 049089/0210 →