IP Library Granted Patent US 10,728,629
Granted Patent B2
US 10,728,629 · App. 16/399,548 · Granted Jul 28, 2020

Dynamic video advertisement replacement

Inventors: Marcus Liassides (Cardiff, GB); Stefan Liassides (Cardiff, GB)
Assignee: The Nielsen Company (US), LLC
H04N21/812G06Q30/02G06Q30/0241G06Q30/0276G06Q30/0277H04N21/252H04N21/2547H04N21/25841H04N21/25883H04N21/262H04N21/44016H04N21/44204H04N21/44209H04N21/458H04N21/4532H04N21/4667
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,728,629
App. No.
16/399,548
Granted
Jul 28, 2020
Kind
B2
Abstract

A system and method includes an automatic content recognition (ACR) headend to perform ACR recognition on a video stream that is also being streamed to a smart TV, to detect timing of an upcoming ad spot to be delivered within the video stream. An addressable TV (ATV) engine can be in communication with the ACR head end and to: determine, from data of an ad campaign, whether a first ad to be delivered to the ad spot is off target for the ad spot; notify the ad replacer client to replace the first ad with an addressable ad when the first ad is off target for the ad spot; and provide, to the ad replacer client, criteria with which to constrain an ad request to obtain a second ad that is on target for the ad spot.

Claims (77)

1. A client device comprising:

a non-transitory computer-readable medium storing a first set of instructions and a second set of instructions; and

a processing device to execute the first set of instructions to implement an automatic content recognition (ACR) client and to execute the second set of instructions to implement an advertisement (ad) replacer client,

wherein the ACR client is configured to:

send, to a ACR headend, frames of a video stream playing on the client device; and

notify the ad replacer client upon detection of the ad spot in the video stream, and wherein the ad replacer client is configured to:

receive, from an addressable television (ATV) system, a notification indicating that a first ad to be delivered to the ad spot is off target for the ad spot and that the first ad should be replaced with a replacement ad;

generate an ad request for the replacement ad; and

transmit the ad request to a supply side platform (SSP) system to receive the replacement ad, and

wherein the ad request provides criteria for determining that the replacement ad is on target for the ad spot,

the criteria are based on data from an ad campaign associated with the ad spot, and

the ACR client is further configured to: receive a content identifier (ID) for the video stream from the ACR headend, and send the content ID to the ad replacer client, wherein the content ID identifies the ad campaign.

2. The client device of claim 1 , wherein the criteria are based further on audience data and/or viewing data associated with the client device.

3. The client device of claim 1 , wherein the ad replacer client receives the criteria from the ATV system.

4. The client device of claim 1 , wherein the ACR client is further configured to monitor changes to the video stream or a channel on which the video stream is playing.

5. The client device of claim 4 , wherein the ACR client is further configured to detect a change in the channel on the client device and notify the ad replacer client of the change in the channel, and

the ad replacer client is further configured to cancel the ad request in response to the change in the channel.

6. The client device of claim 1 , wherein the SSP system is configured to hold an auction for bids from advertisers to fulfill the ad request.

7. The client device of claim 1 , wherein frames of a video stream include a fingerprint identifying the ad spot, the ACR headend detecting the ad spot in the video stream based on the fingerprint.

8. A method comprising:

sending, by an automatic content recognition (ACR) client, frames of a video stream playing on a client device to a ACR headend;

identifying, by the ACR client, an ad spot in the video stream;

receiving, by an advertisement (ad) replacer client, a notification from an addressable television (ATV) system, the notification indicating that a first ad to be delivered to the ad spot is off target for the ad spot and that the first ad should be replaced with a replacement ad;

generating, by the ad replacer client, an ad request for the replacement ad; and

transmitting, by the ad replacer client, the ad request to a supply side platform (SSP) system to receive the replacement ad,

wherein the ad request provides criteria for determining that the replacement ad is on target for the ad spot,

the criteria are based on data from an ad campaign associated with the ad spot, and

the method further comprises,

receiving, by the ACR client, a content identifier (ID) for the video stream from the ACR headend; and

sending, by the ACR client, the content ID to the ad replacer client, wherein the content ID identifies the ad campaign.

9. The method of claim 8 , wherein the criteria are based on audience data and/or viewing data associated with the client device.

10. The method of claim 8 , further comprising receiving, by the ad replacer client, the criteria from the ATV system.

11. The method of claim 8 , further comprising monitoring, by the ACR client, changes to the video stream or a channel on which the video stream is playing.

12. The method device of claim 11 , further comprising:

detecting, by the ACR client, a change in the channel on the client device;

notifying, by the ACR client, the ad replacer client of the change in the channel, and

cancelling, by the ad replacer client, the ad request in response to the change in the channel.

13. The method of claim 8 , wherein the SSP system is configured to hold an auction for bids from advertisers to fulfill the ad request.

14. The method of claim 8 , wherein frames of a video stream include a fingerprint identifying the ad spot, the ACR headend detecting the ad spot in the video stream based on the fingerprint.

15. A client device comprising:

a non-transitory computer-readable medium storing a first set of instructions and a second set of instructions; and

a processing device to execute the first set of instructions to implement an automatic content recognition (ACR) client and to execute the second set of instructions to implement an advertisement (ad) replacer client,

wherein the ACR client is configured to:

send, to a ACR headend, frames of a video stream playing on the client device; and

notify the ad replacer client upon detection of the ad spot in the video stream, and wherein the ad replacer client is configured to:

receive, from an addressable television (ATV) system, a notification indicating that a first ad to be delivered to the ad spot is off target for the ad spot and that the first ad should be replaced with a replacement ad;

generate an ad request for the replacement ad; and

transmit the ad request to a supply side platform (SSP) system to receive the replacement ad, and

wherein the ACR client is further configured to monitor changes to the video stream or a channel on which the video stream is playing,

the ACR client is further configured to detect a change in the channel on the client device and notify the ad replacer client of the change in the channel, and

the ad replacer client is further configured to cancel the ad request in response to the change in the channel.

16. The client device of claim 15 , wherein the ad request provides criteria for determining that the replacement ad is on target for the ad spot.

17. The client device of claim 16 , wherein the criteria are based on audience data and/or viewing data associated with the client device.

18. The client device of claim 16 , wherein the criteria are based on data from an ad campaign associated with the ad spot.

19. The client device of claim 18 , wherein the ACR client is further configured to: receive a content identifier (ID) for the video stream from the ACR headend, and send the content ID to the ad replacer client, wherein the content ID identifies the ad campaign.

20. The client device of claim 16 , wherein the ad replacer client receives the criteria from the ATV system.

21. The client device of claim 15 , wherein the SSP system is configured to hold an auction for bids from advertisers to fulfill the ad request.

22. The client device of claim 15 , wherein frames of a video stream include a fingerprint identifying the ad spot, the ACR headend detecting the ad spot in the video stream based on the fingerprint.

23. A method comprising:

sending, by an automatic content recognition (ACR) client, frames of a video stream playing on a client device to a ACR headend;

identifying, by the ACR client, an ad spot in the video stream;

receiving, by an advertisement (ad) replacer client, a notification from an addressable television (ATV) system, the notification indicating that a first ad to be delivered to the ad spot is off target for the ad spot and that the first ad should be replaced with a replacement ad;

generating, by the ad replacer client, an ad request for the replacement ad;

transmitting, by the ad replacer client, the ad request to a supply side platform (SSP) system to receive the replacement ad;

monitoring, by the ACR client, changes to the video stream or a channel on which the video stream is playing;

detecting, by the ACR client, a change in the channel on the client device;

notifying, by the ACR client, the ad replacer client of the change in the channel; and

cancelling, by the ad replacer client, the ad request in response to the change in the channel.

24. The method of claim 23 , wherein the ad request provides criteria for determining that the replacement ad is on target for the ad spot.

25. The method of claim 24 , wherein the criteria are based on audience data and/or viewing data associated with the client device.

26. The method of claim 24 , wherein the criteria are based on data from an ad campaign associated with the ad spot.

27. The method of claim 26 , further comprising:

receiving, by the ACR client, a content identifier (ID) for the video stream from the ACR headend; and

sending, by the ACR client, the content ID to the ad replacer client, wherein the content ID identifies the ad campaign.

28. The method of claim 26 , further comprising receiving, by the ad replacer client, the criteria from the ATV system.

29. The method of claim 23 , wherein the SSP system is configured to hold an auction for bids from advertisers to fulfill the ad request.

30. The method of claim 23 , wherein frames of a video stream include a fingerprint identifying the ad spot, the ACR headend detecting the ad spot in the video stream based on the fingerprint.

Assignments (11)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: THE NIELSEN COMPANY (US), LLC
To: ROKU, INC.
Reel/Frame 056106/0376 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 6, 2019
From: SORENSON MEDIA, INC.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 049089/0489 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 6, 2019
From: LIASSIDES, MARCUS; LIASSIDES, STEFAN
To: SORENSON MEDIA, INC.
Reel/Frame 049089/0210 →