IP Library Granted Patent US 9,743,154
Granted Patent B2
US 9,743,154 · App. 15/058,750 · Granted Aug 22, 2017

Dynamic video advertisement replacement

Inventors: Marcus Liassides (Cardiff, GB); Stefan Liassides (Cambridge, GB)
H04N21/812G06Q30/02H04N21/25841H04N21/44016H04N21/44204H04N21/44209
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,743,154
App. No.
15/058,750
Granted
Aug 22, 2017
Kind
B2
Abstract

A system and method includes an automatic content recognition (ACR) headend to perform ACR recognition on a video stream that is also being streamed to a smart TV, to detect timing of an upcoming ad spot to be delivered within the video stream. An addressable TV (ATV) engine can be in communication with the ACR head end and to: determine, from data of an ad campaign, whether a first ad to be delivered to the ad spot is off target for the ad spot; notify the ad replacer client to replace the first ad with an addressable ad when the first ad is off target for the ad spot; and provide, to the ad replacer client, criteria with which to constrain an ad request to obtain a second ad that is on target for the ad spot.

Claims (54)

1. A system comprising:

an automatic content recognition (ACR) headend to:

store a first fingerprint of an advertisement (ad) spot;

monitor a video stream ahead in time from when the video stream is delivered to a smart television (TV);

detect the ad spot by comparing the first fingerprint with a second fingerprint, wherein the second fingerprint is captured of the ad spot during monitoring the video stream;

monitor a channel being watched on the smart TV;

notify an ad replacer client of the smart TV upon detecting that the ad spot is to arrive within the video stream on the channel; and

an addressable TV (ATV) engine in operative communication with the ACR headend, the ATV engine to:

determine, from data of an ad campaign, whether a first ad to be delivered to the ad spot is off target for the ad spot;

notify the ad replacer client to replace the first ad with an addressable ad when the first ad is off target for the ad spot; and

provide, to the ad replacer client, criteria with which to constrain an ad request to obtain a second ad that is on target for the ad spot.

2. The system of claim 1 , wherein the ACR headend resides on a first computing device and the ATV engine resides on at least a second computing device.

3. The system of claim 1 , wherein the criteria comprises at least one of: a demographic parameter, a geographic parameter, or a language setting of the smart TV.

4. The system of claim 1 , further comprising an ATV manager to detect a bit rate below a threshold minimum bit rate within the video stream, wherein the threshold minimum bit rate provides sufficient quality in the video stream to capture the second fingerprint.

5. The system of claim 4 , wherein the ATV manager is further to report to the smart TV detection of the bit rate below the threshold minimum bit rate.

6. The system of claim 1 , further comprising an ATV manager to detect that an aspect ratio within the video stream provides sufficient quality in the video stream to capture the second fingerprint.

7. The system of claim 1 , further comprising a supply side computing device to:

receive the ad request from the smart TV;

determine which second ad is on target for the ad spot by comparing, with the criteria, audience and viewing data associated with the smart TV; and

cause the second ad to be delivered to the smart TV to be viewed in lieu of the first ad.

8. A method comprising:

storing, by a first computing device, a first fingerprint of an advertisement (ad) spot;

monitoring, by the first computing device, a video stream ahead in time from when the video stream is delivered to a smart television (TV);

detecting, by the first computing device, the ad spot by comparing the first fingerprint with a second fingerprint, wherein the second fingerprint is captured of the ad spot during the monitoring of the video stream;

monitoring, by the first computing device, a channel being watched on the smart TV;

notifying, by the first computing device, an ad replacer client of the smart TV upon detecting that the ad spot is to arrive within the video stream on the channel;

determining, by a second computing device that is in operative communication with the first computing device and in view of data from an ad campaign, whether a first ad to be delivered to the ad spot is off target for the ad spot;

notifying, by the second computing device, the ad replacer client to replace the first ad with an addressable ad when the first ad is off target for the ad spot; and

providing, by the second computing device to the ad replacer client, criteria with which to constrain an ad request to obtain a second ad that is on target for the ad spot.

9. The method of claim 8 , wherein the criteria comprises at least one of: a demographic parameter, a geographic parameter, or a language setting of the smart TV.

10. The method of claim 8 , further comprising detecting, by a third computing device operatively coupled to the second computing device, a bit rate below a threshold minimum bit rate within the video stream, wherein the threshold minimum bit rate provides sufficient quality in the video stream to capture the second fingerprint.

11. The method of claim 10 , further comprising reporting, by the third computing device to the smart TV, detection of the bit rate below the threshold minimum bit rate.

12. The method of claim 8 , further comprising detecting, by a third computing device operatively coupled to the second computing device, that an aspect ratio within the video stream provides sufficient quality in the video stream to capture the second fingerprint.

13. The method of claim 8 , further comprising:

receiving the ad request from the smart TV;

determining the second ad is on target for the ad spot by comparing, with the criteria, audience and viewing data associated with the smart TV; and

causing the second ad to be delivered to the smart TV to be viewed in lieu of the first ad.

14. A non-transitory computer-readable storage medium storing instructions, which when executed by one of a first computing device or a second computing device, cause the first computing device and the second computing, respectively, to execute a plurality of operations comprising:

storing, by the first computing device, a first fingerprint of an advertisement (ad) spot;

monitoring, by the first computing device, a video stream ahead in time from when the video stream is delivered to a smart television (TV);

detecting, by the first computing device, the ad spot by comparing the first fingerprint with a second fingerprint, wherein the second fingerprint is captured of the ad spot during the monitoring of the video stream;

monitoring, by the first computing device, a channel being watched on the smart TV;

notifying, by the first computing device, an ad replacer client of the smart TV upon detecting that the ad spot is to arrive within the video stream on the channel;

determining, by the second computing device that is in operative communication with the first computing device and in view of data from an ad campaign, whether a first ad to be delivered to the ad spot is off target for the ad spot;

notifying, by the second computing device, the ad replacer client to replace the first ad with an addressable ad when the first ad is off target for the ad spot; and

providing, by the second computing device to the ad replacer client, criteria with which to constrain an ad request to obtain a second ad that is on target for the ad spot.

15. The non-transitory computer-readable storage medium of claim 14 , wherein the criteria comprises at least one of: a demographic parameter, a geographic parameter, or a language setting of the smart TV.

16. The non-transitory computer-readable storage medium of claim 14 , wherein the plurality of operations further comprises detecting, by a third computing device operatively coupled to the second computing device, a bit rate below a threshold minimum bit rate within the video stream, wherein the threshold minimum bit rate provides sufficient quality in the video stream to capture the second fingerprint.

17. The non-transitory computer-readable storage medium of claim 16 , wherein the plurality of operations further comprises reporting, by the third computing device to the smart TV, detection of the bit rate below the threshold minimum bit rate.

18. The non-transitory computer-readable storage medium of claim 14 , wherein the plurality of operations further comprises detecting, by a third computing device operatively coupled to the second computing device, that an aspect ratio within the video stream provides sufficient quality in the video stream to capture the second fingerprint.

19. The non-transitory computer-readable storage medium of claim 14 , wherein the plurality of operations further comprises:

receiving the ad request from the smart TV;

determining the second ad is on target for the ad spot by comparing, with the criteria, audience and viewing data associated with the smart TV; and

causing the second ad to be delivered to the smart TV to be viewed in lieu of the first ad.

Assignments (11)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: THE NIELSEN COMPANY (US), LLC
To: ROKU, INC.
Reel/Frame 056106/0376 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 15, 2019
From: SORENSON MEDIA, INC.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 048355/0949 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 2, 2016
From: LIASSIDES, MARCUS; LIASSIDES, STEFAN
To: SORENSON MEDIA, INC.
Reel/Frame 037873/0929 →
Continuity (2)
Provisional Application 62216216 · Sep 9, 2015
Related Publication 20170070789A1 · Mar 9, 2017