IP Library Granted Patent US 10,542,326
Granted Patent B2
US 10,542,326 · App. 15/938,167 · Granted Jan 21, 2020

Targeted content placement using overlays

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,542,326
App. No.
15/938,167
Granted
Jan 21, 2020
Kind
B2
Abstract

A method for targeted content placement using overlays includes receiving media content from a content feed and displaying the media content from the content feed at a display of the media device. As the display of the media device displays the media content, the method also includes fingerprinting at least one frame of the media content to obtain a fingerprint and identifying an in-frame advertisement based on the obtained fingerprint. The in-frame advertisement corresponds to an advertisement within a portion of the at least one frame. The method further includes determining a target overlay location within the at least one frame with the in-frame advertisement, the target overlay location corresponding to a size of the in-frame advertisement, and superimposing overlay content at the target overlay location when the display of the media device displays the at least one frame with the in-frame advertisement.

Claims (59)

1. A method comprising:

receiving, at data processing hardware of a media device, media content from a content feed;

displaying, by the data processing hardware of the media device, the media content from the content feed at a display of the media device; and

as the display of the media device displays the media content:

fingerprinting, by the data processing hardware of the media device, at least one frame of the media content to obtain one or more fingerprints of the at least one frame of the media content;

identifying, by the data processing hardware of the media device, an in-frame advertisement within the at least one frame based on the one or more obtained fingerprints, the in-frame advertisement corresponding to an advertisement within a portion of the at least one frame;

determining, by the data processing hardware of the media device, that the one or more obtained fingerprints match fingerprint data associated with a known identity of the media content;

determining, by the data processing hardware of the media device, a target overlay location within the at least one frame with the in-frame advertisement, the target overlay location corresponding to a size of the in-frame advertisement within the at least one frame;

while the one or more obtained fingerprints are determined to be matching the fingerprint data associated with the known identity of the media content, superimposing, by the data processing hardware of the media device, overlay content at the target overlay location when the display of the media device displays the at least one frame with the in-frame advertisement;

during superimposing the overlay content at the target overlay location, determining, by the data processing hardware of the media device, that the match between the one or more obtained fingerprints and the fingerprint data associated with the known identity of the media content has ceased; and

in response to determining that the match between the one or more obtained fingerprints and the fingerprint data associated with the known identity of the media content has ceased, discontinuing, by the data processing hardware of the media device, the superimposing of the overlay content at the target overlay location.

2. The method of claim 1 , wherein superimposing the overlay content at the target overlay location further comprises scaling the overlay content to fit the determined target overlay location.

3. The method of claim 1 , further comprising identifying, by the data processing hardware of the media device, the overlay content based on the one or more obtained fingerprints, the identified overlay content corresponding to an overlay content fingerprint that matches a portion of the one or more obtained fingerprints corresponding to the in-frame advertisement.

4. The method of claim 1 , wherein the overlay content is randomly selected from an overlay content database in communication with the data processing hardware of the media device.

5. The method of claim 1 , wherein fingerprinting the at least one frame of the media content to obtain the one or more fingerprints associates an in-frame advertisement identifier with in-frame advertisements, the method further comprising obtaining, by the data processing hardware of the media device, the overlay content with an overlay identifier that matches the associated in-frame advertisement identifier corresponding to a respective in-frame advertisement.

6. The method of claim 1 , wherein the in-frame advertisement comprises a background feature within the media content of the at least one frame.

7. The method of claim 1 , wherein the in-frame advertisement corresponds to a scene, the scene corresponding to more than one frame of media content.

8. The method of claim 7 , further comprising identifying, by the data processing hardware of the media device, overlay content corresponding to an overlay scene, the overlay scene comprising a number of overlay content frames that matches a number of frames corresponding to the scene of the in-frame advertisement.

9. The method of claim 1 , wherein the in-frame advertisement corresponds to a potential in-frame advertisement placement position within the portion of the at least one frame.

10. The method of claim 1 , further comprising:

receiving, at the data processing hardware of the media device, an advertisement placement request, the advertisement placement request requesting an in-frame advertisement placement position and comprising overlay criteria;

identifying, by the data processing hardware of the media device, the target overlay location as the in-frame advertisement placement position; and

superimposing, by the data processing hardware of the media device, overlay content at the in-frame advertisement placement position that satisfies the overlay criteria of the advertisement placement request.

11. A system comprising:

a media device comprising a display;

data processing hardware located at the media device; and

memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:

receiving media content from a content feed;

displaying the media content from the content feed at the display of the media device; and

as the display of the media device displays the media content:

fingerprinting at least one frame of the media content to obtain one or more fingerprints of the at least one frame of the media content;

identifying an in-frame advertisement within the at least one frame based on the one or more obtained fingerprints, the in-frame advertisement corresponding to an advertisement within a portion of the at least one frame;

determining that the one or more obtained fingerprints match fingerprint data associated with a known identity of the media content;

determining a target overlay location within the at least one frame with the in-frame advertisement, the target overlay location corresponding to a size of the in-frame advertisement within the at least one frame;

while the one or more obtained fingerprints are determined to be matching the fingerprint data associated with the known identity of the media content, superimposing overlay content at the target overlay location when the display of the media device displays the at least one frame with the in-frame advertisement;

during superimposing the overlay content at the target overlay location, determining that the match between the one or more obtained fingerprints and the fingerprint data associated with the known identity of the media content has ceased; and

in response to determining that the match between the one or more obtained fingerprints and the fingerprint data associated with the known identity of the media content has ceased, discontinuing the superimposing of the overlay content at the target overlay location.

12. The system of claim 11 , wherein superimposing the overlay content at the target overlay location further comprises scaling the overlay content to fit the determined target overlay location.

13. The system of claim 11 , wherein the operations further comprise identifying the overlay content based on the one or more obtained fingerprints, the identified overlay content corresponding to an overlay content fingerprint that matches a portion of the one or more obtained fingerprints corresponding to the in-frame advertisement.

14. The system of claim 11 , wherein the overlay content is randomly selected from an overlay content database in communication with the data processing hardware of the media device.

15. The system of claim 11 , wherein fingerprinting the at least one frame of the media content to obtain the one or more fingerprints associates an identifier with in-frame advertisements and the operations further comprise obtaining the overlay content with an overlay identifier that matches the associated identifier corresponding to a respective in-frame advertisement.

16. The system of claim 11 , wherein the in-frame advertisement comprises a background feature within the media content of the at least one frame.

17. The system of claim 11 , wherein the in-frame advertisement corresponds to a scene, the scene corresponding to more than one frame of media content.

18. The system of claim 17 , wherein the operations further comprise identifying overlay content corresponding to an overlay scene, the overlay scene comprising a number of overlay content frames that matches a number of frames corresponding to the scene of the in-frame advertisement.

19. The system of claim 11 , wherein the in-frame advertisement corresponds to a potential in-frame advertisement placement position within the portion of the at least one frame.

20. The system of claim 11 , wherein the operations further comprise:

receiving an advertisement placement request, the advertisement placement request requesting an in-frame advertisement placement position and comprising overlay criteria;

identifying the target overlay location as the in-frame advertisement placement position; and

superimposing overlay content at the in-frame advertisement placement position that satisfies the overlay criteria of the advertisement placement request.

21. A non-transitory computer readable medium having stored thereon instructions that, upon execution by a processor, cause performance of a set of acts comprising:

receiving media content from a content feed;

displaying the media content from the content feed at a display of a media device; and as the display of the media device displays the media content:

fingerprinting at least one frame of the media content to obtain one or more fingerprints of the at least one frame of the media content;

identifying an in-frame advertisement within the at least one frame based on the one or more obtained fingerprints, the in-frame advertisement corresponding to an advertisement within a portion of the at least one frame;

determining that the one or more obtained fingerprints match fingerprint data associated with a known identity of the media content;

determining a target overlay location within the at least one frame with the in-frame advertisement, the target overlay location corresponding to a size of the in-frame advertisement within the at least one frame;

while the one or more obtained fingerprints are determined to be matching the fingerprint data associated with the known identity of the media content, superimposing overlay content at the target overlay location when the display of the media device displays the at least one frame with the in-frame advertisement;

during superimposing the overlay content at the target overlay location, determining that the match between the one or more obtained fingerprints and the fingerprint data associated with the known identity of the media content has ceased; and

in response to determining that the match between the one or more obtained fingerprints and the fingerprint data associated with the known identity of the media content has ceased, discontinuing the superimposing of the overlay content at the target overlay location.

Assignments (11)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: GRACENOTE, INC.; A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: THE NIELSEN COMPANY (US), LLC
To: ROKU, INC.
Reel/Frame 056106/0376 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 27, 2019
From: SORENSON MEDIA, INC.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 048458/0856 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 5, 2018
From: GROVER, MATTHEW
To: SORENSON MEDIA, INC.
Reel/Frame 047080/0108 →