IP Library Granted Patent US 10,863,222
Granted Patent B2
US 10,863,222 · App. 16/388,070 · Granted Dec 8, 2020

Digital overlay offers on connected media devices

Inventors: David John Evans (Monmouth, GB); Thomas Greenway (Gilwern, GB); Martin Ian Spicer (Pontypridd, GB)
Assignee: The Nielsen Company (US), LLC
H04N21/2668G06Q20/20G06Q20/367H04N21/25841H04N21/25883H04N21/25891H04N21/2665H04N21/4122H04N21/4126H04N21/4316H04N21/43615H04N21/44222H04N21/4784H04N21/47815H04N21/812
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,863,222
App. No.
16/388,070
Granted
Dec 8, 2020
Kind
B2
Abstract

A computing device includes memory for storing commercial metadata and offer metadata harvested from within an offer distribution network. A processor compares the commercial metadata related to a broadcast commercial to be streamed to a client media device with the offer metadata related to available offers from offer providers, to generate a comparison. The processor then selects an offer from the available offers based on the comparison; determines when and over what video stream the broadcast commercial is to be streamed; detects that a screen device is paired to the client media device; and delivers the offer to a display of the screen device during streaming of the broadcast commercial over the video stream to the client media device. When a user of the screen device selects an indicia of the offer, the offer is collected into a virtual wallet from which the offer can be redeemed in various ways.

Claims (130)

1. A non-transitory computer readable medium having stored thereon instructions that, upon execution by a processor, cause performance of a set of acts comprising:

receiving:

a broadcast commercial from a broadcast stream to be streamed to a client media device; and

available offers from at least one offer provider of an offer distribution network;

identifying, using automatic content recognition, commercial metadata related to the broadcast commercial;

using the identified commercial metadata to determine whether the available offers comprise one or more direct offers, the one or more direct offers having offer metadata matching commercial metadata of the broadcast commercial, the commercial metadata defining a brand or an entity associated with the broadcast commercial;

based on whether the available offers comprise the one or more direct offers, selecting a targeted offer, wherein selecting the targeted offer comprises:

responsive to determining that the available offers comprise the one or more direct offers, using the identified commercial metadata and at least a first type of data to select the targeted offer from the one or more direct offers, wherein the first type of data comprises one or more of brand and entity information, and

responsive to determining that the available offers do not comprise the one or more direct offers, using a second type of data to select the targeted offer from the available offers, wherein the second type of data is different from the first type of data; and

automatically delivering the selected targeted offer to the client media device such that, while the broadcast commercial is being streamed to and displayed by the client media device, the client media device displays the selected targeted offer as an overlay or a pop-up advertisement over the broadcast commercial.

2. The non-transitory computer readable medium of claim 1 , the set of acts further comprising:

delivering the selected targeted offer over a personal area network to a display of a screen device such that, while the broadcast commercial is being streamed to and displayed by the client media device, the screen device displays the selected targeted offer.

3. The non-transitory computer readable medium of claim 1 , wherein the selected targeted offer is automatically delivered with an advertising identifier, the advertising identifier configured to track redemption of the selected targeted offer.

4. The non-transitory computer readable medium of claim 1 , wherein using the identified commercial metadata and at least the first type of data to select the targeted offer from the one or more direct offers comprises using the identified commercial metadata, offer metadata for the one or more direct offers, and the second type of data to select the targeted offer from the one or more direct offers, and

wherein the second type of data comprises user metadata indicating a preference for offer content.

5. The non-transitory computer readable medium of claim 1 , wherein the second type of data comprises user metadata, and

wherein using the second type of data to select the targeted offer from the available offers comprises using, from the user metadata, one or more of (i) a purchase history, (ii) a user history of interaction with offers, (iii) geo-location information, or (iv) user profile factors, to select the targeted offer.

6. A non-transitory computer readable medium having stored thereon instructions that, upon execution by a processor, cause performance of a set of acts comprising:

identifying whether available offers from at least one offer provider of an offer distribution network comprise one or more direct offers, the one or more direct offers having corresponding offer metadata matching a threshold amount of commercial metadata of a corresponding broadcast commercial to be streamed to a client media device, wherein the commercial metadata comprises at least two of:

an entity associated with the corresponding broadcast commercial;

a product or service associated with the corresponding broadcast commercial; or

a category associated with the corresponding broadcast commercial;

identifying, using automatic content recognition, the commercial metadata from the corresponding broadcast commercial based on a video stream broadcast to the client media device;

based on whether the available offers comprise the one or more direct offers, selecting a targeted offer, wherein selecting the targeted offer comprises:

responsive to identifying that the available offers comprise the one or more direct offers, using the identified commercial metadata and at least a first type of data to select the targeted offer from the one or more direct offers, wherein the first type of data comprises one or more of brand and entity information, and

responsive to identifying that the available offers do not comprise the one or more direct offers, using a second type of data to select the targeted offer from the available offers, wherein the second type of data is different from the first type of data;

automatically delivering the selected targeted offer to the client media device such that, while the broadcast commercial is being streamed to and displayed by the client media device, the client media device displays the selected targeted offer as an overlay or a pop-up advertisement over the corresponding broadcast commercial; and

delivering the selected targeted offer over a personal area network to a display of a screen device such that, while the corresponding broadcast commercial is being streamed to and displayed by the client media device, the screen device displays the selected targeted offer.

7. The non-transitory computer readable medium of claim 6 , the set of acts further comprising:

harvesting the commercial metadata from a plurality of sources, including multiple channels of streaming media; and

indexing the commercial metadata such that the commercial metadata is searchable.

8. The non-transitory computer readable medium of claim 6 , the set of acts further comprising:

detecting that the screen device is paired to the client media device via the personal area network;

detecting selection of the selected targeted offer displayed on the client media device and the screen device by the screen device; and

facilitating transfer of a digital version of the selected targeted offer to a virtual wallet accessible through the screen device.

9. A method comprising:

identifying, by a processor, whether available offers from at least one offer provider of an offer distribution network comprise one or more direct offers, the one or more direct offers having corresponding offer metadata matching a threshold amount of commercial metadata of a corresponding broadcast commercial to be streamed to a client media device, wherein the commercial metadata comprises at least two of:

an entity associated with the corresponding broadcast commercial;

a product or service associated with the corresponding broadcast commercial; or

a category associated with the corresponding broadcast commercial;

identifying, by the processor, using automatic content recognition, the commercial metadata from the corresponding broadcast commercial based on a video stream broadcast to the client media device;

based on whether the available offers comprise the one or more direct offers, selecting, by the processor, a targeted offer, wherein selecting the targeted offer comprises:

responsive to identifying that the available offers comprise the one or more direct offers, using the identified commercial metadata and at least a first type of data to select the targeted offer from the one or more direct offers, wherein the first type of data comprises one or more of brand and entity information, or

responsive to identifying that the available offers do not comprise the one or more direct offers, using a second type of data to select the targeted offer from the available offers, wherein the second type of data is different from the first type of data;

automatically delivering, by the processor, the selected targeted offer to the client media device such that, while the corresponding broadcast commercial is being streamed to and displayed by the client media device, the client media device displays the selected targeted offer as an overlay or a pop-up advertisement over the corresponding broadcast commercial; and

delivering, by the processor, the selected targeted offer over a personal area network to a display of a screen device such that, while the corresponding broadcast commercial is being streamed to and displayed by the client media device, the screen device displays the selected target offer.

10. The method of claim 9 , wherein identifying whether the available offers comprise the one or more direct offers comprises identifying that the available offers comprise the one or more direct offers,

wherein using the identified commercial metadata and at least the first type of data to select the targeted offer from the one or more direct offers comprises using the identified commercial metadata, offer metadata for the one or more direct offers, and the second type of data to select the targeted offer from the one or more direct offers, and

wherein the second type of data comprises user metadata indicating a preference for offer content for a user that operates the client media device.

11. The method of claim 9 , wherein identifying whether the available offers comprise the one or more direct offers comprises identifying that the available offers do not comprise the one or more direct offers, the method further comprising:

receiving, by the processor, user metadata related to a user of the client media device,

wherein the user metadata comprises one or more of (i) a purchase history, (ii) a user history of interaction with offers, (iii) geo-location information, or (iv) user profile factors, and

wherein using the second type of data to select the targeted offer from the available offers comprises using the user metadata to select the targeted offer.

12. A non-transitory computer readable medium having stored thereon instructions that, upon execution by a processor, cause performance of a set of acts comprising:

identifying whether available offers from at least one offer provider of an offer distribution network comprise one or more direct offers, the one or more direct offers having corresponding offer metadata matching a threshold amount of commercial metadata of a corresponding broadcast commercial to be streamed to a client media device, wherein the commercial metadata comprises at least two of:

an entity associated with the corresponding broadcast commercial;

a product or service associated with the corresponding broadcast commercial; or

a category associated with the corresponding broadcast commercial;

identifying, using automatic content recognition, the commercial metadata from the corresponding broadcast commercial based on a video stream broadcast to the client media device;

detecting that a screen device is paired to the client media device via a personal area network;

based on whether the available offers comprise the one or more direct offers, selecting a targeted offer, wherein selecting the targeted offer comprises;

responsive to identifying that the available offers comprise the one or more direct offers, using the identified commercial metadata and at least a first type of data to select the targeted offer from the one or more direct offers, wherein the first type of data comprises one or more of brand and entity information, or

responsive to identifying that the available offers do not comprise the one or more direct offers, using a second type of data to select the targeted offer from the available offers, wherein the second type of data is different from the first type of data;

automatically delivering the selected targeted offer over the personal area network to a display of the screen device such that, while the corresponding broadcast commercial is being streamed to and displayed by the client media device, the screen device displays the selected targeted offer.

13. The non-transitory computer readable medium of claim 12 , the set of acts further comprising:

receiving an indication of a user selection of the displayed selected targeted offer through the screen device; and

facilitating transfer of a digital version of the displayed selected targeted offer to a virtual wallet accessible through the screen device.

14. The non-transitory computer readable medium of claim 12 , wherein using the identified commercial metadata and at least the first type of data to select the targeted offer from the one or more direct offers comprises using the identified commercial metadata, offer metadata for the one or more direct offers, and the second type of data to select the targeted offer from the one or more direct offers, and

wherein the second type of data comprises one or more of weather or a location of the client media device.

15. A method comprising:

identifying, by a processor, whether available offers from at least one offer provider of an offer distribution network comprise one or more direct offers, the one or more direct offers having corresponding offer metadata matching a threshold amount of commercial metadata of a corresponding broadcast commercial to be streamed to a client media device, wherein the commercial metadata comprises at least two of:

an entity associated with the corresponding broadcast commercial;

a product or service associated with the corresponding broadcast commercial; or

a category associated with the corresponding broadcast commercial;

identifying, by the processor, using automatic content recognition, the commercial metadata from the corresponding broadcast commercial based on a video stream broadcast to the client media device;

detecting, by the processor, that a screen device is paired to the client media device via a personal area network;

based on whether the available offers comprise the one or more direct offers, selecting, by the processor, a targeted offer, wherein selecting the targeted offer comprises:

responsive to identifying that the available offers comprise the one or more direct offers, using the identified commercial metadata and at least a first type of data to select the targeted offer from the one or more direct offers, wherein the first type of data comprises one or more of brand and entity information, or

responsive to identifying that the available offers do not comprise the one or more direct offers, using a second type of data to select the targeted offer from the available offers, wherein the second type of data is different from the first type of data; and

automatically delivering, by the processor, the selected targeted offer over the personal area network to a display of screen device such that, while the corresponding broadcast commercial is being streamed to and displayed by the client media device, the screen device displays the selected targeted offer.

16. The method of claim 15 , wherein identifying whether the available offer comprise the one or more direct offers comprises identifying that the available offer do not comprise the one or more direct offers, the method further comprising:

receiving, by the processor, user metadata related to a user of the screen device,

wherein the user metadata comprises one or more of (i) a purchase history, (ii) a user history of interaction with offers, (iii) geo-location information, or (iv) user profile factors, and

wherein using the second type of data to select the targeted offer from the available offers comprises using the user metadata to select the targeted offer.

17. A non-transitory computer readable medium having stored thereon instructions that, upon execution by a processor of an offer computing system, cause performance of a set of acts comprising:

harvesting commercial metadata related to broadcast commercials broadcasted within an offer distribution network, each broadcast commercial comprising commercial metadata comprising at least two of:

an entity associated with the corresponding broadcast commercial;

a product or service associated with the corresponding broadcast commercial; or

a category associated with the corresponding broadcast commercial;

storing the harvested commercial metadata in a commercial metadata database;

harvesting offer metadata related to available offers generated by provider systems of the offer distribution network and available to deliver with the broadcast commercials;

storing the harvested offer metadata in an offer metadata database;

obtaining user metadata comprising interests of a user associated with a client media device; and

for each broadcast commercial:

detecting that a screen device is paired to the client media device by a personal area network;

identifying, using automatic content recognition, the commercial metadata from the corresponding broadcast commercial based on a video stream broadcast to the client media device;

identifying whether the available offers comprise one or more direct offers, the one or more direct offers having corresponding offer metadata matching a threshold amount of commercial metadata of the corresponding broadcast commercial;

based on whether the available offers comprise the one or more direct offers, selecting a first targeted offer, wherein selecting the targeted offer comprises;

responsive to identifying that the available offers comprise the one or more direct offers, using the identified commercial metadata and at least offer metadata for the one or more direct offers to select the first targeted offer from the one or more direct offers, wherein the offer metadata comprises one or more of brand and entity information, and

responsive to identifying that the available offers do not comprise the one or more direct offers, using the user metadata to select the targeted offer from the available offers, wherein the user metadata is different from the offer metadata for the one or more direct offers;

delivering the selected first targeted offer over the personal area network for display on the screen device such that, while the corresponding broadcast commercial is being streamed to and displayed by the client media device, the screen device displays the selected first targeted offer;

detecting selection of the displayed first targeted offer through the screen device; and

in response to detecting selection of the displayed first targeted offer through the screen device, facilitating transfer of a digital version of the first targeted offer to a virtual wallet accessible through the screen device.

18. The non-transitory computer readable medium of claim 17 , wherein using the identified commercial metadata and at least the offer metadata for the one or more direct offers to select the first targeted offer from the one or more direct offers comprises using the identified commercial metadata, the offer metadata for the one or more direct offers, and the user metadata to select the first targeted offer from the one or more direct offers.

19. The non-transitory computer readable medium of claim 17 , the set of acts further comprising:

determining that the first targeted offer has already been collected through the client media device; and

in response to determining that the first targeted offer has already been collected through the client media device, selecting a second targeted offer to deliver with the corresponding broadcast commercial to the client media device in lieu of the first targeted offer.

20. An offer computing system comprising:

a processor; and

a non-transitory computer readable medium having stored thereon instructions that, upon execution by the processor, cause performance of a set of acts comprising:

harvesting commercial metadata related to broadcast commercials broadcasted within an offer distribution network, each broadcast commercial comprising commercial metadata comprising at least two of:

an entity associated with the corresponding broadcast commercial;

a product or service associated with the corresponding broadcast commercial; or

a category associated with the corresponding broadcast commercial;

storing the harvested commercial metadata in a commercial metadata database;

harvesting offer metadata related to available offers generated by provider systems of the offer distribution network and available to deliver with the broadcast commercials;

storing the harvested offer metadata in an offer metadata database;

obtaining user metadata comprising interests of a user associated with a client media device; and

for each broadcast commercial:

detecting that a screen device is paired to the client media device by a personal area network;

identifying, using automatic content recognition, the commercial metadata from the corresponding broadcast commercial based on a video stream broadcast to the client media device;

identifying whether the available offers comprise one or more direct offers, the one or more direct offers having corresponding offer metadata matching a threshold amount of commercial metadata of the corresponding broadcast commercial;

based on whether the available offers comprise the one or more direct offers, selecting a first targeted offer, wherein selecting the targeted offer comprises;

responsive to identifying that the available offers comprise the one or more direct offers, using the identified commercial metadata and at least offer metadata for the one or more direct offers to select the first targeted offer from the one or more direct offers, wherein the offer metadata comprises one or more of brand and entity information, and

responsive to identifying that the available offers do not comprise the one or more direct offers, using the user metadata to select the targeted offer from the available offers, wherein the user metadata is different from the offer metadata for the one or more direct offers;

delivering the selected first targeted offer over the personal area network for display on the screen device such that, while the corresponding broadcast commercial is being streamed to and displayed by the client media device, the screen device displays the selected first targeted offer;

detecting selection of the displayed first targeted offer through the screen device; and

in response to detecting selection of the displayed first targeted offer through the screen device, facilitating transfer of a digital version of the first targeted offer to a virtual wallet accessible through the screen device.

21. The offer computing system of claim 20 , wherein the user metadata further comprises one or more of: (i) past purchases of the user, (ii) past interactions of the user with the first targeted offer or with similar offers, (iii) a wish list of the user for items of interest, (iv) profile information including gender, family type, and residence location, or (v) a geo-location of the client media device.

22. The offer computing system of claim 20 , wherein delivering the selected first targeted offer over the personal area network for display on the screen device comprises delivering the selected first targeted offer over the personal area network for display on the screen device as an overlay, inset, or pop-up advertisement to the corresponding broadcast commercial being streamed to the client media device.

Assignments (11)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: THE NIELSEN COMPANY (US), LLC
To: ROKU, INC.
Reel/Frame 056106/0376 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2019
From: SORENSON MEDIA, INC.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 048929/0577 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2019
From: EVANS, DAVID JOHN; GREENWAY, THOMAS; SPICER, MARTIN IAN
To: SORENSON MEDIA, INC.
Reel/Frame 048929/0518 →