IP Library Granted Patent US 10,462,514
Granted Patent B2
US 10,462,514 · App. 15/938,049 · Granted Oct 29, 2019

Interactive overlays to determine viewer data

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,462,514
App. No.
15/938,049
Granted
Oct 29, 2019
Kind
B2
Abstract

The disclosure provides a method for determining viewer data from interactive overlays. The method includes receiving media content from a content feed. The media device includes a unique identifier (UID). The method also includes determining a media program associated with the received media content based on a fingerprint of the received media content. The method further includes overlaying interactive overlay content onto the media program of the media content in an overlay area. The overlay area corresponds to a spatial position within at least one frame of the media content. The method also includes receiving a feedback response from a viewer based on the interactive overlay content. The method further includes determining viewer information from the feedback response of the viewer. The method further includes associating the viewer information of the feedback response with the UID of the media device.

Claims (58)

1. A method comprising:

receiving, at data processing hardware of a media device, media content from a content feed, the media device comprising a unique identifier (UID);

determining, by the data processing hardware of the media device, a media program associated with the received media content based on a fingerprint of the received media content; and

while the media program is being displayed by the media device:

overlaying, by the data processing hardware of the media device, interactive overlay content onto the media program of the media content in an overlay area, the overlay area corresponding to a spatial position within at least one frame of the media content;

overlaying, by the data processing hardware of the media device, first overlay content onto the media program of the media content, wherein the first overlay content is associated with a first viewer characteristic;

receiving, at the data processing hardware of the media device, a feedback response from a viewer based on the interactive overlay content;

determining, by the data processing hardware of the media device, viewer information from the feedback response of the viewer;

associating, by the data processing hardware of the media device, the viewer information of the feedback response with the UID of the media device;

determining, by the data processing hardware of the media device, that the viewer information associated with the UID of the media device indicates a second viewer characteristic that is different from the first viewer characteristic; and

in response to determining that the viewer information indicates the second viewer characteristic that is different from the first viewer characteristic, dynamically switching, by the data processing hardware of the media device, from overlaying the first overlay content onto the media program to instead overlaying, onto the media program, second overlay content that is associated with the second viewer characteristic.

2. The method of claim 1 , wherein the interactive overlay content is based on the fingerprint of the received media content.

3. The method of claim 1 , wherein the interactive overlay content is randomly selected from an interactive overlay content database in communication with the data processing hardware of the media device.

4. The method of claim 1 , wherein the interactive overlay content comprises a prompt for viewer information, the prompt comprises at least one of a quiz, a questionnaire, a survey, or a feedback form.

5. The method of claim 1 , wherein the interactive overlay content is based on prior viewer information associated with the UID of the media device, the method further comprising updating, at the data processing hardware of the media device, the viewer information associated with the UID based on the feedback response of the overlaid interactive overlay content.

6. The method of claim 1 further comprising overlaying, by the data processing hardware of the media device, a targeted overlay onto the media content, the targeted overlay based on the viewer information associated with the UID of the media device.

7. The method of claim 1 , wherein the interactive overlay content is based on the determined media program corresponding to the fingerprint of the received media content.

8. The method of claim 1 , wherein determining the media program further comprises:

generating, by the data processing hardware of the media device, the fingerprint based on at least one frame of the media content, the generated fingerprint comprising channel information and time codes from the at least one frame; and

identifying, by the data processing hardware of the media device, the media program based on the channel information and the time codes of the generated fingerprint.

9. The method of claim 1 , wherein associating the viewer information of the feedback response with the UID of the media device further comprises associating the determined media program with the UID of the media device.

10. The method of claim 1 further comprising generating, by the data processing hardware of the media device, a report based on the viewer information, the report configured to identify more than one viewer at the media device based on the viewer information associated with the UID of the media device.

11. A system comprising:

a media device comprising a unique identifier (UID);

data processing hardware located at the media device; and

memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:

receiving media content from a content feed;

determining a media program associated with the received media content based on a fingerprint of the received media content; and

while the media program is being displayed by the media device:

overlaying interactive overlay content onto the media program of the media content in an overlay area, the overlay area corresponding to a spatial position within at least one frame of the media content;

overlaying first overlay content onto the media program of the media content, wherein the first overlay content is associated with a first viewer characteristic;

receiving a feedback response from a viewer based on the interactive overlay content;

determining viewer information from the feedback response of the viewer;

associating the viewer information of the feedback response with the UID of the media device;

determining that the viewer information associated with the UID of the media device indicates a second viewer characteristic that is different from the first viewer characteristic; and

in response to determining that the viewer information indicates the second viewer characteristic that is different from the first viewer characteristic, dynamically switching from overlaying the first overlay content onto the media program to instead overlaying, onto the media program, second overlay content that is associated with the second viewer characteristic.

12. The system of claim 11 , wherein the interactive overlay content is based on the fingerprint of the received media content.

13. The system of claim 11 , wherein the interactive overlay content is randomly selected from an interactive overlay content database in communication with the data processing hardware of the media device.

14. The system of claim 11 , wherein the interactive overlay content comprises a prompt for viewer information, the prompt comprises at least one of a quiz, a questionnaire, a survey, or a feedback form.

15. The system of claim 11 , wherein the interactive overlay content is based on prior viewer information associated with the UID of the media device and the operations further comprise updating the viewer information associated with the UID based on the feedback response of the overlaid interactive overlay content.

16. The system of claim 11 , wherein the operations further comprise overlaying a targeted overlay onto the media content, the targeted overlay based on the viewer information associated with the UID of the media device.

17. The system of claim 11 , wherein the interactive overlay content is based on the determined media program corresponding to the fingerprint of the received media content.

18. The system of claim 11 , wherein determining the media program further comprises:

generating the fingerprint based on at least one frame of the media content, the generated fingerprint comprising channel information and time codes from the at least one frame; and

identifying the media program based on the channel information and the time codes of the generated fingerprint.

19. The system of claim 11 , wherein associating the viewer information of the feedback response with the UID of the media device further comprises associating the determined media program with the UID of the media device.

20. The system of claim 11 , wherein the operations further comprise generating a report based on the viewer information, the report configured to identify more than one viewer at the media device based on the viewer information associated with the UID of the media device.

21. A non-transitory computer readable medium having stored thereon instructions that, upon execution by a processor, cause performance of a set of acts comprising:

receiving media content from a content feed;

determining a media program associated with the received media content based on a fingerprint of the received media content; and

while the media program is being displayed by a media device:

overlaying interactive overlay content onto the media program of the media content in an overlay area, the overlay area corresponding to a spatial position within at least one frame of the media content;

overlaying first overlay content onto the media program of the media content, wherein the first overlay content is associated with a first viewer characteristic;

receiving a feedback response from a viewer based on the interactive overlay content;

determining viewer information from the feedback response of the viewer;

associating the viewer information of the feedback response with a unique identifier (UID) of the media device;

determining that the viewer information associated with the UID of the media device indicates a second viewer characteristic that is different from the first viewer characteristic; and

in response to determining that the viewer information associated with the UID of the media device indicates the second viewer characteristic that is different from the first viewer characteristic, dynamically switching from overlaying the first overlay content onto the media program to instead overlaying, onto the media program, second overlay content that is associated with the second viewer characteristic.

Assignments (11)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: THE NIELSEN COMPANY (US), LLC
To: ROKU, INC.
Reel/Frame 056106/0376 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 15, 2019
From: SORENSON MEDIA, INC.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 048355/0949 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2018
From: GROVER, MATTHEW
To: SORENSON MEDIA, INC.
Reel/Frame 046034/0763 →