IP Library Granted Patent US 10,965,992
Granted Patent B2
US 10,965,992 · App. 16/178,116 · Granted Mar 30, 2021

Displaying an actionable element over playing content

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,965,992
App. No.
16/178,116
Granted
Mar 30, 2021
Kind
B2
Abstract

Example methods and systems for displaying actionable elements over playing content, such as video content, are described. In some example embodiments, the methods and systems identify video content currently playing within a display environment provided by a playback device, and display an actionable element within the display environment provided by the playback device that is based on the identified video content and includes one or more user-selectable options to perform an action associated with the identified video content. Further, in some example embodiments, the methods and systems may perform an action (e.g., present supplemental content and/or information) in response to a selection of one or more of the user-selectable options.

Claims (39)

1. A method, comprising:

receiving, at data processing hardware of a media device, media content from a content feed;

displaying, by the data processing hardware of the media device, the media content from the content feed within a display environment provided by the media device;

fingerprinting, by the data processing hardware of the media device, at least one frame of the media content to obtain a query fingerprint;

determining, by the data processing hardware of the media device, a target overlay location within the display environment at which to display overlay content over the media content, wherein determining the target overlay location comprises:

identifying an area within the display environment using the query fingerprint, and

based on the identifying, selecting the identified area within the display environment as the target overlay location at which to display the overlay content; and

in response to determining the target overlay location at which to display the overlay content, displaying, by the data processing hardware of the media device, the overlay content at the target overlay location and over the media content.

2. The method of claim 1 , wherein displaying the overlay content comprises rendering the overlay content with a size that is based on characteristics of the media content.

3. The method of claim 1 , further comprising identifying the media content, wherein the overlay content is based on the identified media content.

4. The method of claim 1 , wherein the overlay content includes a targeted advertisement selected for the media device based on context.

5. The method of claim 1 , wherein the overlay content includes a user-selectable option that is selectable by way of an input device associated with the media device.

6. The method of claim 1 , wherein receiving the media content from the content feed comprises receiving the media content from a content provider over a network.

7. A non-transitory computer-readable medium having stored thereon program instructions that upon execution by a processor, cause performance of a set of acts comprising:

receiving media content from a content feed;

displaying the media content from the content feed within a display environment provided by a media device;

fingerprinting at least one frame of the media content to obtain a query fingerprint;

determining a target overlay location within the display environment at which to display overlay content over the media content, wherein determining the target overlay location comprises:

identifying an area within the display environment using the query fingerprint, and

based on the identifying, selecting the identified area within the display environment as the target overlay location at which to display the overlay content; and

in response to determining the target overlay location at which to display the overlay content, displaying the overlay content at the target overlay location and over the media content.

8. The non-transitory computer-readable medium of claim 7 , wherein displaying the overlay content comprises rendering the overlay content with a size that is based on characteristics of the media content.

9. The non-transitory computer-readable medium of claim 7 , wherein the set of acts further comprises identifying the media content, and wherein the overlay content is based on the identified media content.

10. The non-transitory computer-readable medium of claim 7 , wherein the overlay content includes a targeted advertisement selected for the media device based on context.

11. The non-transitory computer-readable medium of claim 7 , wherein the overlay content includes a user-selectable option that is selectable by way of an input device associated with the media device.

12. A computing system comprising:

one or more processors; and

a non-transitory computer-readable medium having stored therein instructions that are executable to cause the computing system to perform a set of acts comprising:

receiving media content from a content feed,

displaying the media content from the content feed within a display environment provided by a media device,

fingerprinting at least one frame of the media content to obtain a query fingerprint,

determining a target overlay location within the display environment at which to display overlay content over the media content, wherein determining the target overlay location comprises:

identifying an area within the display environment using the query fingerprint; and

based on the identifying, selecting the identified area within the display environment as the target overlay location at which to display the overlay content, and

in response to determining the target overlay location at which to display the overlay content, displaying the overlay content at the target overlay location and over the media content.

13. The computing system of claim 12 , wherein displaying the overlay content comprises rendering the overlay content with a size that is based on characteristics of the media content.

14. The computing system of claim 12 , wherein the set of acts further comprises identifying the media content, and wherein the overlay content is based on the identified media content.

15. The computing system of claim 12 , wherein the overlay content includes a targeted advertisement selected for the media device based on context.

16. The computing system of claim 12 , wherein the overlay content includes a user-selectable option that is selectable by way of an input device associated with the media device.

Assignments (10)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2018
From: CREMER, MARKUS K.; HARRON, WILSON
To: GRACENOTE, INC.
Reel/Frame 047387/0131 →