IP Library Granted Patent US 10,965,991
Granted Patent B2
US 10,965,991 · App. 14/020,295 · Granted Mar 30, 2021

Displaying an actionable element over playing content

Inventors: Markus K. Cremer (Orinda, CA); Wilson Harron (Berkeley, CA)
Assignee: Gracenote, Inc.
H04N21/4722H04N21/4316H04N21/44008H04N21/44222H04N21/4532H04N21/4622H04N21/8133H04N21/8352
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,965,991
App. No.
14/020,295
Granted
Mar 30, 2021
Kind
B2
Abstract

Example methods and systems for displaying actionable elements over playing content, such as video content, are described. In some example embodiments, the methods and systems identify video content currently playing within a display environment provided by a playback device, and display an actionable element within the display environment provided by the playback device that is based on the identified video content and includes one or more user-selectable options to perform an action associated with the identified video content. Further, in some example embodiments, the methods and systems may perform an action (e.g., present supplemental content and/or information) in response to a selection of one or more of the user-selectable options.

Claims (51)

1. A method, comprising:

identifying video content currently playing within a display environment provided by a playback device;

determining a location within the display environment at which to display an actionable element, wherein determining the location comprises:

identifying, based on a fingerprint associated with the identified video content, an area within the display environment in which the playback device displays a navigation element native to the playback device, and

based on the identifying, selecting the identified area within the display environment as the location within the display environment at which to display the actionable element; and

in response to determining the location within the display environment at which to display the actionable element, displaying the actionable element at the determined location within the display environment, wherein the actionable element has a configuration that is based on a size of the identified area within the display environment, wherein the actionable element is based on the identified video content, and wherein the actionable element includes one or more user-selectable options to perform an action associated with the identified video content.

2. The method of claim 1 , wherein identifying video content currently playing within a display environment provided by a playback device includes identifying the video content by matching the fingerprint to one or more fingerprints associated with known video content.

3. The method of claim 1 , further comprising:

identifying different video content currently playing within the display environment provided by the playback device; and

modifying the displayed actionable element to include one or more user-selectable options to perform an action associated with the identified different video content.

4. The method of claim 1 , further comprising:

identifying different video content currently playing within the display environment provided by the playback device; and

modifying the configuration of the displayed actionable element to a configuration that is associated with the identified different video content.

5. The method of claim 1 , further comprising:

receiving a selection of one of the one or more user-selectable options of the actionable element; and

performing an action associated with the selected option.

6. The method of claim 1 , further comprising:

receiving a selection of one of the one or more user-selectable options of the actionable element that is associated with retrieving supplemental content from a web-based resource that is related to the video content currently playing via the playback device; and

presenting the supplemental content within the display environment.

7. The method of claim 1 , further comprising:

receiving a selection of one of the one or more user-selectable options of the actionable element that is associated with providing information about the video content currently playing via the playback device; and

presenting the information along with the video content within the display environment.

8. The method of claim 1 , wherein the displayed actionable element further includes one or more user-selectable buttons configured to facilitate navigation of content provided within the display environment.

9. The method of claim 1 , wherein a shape and a color of the actionable element are based on one or more characteristics of the currently displayed video content.

10. The method of claim 1 , wherein the navigation element native to the playback device is a channel bar.

11. The method of claim 10 , wherein the actionable element is a channel bar.

12. A system, comprising:

a content identification module, implemented by one or more hardware processors, that is configured to identify video content currently playing within a display environment provided by a playback device;

an element display module, implemented by the one or more hardware processors, that is configured to:

determine a location within the display environment at which to display an actionable element, wherein determining the location comprises:

identifying, based on a fingerprint associated with the identified video content, an area within the display environment in which the playback device displays a navigation element native to the playback device; and

based on the identifying, selecting the identified area within the display environment as the location within the display environment at which to display the actionable element, and

in response to determining the location within the display environment at which to display the actionable element, display the actionable element at the determined location within the display environment, wherein the actionable element has a configuration that is based on a size of the identified area within the display environment, wherein the actionable element is based on the identified video content, and wherein the actionable element includes one or more user-selectable options to perform an action associated with the identified video content; and

an action module, implemented by the one or more hardware processors, that is configured to receive a selection of one of the one or more user-selectable options of the actionable element and perform an action associated with the selected option.

13. The system of claim 12 , wherein the configuration is further based on one or more characteristics of the identified video content comprising a low contrast between pixels of the video content.

14. The system of claim 12 , wherein a shape and a color of the actionable element are based on one or more characteristics of the currently displayed video content.

15. A non-transitory computer-readable storage medium including instructions, that when executed by a computing system, cause the computing system to perform operations comprising:

identifying video content currently playing within a display environment provided by a playback device;

determining a location within the display environment at which to display an actionable element, wherein determining the location comprises:

identifying, based on a fingerprint associated with the identified video content, an area within the display environment in which the playback device displays a navigation element native to the playback device, and

based on the identifying, selecting the identified area within the display environment as the location within the display environment at which to display the actionable element; and

in response to determining the location within the display environment at which to display the actionable element, displaying the actionable element at the determined location within the display environment, wherein the actionable element has a configuration that is based on a size of the identified area within the display environment, wherein the actionable element is based on the identified video content, and wherein the actionable element includes one or more user-selectable options to perform an action associated with the identified video content.

16. The computer-readable storage medium of claim 15 , wherein identifying video content currently playing within a display environment provided by a playback device includes identifying the video content by matching the fingerprint associated with the video content to one or more fingerprints associated with known video content.

17. The computer-readable storage medium of claim 15 , wherein the action associated with the selected option includes presenting supplemental video content having metadata that is similar to metadata for the video content currently playing within the display environment.

18. The computer-readable storage medium of claim 15 , wherein the action associated with the selected option includes presenting informational content having metadata that is similar to metadata for the video content currently playing within the display environment.

19. The computer-readable storage medium of claim 15 :

wherein the video content currently playing within the display environment is a television show and the playback device is a television; and

wherein the action associated with the selected option includes presenting video content retrieved from a web-based resource that is associated with the television show.

20. The computer-readable storage medium of claim 15 :

wherein the video content currently playing within the display environment is associated with a live sports event and the playback device is a television; and

wherein the action associated with the selected option includes presenting statistical information related to the live sports event.

Assignments (14)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
RELEASE (REEL 042262 / FRAME 0601) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC
Reel/Frame 061748/0001 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Apr 13, 2017
From: GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE DIGITAL VENTURES, LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 042262/0601 →
RELEASE OF SECURITY INTEREST IN PATENT RIGHTS Recorded Feb 8, 2017
From: JPMORGAN CHASE BANK, N.A.
To: GRACENOTE, INC.; CASTTV INC.; TRIBUNE MEDIA SERVICES, LLC; TRIBUNE DIGITAL VENTURES, LLC
Reel/Frame 041656/0804 →
SECURITY INTEREST Recorded Mar 19, 2014
From: GRACENOTE, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 032480/0272 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 25, 2013
From: CREMER, MARKUS K; HARRON, WILSON
To: GRACENOTE, INC.
Reel/Frame 031481/0942 →