IP Library Granted Patent US 10,182,263
Granted Patent B2
US 10,182,263 · App. 15/934,753 · Granted Jan 15, 2019

Enabling interactive control of live television broadcast streams

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,182,263
App. No.
15/934,753
Granted
Jan 15, 2019
Kind
B2
Abstract

The disclosure provides a method for interactive control of live television broadcast streams. The method includes receiving a streaming live media feed from a television broadcaster and displaying an overlay on media content of the streaming live media feed. The overlay includes a play control option unassociated with an intermediary feed source of the live media feed between the television broadcaster and the media device. The method further includes receiving a first selection input of the play control option and determining that the selection input corresponds to a play mode at a first location within the media content of the streaming live media feed by determining that a first fingerprint fails to match a second fingerprint. Furthermore, the method includes overlaying targeted overlay content on the streaming live media feed.

Claims (54)

1. A method comprising:

receiving, at data processing hardware of a media device, a streaming live media feed from a television broadcaster, the streaming live media feed comprising media content;

displaying, by the data processing hardware of the media device, an overlay on the media content of the streaming live media feed, the overlay comprising a play control option, the play control option unassociated with an intermediary feed source of the live media feed between the television broadcaster and the media device, the play control option configured to control a play mode of the media device for playing the streaming live media feed;

receiving, at the data processing hardware of the media device, a first selection input of the play control option of the overlay;

determining, by the data processing hardware of the media device, that the selection input of the play control option corresponds to a fast-forward play mode or a rewind play mode at a first location within the media content of the streaming live media feed;

receiving, at the data processing hardware of the media device, a second selection input;

determining, by the data processing hardware of the media device, a second location within the media content of the streaming live media feed corresponding to the second selection input based on a first fingerprint of at least one first frame of the media content of the streaming live media feed at the second location;

determining, by the data processing hardware at the media device, that the first fingerprint at the second location fails to match a second fingerprint of at least one second frame of the media content at the first location; and

overlaying, by the data processing hardware of the media device, targeted overlay content on the streaming live media feed, the target overlay content contextually relevant to the media content at the second location within the media content of the streaming live media feed.

2. The method of claim 1 further comprising determining, by the data processing hardware of the media device, the contextually relevant to the media content at the second location within the media content of the streaming live media feed based a user profile.

3. The method of claim 1 , wherein the intermediary feed source of the streaming live media feed is one of aerial, satellite, internet-enabled, or set top box.

4. The method of claim 1 , wherein the second selection input is subsequent in time to the first selection input.

5. The method of claim 1 , further comprising buffering, by the data processing hardware of the media device, the media content for a period of time, the period of time having a duration between the first selection input of the play control option and the second selection input of the play control option.

6. The method of claim 1 , wherein determining each of the first location and the second location comprises:

receiving, at the data processing hardware of the media device, a query fingerprint corresponding to media content from a content feed at the media device, the query fingerprint representing sequential frames of the media content from the content feed and comprising a time stamp corresponding to a temporal position within the content feed; and

determining, by the data processing hardware of the media device, that the query fingerprint matches at least one frame fingerprint of a plurality of frame fingerprints of the streaming live media feed provided by the television broadcaster, the matched at least one frame fingerprint associated with a respective channel of the television broadcaster, a respective media program within the respective channel, and a respective location within the respective media program of the respective channel.

7. The method of claim 1 , wherein determining each of the first location and the second location comprises:

receiving, at the data processing hardware of the media device, a query fingerprint corresponding to media content from a content feed at the media device, the query fingerprint representing sequential frames of the media content from the content feed and comprising a time stamp corresponding to a temporal position within the content feed;

determining, by the data processing hardware of the media device, that the query fingerprint matches at least one frame fingerprint of a plurality of frame fingerprints of the media content provided by the television broadcaster, the matched at least one frame fingerprint associated with a respective channel of the television broadcaster; and

based on the time stamp of the query fingerprint and scheduling data for the respective channel, determining, by the data processing hardware of the media device, that the query fingerprint corresponds to a respective location within a media program of the live media feed from the television broadcaster.

8. The method of claim 1 , further comprising communicating, from the data processing hardware of the media device, at least one of the first location or the second location to an advertisement targeter, the advertisement targeter configured to identify overlay content for a viewer of the streaming live media feed based on viewing habits of the viewer.

9. The method of claim 1 , further comprising communicating, from the data processing hardware of the media device, an identifier of a media program associated with the first location as viewing history to an advertisement targeter, the advertisement targeter configured to:

identify overlay content for a viewer of the streaming live media feed based on the viewing history; and

communicate the identified overlay content to the media device.

10. The method of claim 1 , wherein the overlay comprises a hypertext markup language browser (HTML).

11. A system comprising:

a media device;

data processing hardware located at the media device; and

memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:

receiving a streaming live media feed from a television broadcaster, the streaming live media feed comprising media content;

displaying an overlay on the media content of the streaming live media feed, the overlay comprising a play control option, the play control option unassociated with an intermediary feed source of the live media feed between the television broadcaster and the media device, the play control option configured to control a play mode of the media device for playing the streaming live media feed;

receiving a first selection input of the play control option of the overlay;

determining that the selection input of the play control option corresponds to a fast-forward play mode or a rewind play mode at a first location within the media content of the streaming live media feed;

receiving a second selection input;

determining a second location within the media content of the streaming live media feed corresponding to the second selection input based on a first fingerprint of at least one first frame of the media content of the streaming live media feed at the second location;

determining that the first fingerprint at the second location fails to match a second fingerprint of at least one second frame of the media content at the first location; and

overlaying targeted overlay content on the streaming live media feed, the target overlay content contextually relevant to the media content at the second location within the media content of the streaming live media feed.

12. The system of claim 11 , wherein the operations further comprise determining the contextually relevant to the media content at the second location within the media content of the streaming live media feed based a user profile.

13. The system of claim 11 , wherein the intermediary feed source of the streaming live media feed is one of aerial, satellite, internet-enabled, or set top box.

14. The system of claim 11 , wherein the second selection input is subsequent in time to the first selection input.

15. The system of claim 11 , wherein the operations further comprise buffering the media content for a period of time, the period of time having a duration between the first selection input of the play control option and the second selection input of the play control option.

16. The system of claim 11 , wherein the operation of determining each of the first location and the second location further comprises:

receiving a query fingerprint corresponding to media content from a content feed at the media device, the query fingerprint representing sequential frames of the media content from the content feed and comprising a time stamp corresponding to a temporal position within the content feed; and

determining that the query fingerprint matches at least one frame fingerprint of a plurality of frame fingerprints of the streaming live media feed provided by the television broadcaster, the matched at least one frame fingerprint associated with a respective channel of the television broadcaster, a respective media program within the respective channel, and a respective location within the respective media program of the respective channel.

17. The system of claim 11 , wherein the operation of determining each of the first location and the second location further comprises:

receiving a query fingerprint corresponding to media content from a content feed at the media device, the query fingerprint representing sequential frames of the media content from the content feed and comprising a time stamp corresponding to a temporal position within the content feed;

determining that the query fingerprint matches at least one frame fingerprint of a plurality of frame fingerprints of the media content provided by the television broadcaster, the matched at least one frame fingerprint associated with a respective channel of the television broadcaster; and

based on the time stamp of the query fingerprint and scheduling data for the respective channel, determining that the query fingerprint corresponds to a respective location within a media program of the live media feed from the television broadcaster.

18. The system of claim 11 , wherein the operations further comprise communicating at least one of the first location or the second location to an advertisement targeter, the advertisement targeter configured to identify overlay content for a viewer of the streaming live media feed based on viewing habits of the viewer.

19. The system of claim 11 , wherein the operations further comprise:

communicating an identifier of a media program associated with the first location as viewing history to an advertisement targeter, the advertisement targeter configured to:

identify overlay content for a viewer of the streaming live media feed based on the viewing history; and

communicate the identified overlay content to the media device.

20. The system of claim 11 , wherein the overlay comprises a hypertext markup language (HTML) browser.

Assignments (11)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: GRACENOTE, INC.; A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: THE NIELSEN COMPANY (US), LLC
To: ROKU, INC.
Reel/Frame 056106/0376 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 15, 2019
From: SORENSON MEDIA, INC.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 048355/0949 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 18, 2018
From: GROVER, MATTHEW
To: SORENSON MEDIA, INC.
Reel/Frame 046894/0196 →