IP Library Granted Patent US 8,863,165
Granted Patent B2
US 8,863,165 · App. 13/286,138 · Granted Oct 14, 2014

Method and system for presenting additional content at a media system

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,863,165
App. No.
13/286,138
Granted
Oct 14, 2014
Kind
B2
Abstract

A media system, receives a received sequence of media content, for presentation at the media system and generates a comparison fingerprint of the received sequence of media content. The comparison fingerprint is for comparison with a plurality of reference fingerprints so as to identify the received sequence of media content. The media system sends a request for identification of additional content to a server system. The request is based at least in part on the comparison fingerprint. The media system receives a response to the request, including information enabling additional content to be selected for display at the media system based at least in part on the identification of the received sequence of media content, and presents a displayed sequence of media content that includes at least a portion of the received sequence of media content and at least a portion of the additional content.

Claims (76)

1. A method for presenting a displayed sequence of media content, the method comprising:

at a media system having one or more processors and memory storing one or more programs for execution by the one or more processors so as to perform operations including:

receiving a received sequence of media content, for presentation at the media system;

receiving, from a server system, a set of reference fingerprints;

after receiving the set of reference fingerprints, generating a comparison fingerprint of the received sequence of media content, wherein the comparison fingerprint is for comparison with the set of reference fingerprints so as to identify the received sequence of media content;

after generating the comparison fingerprint, comparing the comparison fingerprint to respective reference fingerprints of the set of reference fingerprints;

sending a request for identification of additional content to the server system, wherein the request is based at least in part on the comparison fingerprint, wherein:

if a respective reference fingerprint of the set of reference fingerprints matches the comparison fingerprint, the request for identification of additional content includes data indicating that the comparison fingerprint matches the respective reference fingerprint; and

if the comparison fingerprint does not match any of the respective reference fingerprints of the set of reference fingerprints, the request for identification of additional content includes the comparison fingerprint, for comparison with additional reference fingerprints at the server system;

receiving a response to the request, the response including information enabling additional content to be selected for display at the media system, wherein the additional content is selected based at least in part on the identification of the received sequence of media content; and

presenting a displayed sequence of media content, wherein the displayed sequence of media content includes at least a portion of the received sequence of media content and at least a portion of the additional content, the presenting of the displayed sequence including:

interrupting the portion of the additional content by presenting a further sequence of media content in response to a first request received during the presenting of the portion of the additional content, the further sequence of media content being presented without presenting the additional content; and

resuming the portion of the additional content in response to a second request being received within a predefined time of the first request.

2. The method of claim 1 , wherein the information enabling additional content to be selected for display at the media system is information that uniquely identifies the additional content and enables the media system to retrieve the additional content.

3. The method of claim 1 , wherein the information enabling additional content to be selected for display at the media system includes the additional content.

4. The method of claim 1 , wherein:

the additional content is supplemental content; and

presenting the displayed sequence of media content includes displaying supplemental content that overlays at least a portion of the received sequence of media content.

5. The method of claim 1 , wherein:

the additional content is a replacement sequence of media content; and

presenting the displayed sequence of media content includes displaying the replacement sequence of media content instead of displaying at least a portion of the received sequence of media content.

6. The method of claim 1 , wherein:

the comparison fingerprint is also for comparison with the set of reference fingerprints so as to determine a reference position within the received sequence of media content; and

presenting the displayed sequence of media content includes presenting the additional content on the media system at a position within the received sequence of media content that is determined based at least in part on the reference position.

7. The method of claim 1 , wherein the set of reference fingerprints are generated prior to the broadcast of the received sequence of media content.

8. The method of claim 1 , wherein:

the received sequence of media content is an ongoing broadcast of media content;

there is a buffer time period between when respective units of the received sequence of media content are received at the media system and when the respective units are scheduled to be presented to the end-user of the media system; and

for a particular unit of the received sequence of media content:

a fingerprint of the particular unit is generated by the media system and sent to the server system after the particular unit has been received at the media system; and

the additional content is received before the particular unit is scheduled to be presented to the end-user of the media system.

9. The method of claim 1 , after receiving the response:

receiving one or more reference fingerprints for the received sequence of media content from the server system;

generating, at the media system, additional comparison fingerprints of units of the received sequence of media content; and

comparing a respective reference fingerprint to a comparison fingerprint of a corresponding unit of the received sequence of media content to determine whether the respective reference fingerprint matches the comparison fingerprint.

10. The method of claim 1 , wherein:

the received sequence of media content is a sequence of video content including video content requested by the end-user and advertisement video content; and

the additional content is a sequence of video content including one or more replacement advertisements.

11. The method of claim 1 , wherein the received sequence of media content is identified by identifying a channel and a timestamp for the received sequence of media content.

12. The method of claim 1 , wherein the set of reference fingerprints are selected based on usage data.

13. The method of claim 1 , wherein the presenting of the displayed sequence of media content comprises presenting the displayed sequence of media content to a user; and the request is further based at least in part on demographic information about the user.

14. The method of claim 1 , wherein the presenting of the displayed sequence of media content comprises presenting the displayed sequence of media content to a user; and the request is further based at least in part on behavioral information about the user.

15. The method of claim 1 , wherein the request is further based at least in part on technical limitations of the media system.

16. The method of claim 6 , wherein the reference position identifies a specific frame in the received sequence of media content.

17. The method of claim 8 , wherein the buffer time period is less than thirty seconds.

18. The method of claim 9 , further comprising, when the received sequence of media content has been changed to a second sequence of media content:

determining that the respective reference fingerprint does not match the comparison fingerprint for the corresponding unit of the second sequence of media content; and

in response to the determining, sending the comparison fingerprint to the server system for comparison with a plurality of reference fingerprints so as to identify the second sequence of media content and determine a reference position within the second sequence of media content.

19. A media system, comprising:

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for operations comprising:

receiving a received sequence of media content, for presentation at the media system;

receiving, from a server system, a set of reference fingerprints;

after receiving the set of reference fingerprints, generating a comparison fingerprint of the received sequence of media content, wherein the comparison fingerprint is for comparison with the set of reference fingerprints so as to identify the received sequence of media content;

matching the comparison fingerprint to a reference fingerprint of the set of reference fingerprints;

after generating the comparison fingerprint, comparing the comparison fingerprint to respective reference fingerprints of the set of reference fingerprints;

sending a request for identification of additional content to the server system, wherein the request is based at least in part on the comparison fingerprint, wherein:

if a respective reference fingerprint of the set of reference fingerprints matches the comparison fingerprint, the request for identification of additional content includes data indicating that the comparison fingerprint matches the respective reference fingerprint; and

if the comparison fingerprint does not match any of the respective reference fingerprints of the set of reference fingerprints, the request for identification of additional content includes the comparison fingerprint, for comparison with additional reference fingerprints at the server system;

receiving a response to the request, the response including information enabling additional content to be selected for display at the media system, wherein the additional content is selected based at least in part on the identification of the received sequence of media content; and

presenting a displayed sequence of media content, wherein the displayed sequence of media content includes at least a portion of the received sequence of media content and at least a portion of the additional content, the presenting of the displayed sequence including:

interrupting the portion of the additional content by presenting a further sequence of media content in response to a first request received during the presenting of the portion of the additional content, the further sequence of media content being presented without presenting the additional content; and

resuming the portion of the additional content in response to a second request being received within a predefined time of the first request.

20. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a media system with one or more processors, cause the media system to:

receive a received sequence of media content, for presentation at the media system;

receive, from a server system, a set of reference fingerprints;

after receiving the set of reference fingerprints, generate a comparison fingerprint of the received sequence of media content, wherein the comparison fingerprint is for comparison with the set of reference fingerprints so as to identify the received sequence of media content;

after generating the comparison fingerprint, compare the comparison fingerprint to respective reference fingerprints of the set of reference fingerprints;

send a request for identification of additional content to the server system, wherein the request is based at least in part on the comparison fingerprint, wherein:

if a respective reference fingerprint of the set of reference fingerprints matches the comparison fingerprint, the request for identification of additional content includes data indicating that the comparison fingerprint matches the respective reference fingerprint; and

if the comparison fingerprint does not match any of the respective reference fingerprints of the set of reference fingerprints, the request for identification of additional content includes the comparison fingerprint, for comparison with additional reference fingerprints at the server system;

receive a response to the request, the response including information enabling additional content to be selected for display at the media system, wherein the additional content is selected based at least in part on the identification of the received sequence of media content; and

present a displayed sequence of media content, wherein the displayed sequence of media content includes at least a portion of the received sequence of media content and at least a portion of the additional content, the presenting of the displayed sequence including:

interrupting the portion of the additional content by presenting a further sequence of media content in response to a first request received during the presenting of the portion of the additional content, the further sequence of media content being presented without presenting the additional content; and

resuming the portion of the additional content in response to a second request being received within a predefined time of the first request.

Assignments (16)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
RELEASE (REEL 042262 / FRAME 0601) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC
Reel/Frame 061748/0001 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Apr 13, 2017
From: GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE DIGITAL VENTURES, LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 042262/0601 →
RELEASE OF SECURITY INTEREST IN PATENT RIGHTS Recorded Feb 8, 2017
From: JPMORGAN CHASE BANK, N.A.
To: GRACENOTE, INC.; CASTTV INC.; TRIBUNE MEDIA SERVICES, LLC; TRIBUNE DIGITAL VENTURES, LLC
Reel/Frame 041656/0804 →
SECURITY AGREEMENT Recorded Nov 13, 2014
From: GRACENOTE, INC.; TRIBUNE BROADCASTING COMPANY, LLC; TRIBUNE DIGITAL VENTURES, LLC; TRIBUNE MEDIA COMPANY
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 034231/0333 →
SECURITY INTEREST Recorded Mar 19, 2014
From: GRACENOTE, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 032480/0272 →
CONFIRMATION Recorded Jul 17, 2012
From: BULLDOG UNITED LLC
To: GRACENOTE, INC.
Reel/Frame 028572/0401 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2012
From: GORDON, DONALD F.
To: BULLDOG UNITED LLC
Reel/Frame 028559/0686 →