IP Library Granted Patent US 9,992,533
Granted Patent B2
US 9,992,533 · App. 15/442,114 · Granted Jun 5, 2018

Media channel identification and action with multi-match detection and disambiguation based on matching with differential reference—fingerprint feature

Inventors: Jaehyung Lee (Seoul, KR); Dewey Ho Lee (Emeryville, CA); Markus Cremer (Emeryville, CA)
Assignee: Gracenote, Inc.
H04N21/44008H04N21/2353H04N21/23418H04N21/2407H04N21/25841H04N21/431H04N21/435H04N21/4383H04N21/44204H04N21/44222H04N21/4756H04N21/6118H04N21/6543H04N21/812H04N21/8358H04N21/84H04N21/8456
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,992,533
App. No.
15/442,114
Granted
Jun 5, 2018
Kind
B2
Abstract

A computing system compares various reference fingerprints each representing a reference media stream broadcast on a different respective known channel, and the computing system determines that a plurality of the reference fingerprints match each other, thus defining a multi-match group of the matching reference fingerprints. In response, the computing system identifies a fingerprint feature that could define a distinction between the reference fingerprints, and the computing system resolves the multi-match based on the identified feature, thereby determining the channel carrying the media stream being rendered by the media presentation device. And the server then takes channel-specific action based on the determined channel.

Claims (29)

1. A method comprising:

determining, by a computing system, that a query fingerprint of media content being rendered by a media presentation device matches multiple reference fingerprints each corresponding with a different respective channel than each other;

responsive to at least determining that the query fingerprint matches the multiple reference fingerprints each corresponding with a different respective channel, performing disambiguation by (i) identifying a fingerprint feature that differs as between the multiple reference fingerprints and (ii) determining that the query fingerprint matches just one of the reference fingerprints as to the identified fingerprint feature, whereby the disambiguation establishes that the media presentation device is receiving the media content on the channel corresponding with the one reference fingerprint; and

taking action based on the establishing that the media presentation device is receiving the media content on the channel corresponding with the one reference fingerprint,

wherein the computing system includes or has access to channel-data that indicates for the channels corresponding with the multiple reference fingerprints a region of media content that is channel specific, and wherein identifying the fingerprint feature that differs as between the multiple reference fingerprints comprises (i) referring to the data to determine the region of media content that is channel specific and (ii) identifying as the fingerprint feature that differs as between the multiple reference fingerprints a fingerprint feature corresponding with the determined region of media content, and

wherein the media content comprises video content, and wherein the region of media content that is channel specific comprises a video frame region that is at least one of (i) at a video frame edge or (ii) where channel identification is presented.

2. The method of claim 1 , wherein taking action based on the establishing that the media presentation device is receiving the media content on the channel corresponding with the one reference fingerprint comprises causing supplemental channel-specific content to be presented by the media presentation device in conjunction with the media content being rendered by the media presentation device.

3. The method of claim 1 , wherein taking action based on the establishing that the media presentation device is receiving the media content on the channel corresponding with the one reference fingerprint comprises recording presentation of the single channel for use in a channel ratings system.

4. The method of claim 1 , wherein the computing system is an entity other than the media presentation device, and wherein the query fingerprint is generated by the media presentation device, the method further comprising the computing system receiving the query fingerprint from the media presentation device.

5. The method of claim 1 , wherein the multiple reference fingerprints are selected from a plurality of reference fingerprints in reference data, and wherein determining that the query fingerprint of the media content being rendered by the media presentation device matches the multiple reference fingerprints comprises:

comparing the query fingerprint with the plurality of reference fingerprints in the reference data, and

based on the comparing, determining that the query fingerprint matches the multiple reference fingerprints.

6. The method of claim 1 , carried out at least in part by the media presentation device.

7. A system comprising:

a network communication interface;

a processing unit;

non-transitory data storage; and

program instructions stored in the non-transitory data storage and executable by the processing unit to carry out operations including:

receiving from a media presentation device, via the network communication interface, a query fingerprint of media content being rendered by the media presentation device,

determining that the received fingerprint matches multiple reference fingerprints each corresponding with a different respective channel,

responsive to at least determining that the received fingerprint matches the multiple reference fingerprints each corresponding with a different respective channel, performing disambiguation by (i) identifying a fingerprint feature that differs as between the multiple reference fingerprints and (ii) determining that the query fingerprint matches just one of the reference fingerprints as to the identified fingerprint feature, whereby the disambiguation establishes that the media presentation device is receiving the media content on the channel corresponding with the one reference fingerprint, and

taking action based on the establishing that the single channel carries the media content being rendered by the media presentation device,

wherein the system includes or has access to channel-data that indicates for the channels corresponding with the multiple reference fingerprints a region of media content that is channel specific, and wherein identifying the fingerprint feature that differs as between the multiple reference fingerprints comprises (i) referring to the data to determine the region of media content that is channel specific and (ii) identifying as the fingerprint feature that differs as between the multiple reference fingerprints a fingerprint feature corresponding with the determined region of media content, and

wherein the media content comprises video content, and wherein the region of media content that is channel specific comprises a video frame region that is at least one of (i) at a video frame edge or (ii) where channel identification is presented.

8. The system of claim 7 , wherein taking action based on the establishing that the single channel carries the media content being rendered by the media presentation device comprises causing supplemental channel-specific content to be presented by the media presentation device in conjunction with the media content being rendered by the media presentation device.

9. The system of claim 7 , wherein taking action based on the establishing that the single channel carries the media content being rendered by the media presentation device comprises recording presentation of the single channel for use in a channel ratings system.

10. The system of claim 7 , wherein the multiple reference fingerprints are selected from a plurality of reference fingerprints in reference data, and wherein determining that the received fingerprint of the media content being rendered by the media presentation device matches the multiple reference fingerprints comprises:

comparing the query fingerprint with the plurality of reference fingerprints in the reference data, and

based on the comparing, determining that the query fingerprint matches the multiple reference fingerprints.

Assignments (10)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 24, 2017
From: LEE, JAEHYUNG; LEE, DEWEY HO; CREMER, MARKUS
To: GRACENOTE, INC.
Reel/Frame 041373/0823 →
Continuity (2)
Provisional Application 62301616 · Feb 29, 2016
Related Publication 20170251250A1 · Aug 31, 2017