IP Library Granted Patent US 10,523,999
Granted Patent B2
US 10,523,999 · App. 15/982,437 · Granted Dec 31, 2019

Media channel identification and action with multi-match detection and disambiguation based on matching with differential reference-fingerprint feature

Inventors: Jaehyung Lee (Seoul, KR); Dewey Ho Lee (Berkeley, CA); Markus Cremer (Orinda, CA)
Assignee: Gracenote, Inc.
H04N21/44008H04N21/2353H04N21/23418H04N21/2407H04N21/25841H04N21/431H04N21/435H04N21/4383H04N21/44204H04N21/44222H04N21/4756H04N21/6118H04N21/6543H04N21/812H04N21/8358H04N21/84H04N21/8456
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,523,999
App. No.
15/982,437
Granted
Dec 31, 2019
Kind
B2
Abstract

A computing system compares various reference fingerprints each representing a reference media stream broadcast on a different respective known channel, and the computing system determines that a plurality of the reference fingerprints match each other, thus defining a multi-match group of the matching reference fingerprints. In response, the computing system identifies a fingerprint feature that could define a distinction between the reference fingerprints, and the computing system resolves the multi-match based on the identified feature, thereby determining the channel carrying the media stream being rendered by the media presentation device. And the server then takes channel-specific action based on the determined channel.

Claims (43)

1. A media presentation device comprising:

a media input interface through which to receive video content to be presented by the media presentation device, wherein the video content includes video frames having video frame regions, the video frame regions comprising a center, an edge, and a corner;

a media presentation interface for presenting the received video content;

a network communication interface;

a processing unit;

non-transitory data storage; and

program instructions stored in the non-transitory data storage and executable by the processing unit to carry out operations comprising:

generating a first query fingerprint of the video content based on analysis of the video content, and outputting the generated first query fingerprint for transmission through the network communication interface to a server,

receiving from the server, in response to the first query fingerprint, a request for a second query fingerprint specifically focused on an identified video frame region of the video frame regions of the video content, wherein the server determines that the first query fingerprint matches multiple reference fingerprints corresponding with multiple channels and, in response to the determining, identifies the video frame region, the identifying being based on the video frame region defining a difference between the channels corresponding with the multiple reference fingerprints,

outputting, for transmission through the network communication interface to the server, the requested second query fingerprint specifically focused on the identified video frame region of the video content, and

causing the media presentation device to present, in conjunction with the video content that the media presentation device is presenting, supplemental channel-specific content associated with one of the multiple channels, wherein the server identifies the one channel by determining that the second query fingerprint matches a reference fingerprint of the video frame region of just the one channel of the multiple channels, and wherein the media presentation device receives from the server the supplemental channel-specific content for the media presentation device to present in conjunction with the video content that the media presentation device is presenting.

2. The media presentation device of claim 1 , wherein the supplemental channel-specific content comprises at least one of a pop-up advertisement, a commercial break, or a channel-identification.

3. The media presentation device of claim 1 , wherein the supplemental channel-specific content is a replacement for one or more portions of the video content.

4. The media presentation device of claim 1 , wherein the supplemental channel-specific content is additionally based on profile data associated with the media presentation device.

5. The media presentation device of claim 4 , wherein the profile data comprises device-specific viewing analytics.

6. The media presentation device of claim 1 , wherein the identified video frame region is at least one of (i) at a video frame edge or (ii) where channel identification is presented.

7. A method comprising:

generating by a media presentation device a first query fingerprint of video content that the media presentation device is presenting, wherein the video content includes video frames having video frame regions, the video frame regions comprising a center, an edge, and a corner, and wherein the generating of the first query fingerprint is based on analysis by the media presentation device of the video content;

outputting the generated first query fingerprint for transmission over a network to a server;

receiving from the server, in response to the first query fingerprint, a request for a second query fingerprint specifically focused on an identified video frame region of the video frame regions of the of the video content, wherein the server determines that the first query fingerprint matches multiple reference fingerprints corresponding with multiple channels and, in response to the determining, identifies the video frame region, the identifying being based on the video frame region defining a difference between the channels corresponding with the multiple reference fingerprints;

responsive to the request, generating by the media presentation device the second query fingerprint specifically focused on the identified video frame region of the video content and outputting the second query fingerprint for transmission over the network to the server;

receiving by the media presentation device, from the server, supplemental channel-specific content associated with one of the multiple channels, wherein the one channel is identified by the server based on the second query fingerprint matching a reference fingerprint of the video frame region of just the one channel of the multiple channels; and

presenting by the media presentation device, in conjunction with the video content that the media presentation device is presenting, the received supplemental channel-specific media content.

8. The method of claim 7 , wherein the supplemental channel-specific content comprises at least one of a pop-up advertisement, a commercial break, or a channel-identification.

9. The method of claim 7 , wherein the supplemental channel-specific content is a replacement for one or more portions of the video content.

10. The method of claim 7 , wherein the supplemental channel-specific content is additionally based on profile data associated with the media presentation device.

11. The method of claim 10 , wherein the profile data comprises device-specific viewing analytics.

12. The method of claim 7 , wherein the identified video frame region is at least one of (i) at a video frame edge or (ii) where channel identification is presented.

13. The method of claim 7 , wherein the identified video frame region is indicated by channel-data accessible to the server.

14. A method comprising:

receiving by a computing system from a media presentation device a first query fingerprint of video content being rendered by the media presentation device, wherein the video content includes video frames having video frame regions, the video frame regions comprising a center, an edge, and a corner;

determining by the computing system that the first query fingerprint matches multiple reference fingerprints corresponding with multiple channels;

responsive to at least determining that the first query fingerprint matches the multiple reference fingerprints corresponding with the multiple channels, the computing system performing disambiguation by (i) identifying a video frame region, of the video frame regions of the video content, that defines a difference between the channels corresponding with the multiple reference fingerprints, (ii) requesting and receiving from the media presentation device a second query fingerprint specifically focused on the identified video frame region, and (iii) determining that the second query fingerprint matches a reference fingerprint of the video frame region of just one of the multiple channels, whereby the disambiguation establishes that the media presentation device is receiving the video content on the one channel; and

taking action based on the establishing that the media presentation device is receiving the video content on the one channel.

15. The method of claim 14 , further comprising, for each channel of the multiple channels, establishing a respective reference fingerprint of the identified video frame region,

wherein determining that the second query fingerprint matches a reference fingerprint of the video frame region of just one of the multiple channels comprises determining that the second query fingerprint matches the established respective reference fingerprint of the identified video frame region of just one of the multiple channels.

16. The method of claim 14 , wherein taking action based on the establishing that the media presentation device is receiving the video content on the one channel comprises causing supplemental channel-specific content to be presented by the media presentation device in conjunction with the video content being rendered by the media presentation device.

17. The method of claim 14 , wherein the multiple reference fingerprints are selected from a plurality of reference fingerprints in reference data, and wherein determining that the first query fingerprint matches the multiple reference fingerprints comprises:

comparing the first query fingerprint with the plurality of reference fingerprints in the reference data, and

based on the comparing, determining that the first query fingerprint matches the multiple reference fingerprints.

18. The method of claim 14 , wherein the computing system includes or has access to data that indicates, for the channels corresponding with the multiple reference fingerprints, the video frame region that defines the difference between the channels corresponding with the multiple reference fingerprints, and wherein identifying the video frame region comprises referring to the data to identify the video frame region.

19. The method of claim 14 , wherein the identified video frame region comprises a region at a video frame edge.

20. The method of claim 14 , wherein the identified video frame region comprises a video frame region where channel identification is presented.

Assignments (10)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2018
From: LEE, JAEHYUNG; LEE, DEWEY HO; CREMER, MARKUS
To: GRACENOTE, INC.
Reel/Frame 045836/0133 →