IP Library Granted Patent US 10,972,786
Granted Patent B2
US 10,972,786 · App. 15/929,180 · Granted Apr 6, 2021

Media channel identification and action with multi-match detection and disambiguation based on matching with differential reference- fingerprint feature

Inventors: Jaehyung Lee (Seoul, KR); Dewey Ho Lee (Berkeley, CA); Markus Cremer (Orinda, CA)
Assignee: Gracenote, Inc.
H04N21/44008C09J7/20E04F13/0887E04F15/02155H04H60/31H04H60/43H04N21/2353H04N21/23109H04N21/23418H04N21/2407H04N21/25841H04N21/431H04N21/435H04N21/4383H04N21/44204H04N21/44222H04N21/4756H04N21/6118H04N21/6543H04N21/6582H04N21/812H04N21/8352H04N21/8358H04N21/84H04N21/8456C09J2203/314C09J2301/124C09J2301/21C09J2301/314C09J2433/00H04H60/56H04H60/65H04H2201/90
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,972,786
App. No.
15/929,180
Granted
Apr 6, 2021
Kind
B2
Abstract

A computing system compares various reference fingerprints each representing a reference media stream broadcast on a different respective known channel, and the computing system determines that a plurality of the reference fingerprints match each other, thus defining a multi-match group of the matching reference fingerprints. In response, the computing system identifies a fingerprint feature that could define a distinction between the reference fingerprints, and the computing system resolves the multi-match based on the identified feature, thereby determining the channel carrying the media stream being rendered by the media presentation device. And the server then takes channel-specific action based on the determined channel.

Claims (36)

1. A media presentation device comprising:

a media input interface through which to receive video content to be presented by the media presentation device, wherein the video content includes video frames having video frame regions, the video frame regions comprising a center, an edge, and a corner;

a media presentation interface for presenting the received video content; and

a network communication interface,

wherein the media presentation device is configured to generate first query fingerprint data representing the video content based on analysis of the video content, and to output the generated first query fingerprint data for transmission through the network communication interface to a server,

wherein the media presentation device is configured to receive from the server, after outputting the first query fingerprint data, a request for second query fingerprint data specifically focused on an identified video frame region of the video frame regions of the video content, wherein the identified video frame region defines a difference between multiple channels that each have reference fingerprint data matching the first query fingerprint data,

wherein the media presentation device is configured to output, for transmission through the network communication interface to the server, the requested second query fingerprint data specifically focused on the identified video frame region of the video content, and

wherein the media presentation device is configured to present, in conjunction with the video content that the media presentation device is presenting, supplemental channel-specific content associated with one of the multiple channels, the one channel being identified from among the multiple channels based on a determination that the second query fingerprint data matches a reference fingerprint of just the one channel of the multiple channels.

2. The media presentation device of claim 1 , wherein the supplemental channel-specific content comprises at least one of a pop-up advertisement, a commercial break, or a channel-identification.

3. The media presentation device of claim 1 , wherein the supplemental channel-specific content is a replacement for one or more portions of the video content.

4. The method presentation device of claim 3 , wherein the supplemental channel-specific content is a replacement advertisement.

5. The media presentation device of claim 1 , wherein the supplemental channel-specific content is selected based on profile data associated with the media presentation device.

6. The media presentation device of claim 5 , wherein the profile data comprises device-specific viewing analytics.

7. The media presentation device of claim 1 , wherein the identified video frame region is at least one of (i) at a video frame edge or (ii) where channel identification is presented.

8. A method comprising:

generating by a media presentation device, based on analysis of video content being rendered by the media presentation device, first query fingerprint data representing the video content being rendered by the media presentation device, wherein the video content includes video frames having video frame regions, the video frame regions comprising a center, an edge, and a corner;

outputting by the media presentation device the generated first query fingerprint data for transmission over a network to a server;

receiving by the media presentation device, from the server, after outputting the first query fingerprint, a request for second query fingerprint data specifically focused on an identified video frame region of the video frame regions of the video content, wherein the identified video frame region defines a difference between multiple channels that each have reference fingerprint data matching the first query fingerprint data;

outputting, for transmission over the network to the server, the requested second query fingerprint data specifically focused on the identified video frame region of the video content; and

taking action by the media presentation device based on an identified one of the multiple channels, the one channel being identified from among the multiple channels based on a determination that the second query fingerprint data matches reference fingerprint data of just the one channel of the multiple channels.

9. The method of claim 8 , wherein the identified video frame region is at least one of (i) at a video frame edge or (ii) where channel identification is presented.

10. The method of claim 8 , wherein the identified video frame region is indicated by channel-data accessible to the server.

11. The method of claim 8 , wherein taking action based on the identified channel comprises performing advertisement replacement.

12. A non-transitory computer readable medium having stored thereon instructions executable by a processing unit to carry out operations including:

generating, based on analysis of video content being rendered by a media presentation device, first query fingerprint data representing the video content being rendered by the media presentation device, and outputting the generated first query fingerprint data for transmission over a network to a server, wherein the video content includes video frames having video frame regions, the video frame regions comprising a center, an edge, and a corner;

receiving from the server, after outputting the first query fingerprint data, a request for a second query fingerprint data specifically focused on an identified video frame region of the video frame regions of the video content, wherein the identified video frame region defines a difference between multiple channels that each have reference fingerprint data matching the first query fingerprint data;

outputting, for transmission over the network to the server, the requested second query fingerprint specifically focused on the identified video frame region of the video content; and

causing the media presentation device to take action based on an identified one of the multiple channels, the one channel being identified from among the multiple channels based on a determination that the second query fingerprint data matches reference fingerprint data of just the one channel of the multiple channels.

13. The non-transitory computer readable medium of claim 12 , wherein the identified video frame region is at least one of (i) at a video frame edge or (ii) where channel identification is presented.

14. The non-transitory computer readable medium of claim 12 , wherein the identified video frame region is indicated by channel-data accessible to the server.

15. The non-transitory computer readable medium of claim 12 , wherein the action based on the identified channel comprises performing advertisement replacement.

16. The non-transitory computer readable medium of claim 12 , wherein the action based on the identified channel comprises causing the media presentation device to present, in conjunction with the video content that the media presentation device is presenting, supplemental channel-specific content associated with the identified channel.

17. The non-transitory computer readable medium of claim 16 , wherein the supplemental channel-specific content comprises at least one of a pop-up advertisement, a commercial break, or a channel-identification.

18. The non-transitory computer readable medium of claim 16 , wherein the supplemental channel-specific content is a replacement for one or more portions of the video content.

19. The non-transitory computer readable medium of claim 16 , wherein the supplemental channel-specific content is additionally based on profile data associated with the media presentation device.

20. The non-transitory computer readable medium of claim 19 , wherein the profile data comprises device-specific viewing analytics.

Assignments (10)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2019
From: LEE, JAEHYUNG; LEE, DEWEY HO; CREMER, MARKUS
To: GRACENOTE, INC.
Reel/Frame 051200/0814 →