IP Library Granted Patent US 10,939,162
Granted Patent B2
US 10,939,162 · App. 15/929,193 · Granted Mar 2, 2021

Media channel identification and action with multi-match detection based on reference stream comparison

Inventors: Chung Won Seo (Seoul, KR); Youngmoo Kwon (Goyang, KR); Jaehyung Lee (Seoul, KR)
Assignee: Gracenote, Inc.
H04N21/44008C09J7/20E04F13/0887E04F15/02155H04H60/31H04H60/43H04N21/2353H04N21/23109H04N21/23418H04N21/2407H04N21/25841H04N21/431H04N21/435H04N21/4383H04N21/44204H04N21/44222H04N21/4756H04N21/6118H04N21/6543H04N21/6582H04N21/812H04N21/8352H04N21/8358H04N21/84H04N21/8456C09J2203/314C09J2301/124C09J2301/21C09J2301/314C09J2433/00H04H60/56H04H60/65H04H2201/90
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,939,162
App. No.
15/929,193
Granted
Mar 2, 2021
Kind
B2
Abstract

A computing system will compare various reference fingerprints each representing a reference media stream broadcast on a different respective known channel, and the computing system will determine that a plurality of the reference fingerprints match each other, thus defining a multi-match group of the matching reference fingerprints. Further, the computing system will determine that a query fingerprint representing a media stream being rendered by a media presentation device matches the multi-match group, thus raising a question of which channel is carrying the media stream that is being rendered by the media presentation device. By considering one or more attributes of the query fingerprint, the server may then disambiguate and thereby determine the channel at issue, and the server may in turn take channel-specific action.

Claims (44)

1. A method comprising:

determining, based on a comparison of reference fingerprints with each other, that a plurality of the reference fingerprints match each other, the plurality of reference fingerprints defining a multi-match group, wherein each reference fingerprint represents a respective reference media stream carried by a respective known channel of media content, so that the multi-match group of the plurality of reference fingerprints corresponds with multiple channels of media content;

upon determining that the plurality of reference fingerprints match each other, flagging at least a given one of the reference fingerprints of the plurality as being a member of the multi-match group, wherein flagging the given reference fingerprint as being a member of the multi-match group comprises associating the given reference fingerprint with the multiple channels;

detecting that a query fingerprint representing a media stream being rendered by a media presentation device matches the given reference fingerprint;

based on having detected that the query fingerprint matches the given reference fingerprint of the plurality, and based on having flagged the given reference fingerprint as being a member of the multi-match group, determining that the query fingerprint matches each reference fingerprint of the plurality;

responsive to the determining that the query fingerprint matches each reference fingerprint of the plurality, using one or more attributes of the query fingerprint as a basis to identify a reference fingerprint of the plurality that best matches the query fingerprint; and

determining, based on the identified reference fingerprint, what channel carries the media stream being rendered by the media presentation device, wherein determining what channel carries the media stream being rendered by the media presentation device comprises determining, as the channel that carries the media stream being rendered by the media presentation device, the channel on which the reference media stream represented by the identified reference fingerprint is carried.

2. The method of claim 1 , further comprising taking action based on the determining what channel carries the media stream being rendered by the media presentation device.

3. The method of claim 2 , wherein taking action comprises replacing a portion of the media content with alternative content.

4. The method of claim 3 , wherein the alternative content comprises a replacement advertisement.

5. The method of claim 1 , further comprising obtaining by the computing system the reference fingerprints, wherein obtaining the reference fingerprints comprises receiving the reference fingerprints from media-receiver devices, and wherein the media-receiver devices receive the reference media streams on their respective channels and generate and provide the reference fingerprints representing the received reference media streams.

6. The method of claim 1 , further comprising obtaining by the computing system the reference fingerprints, wherein obtaining the reference fingerprints comprises receiving the reference media streams and generating the reference fingerprints based on the received reference media streams.

7. The method of claim 1 , wherein the computing system is an entity other than the media presentation device, and wherein the query fingerprint is generated by the media presentation device, the method further comprising:

receiving by the computing system, from the media presentation device, the query fingerprint.

8. The method of claim 1 , wherein each reference media stream and the media stream being rendered by the media presentation device comprises content selected from the group consisting of video content and audio content.

9. A computing system comprising:

a network communication interface;

a processing unit;

non-transitory data storage; and

program instructions stored in the data storage and executable by the processing unit to carry out operations including:

determining, based on a comparison of reference fingerprints with each other, that a plurality of the reference fingerprints match each other, the plurality of reference fingerprints defining a multi-match group, wherein each reference fingerprint represents a respective reference media stream carried by a respective known channel of media content, so that the multi-match group of the plurality of reference fingerprints corresponds with multiple channels of media content,

upon determining that the plurality of reference fingerprints match each other, flagging at least a given one of the reference fingerprints of the plurality as being a member of the multi-match group, wherein flagging the given reference fingerprint as being a member of the multi-match group comprises associating the given reference fingerprint with the multiple channels,

detecting that a query fingerprint representing a media stream being rendered by a media presentation device matches the given reference fingerprint,

based on having detected that the query fingerprint matches the given reference fingerprint of the plurality, and based on having flagged the given reference fingerprint as being a member of the multi-match group, determining that the query fingerprint matches each reference fingerprint of the plurality,

responsive to the determining that the query fingerprint matches each reference fingerprint of the plurality, using one or more attributes of the query fingerprint as a basis to identify a reference fingerprint of the plurality that best matches the query fingerprint, and

determining, based on the identified reference fingerprint, what channel carries the media stream being rendered by the media presentation device, wherein determining what channel carries the media stream being rendered by the media presentation device comprises determining, as the channel that carries the media stream being rendered by the media presentation device, the channel on which the reference media stream represented by the identified reference fingerprint is carried.

10. The computing system of claim 9 , wherein the operations further comprise taking action based on the determining of what channel carries the media stream being rendered by the media presentation device.

11. The computing system of claim 10 , wherein the action comprises causing a portion of the media content to be replaced with alternative content.

12. The computing system of claim 11 , wherein the alternative content comprises a replacement advertisement.

13. The computing system of claim 9 , wherein the operations further include obtaining the reference fingerprints, wherein obtaining the reference fingerprints comprises receiving the reference fingerprints via the network communication interface from media-receiver devices, and wherein the media-receiver devices receive the reference media streams on their respective channels and generate and provide the reference fingerprints representing the received reference media streams.

14. The computing system of claim 9 , wherein the operations further include obtaining the reference fingerprints, and wherein obtaining the reference fingerprints comprises receiving the reference media streams and generating the reference fingerprints based on the received reference media streams.

15. The computing system of claim 9 , wherein the computing system is an entity other than the media presentation device, wherein the query fingerprint is generated by the media presentation device, and wherein the operations further include:

receiving via the network communication interface, from the media presentation device, the query fingerprint.

16. The computing system of claim 9 , wherein the operations further include correlating each reference fingerprint with the channel on which the reference media stream represented by the reference fingerprint is carried, to facilitate determining, based on the identified reference fingerprint, what channel carries the media stream being rendered by the media presentation device.

17. A non-transitory computer readable medium having stored thereon instructions executable by a processing unit to carry out operations comprising:

determining, based on a comparison of reference fingerprints with each other, that a plurality of the reference fingerprints match each other, the plurality of reference fingerprints defining a multi-match group, wherein each reference fingerprint represents a respective reference media stream carried by a respective known channel of media content, so that the multi-match group of the plurality of reference fingerprints corresponds with multiple channels of media content;

upon determining that the plurality of reference fingerprints match each other, flagging at least a given one of the reference fingerprints of the plurality as being a member of the multi-match group, wherein flagging the given reference fingerprint as being a member of the multi-match group comprises associating the given reference fingerprint with the multiple channels;

detecting that a query fingerprint representing a media stream being rendered by a media presentation device matches the given reference fingerprint;

based on having detected that the query fingerprint matches the given reference fingerprint of the plurality, and based on having flagged the given reference fingerprint as being a member of the multi-match group, determining that the query fingerprint matches each reference fingerprint of the plurality;

responsive to the determining that the query fingerprint matches each reference fingerprint of the plurality, using one or more attributes of the query fingerprint as a basis to identify a reference fingerprint of the plurality that best matches the query fingerprint; and

determining, based on the identified reference fingerprint, what channel carries the media stream being rendered by the media presentation device, wherein determining what channel carries the media stream being rendered by the media presentation device comprises determining, as the channel that carries the media stream being rendered by the media presentation device, the channel on which the reference media stream represented by the identified reference fingerprint is carried.

18. The non-transitory computer readable medium of claim 17 , wherein the operations further comprise generating the reference fingerprints and storing each reference fingerprint in correlation with the channel on which the reference media stream represented by the reference fingerprint is carried.

19. The non-transitory computer readable medium of claim 17 , wherein the operations further comprise taking action based on the determining of what channel carries the media stream being rendered by the media presentation device.

20. The non-transitory computer readable medium of claim 17 , wherein the action comprises causing a portion of the media content to be replaced with alternative content.

Assignments (10)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 7, 2020
From: SEO, CHUNG WON; KWON, YOUNGMOO; LEE, JAEHYUNG
To: GRACENOTE, INC.
Reel/Frame 051435/0791 →