IP Library Granted Patent US 10,575,052
Granted Patent B2
US 10,575,052 · App. 16/246,746 · Granted Feb 25, 2020

Media channel identification and action with multi-match detection based on reference stream comparison

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,575,052
App. No.
16/246,746
Granted
Feb 25, 2020
Kind
B2
Abstract

A computing system will compare various reference fingerprints each representing a reference media stream broadcast on a different respective known channel, and the computing system will determine that a plurality of the reference fingerprints match each other, thus defining a multi-match group of the matching reference fingerprints. Further, the computing system will determine that a query fingerprint representing a media stream being rendered by a media presentation device matches the multi-match group, thus raising a question of which channel is carrying the media stream that is being rendered by the media presentation device. By considering one or more attributes of the query fingerprint, the server may then disambiguate and thereby determine the channel at issue, and the server may in turn take channel-specific action.

Claims (40)

1. A method comprising:

detecting by a computing system, based on a comparison of reference fingerprints with each other, that a plurality of the reference fingerprints match each other, the plurality of reference fingerprints defining a multi-match group, wherein each reference fingerprint represents a respective reference media stream carried by a respective known channel of media content;

after detecting by the computing system that the plurality of reference fingerprints match each other, detecting by the computing system that a query fingerprint representing a media stream being rendered by a media presentation device matches a given one of the reference fingerprints of the plurality;

based on the computing system having detected that the query fingerprint matches the given reference fingerprint of the plurality, and based on the computing system having detected that the plurality of reference fingerprints match each other, determining by the computing system that the query fingerprint matches each reference fingerprint of the plurality;

responsive to the determining that the query fingerprint matches each reference fingerprint of the plurality, using by the computing system one or more attributes of the query fingerprint as a basis to identify a reference fingerprint of the plurality that best matches the query fingerprint; and

determining by the computing system, based on the identified reference fingerprint, what channel carries the media stream being rendered by the media presentation device, wherein determining what channel carries the media stream being rendered by the media presentation device comprises determining, as the channel that carries the media stream being rendered by the media presentation device, the channel on which the reference media stream represented by the identified reference fingerprint is carried.

2. The method of claim 1 , further comprising obtaining by the computing system the reference fingerprints, wherein obtaining the reference fingerprints comprises receiving the reference fingerprints from media-receiver devices, and wherein the media-receiver devices receive the reference media streams on their respective channels and generate and provide the reference fingerprints representing the received reference media streams.

3. The method of claim 1 , further comprising obtaining by the computing system the reference fingerprints, wherein obtaining the reference fingerprints comprises receiving the reference media streams and generating the reference fingerprints based on the received reference media streams.

4. The method of claim 1 , wherein, of the plurality of the reference fingerprints, a first reference fingerprint represents a first reference media stream on a first channel and a second reference fingerprint represents a second reference media stream on a second channel, the first media stream being earlier on the first channel than the second media stream on the second channel, and the first reference fingerprint thus being earlier than the second reference fingerprint, wherein the first reference fingerprint is the given reference fingerprint.

5. The method of claim 1 , wherein the computing system is an entity other than the media presentation device, and wherein the query fingerprint is generated by the media presentation device, the method further comprising:

receiving by the computing system, from the media presentation device, the query fingerprint.

6. The method of claim 1 , further comprising, based on the determined channel, replacing a portion of the media content with alternative content.

7. The method of claim 6 , wherein the alternative content comprises a replacement advertisement.

8. The method of claim 1 , wherein each reference media stream and the query media stream comprises content selected from the group consisting of video content and audio content.

9. A computing system comprising:

a network communication interface;

a processing unit;

non-transitory data storage; and

program instructions stored in the data storage and executable by the processing unit to carry out operations including:

detecting, based on a comparison of reference fingerprints with each other, that a plurality of the reference fingerprints match each other, the plurality of reference fingerprints defining a multi-match group, wherein each reference fingerprint represents a respective reference media stream carried by a respective known channel of media content,

after detecting that the plurality of reference fingerprints match each other, detecting that a query fingerprint representing a media stream being rendered by a media presentation device matches a given one of the reference fingerprints of the plurality, based on having detected that the query fingerprint matches the given reference fingerprint of the plurality, and based on having detected that the plurality of reference fingerprints match each other, determining that the query fingerprint matches each reference fingerprint of the plurality,

responsive to the determining that the query fingerprint matches each reference fingerprint of the plurality, using one or more attributes of the query fingerprint as a basis to identify a reference fingerprint of the plurality that best matches the query fingerprint, and

determining, based on the identified reference fingerprint, what channel carries the media stream being rendered by the media presentation device, wherein determining what channel carries the media stream being rendered by the media presentation device comprises determining, as the channel that carries the media stream being rendered by the media presentation device, the channel on which the reference media stream represented by the identified reference fingerprint is carried.

10. The computing system of claim 9 , wherein the operations further include obtaining the reference fingerprints, wherein obtaining the reference fingerprints comprises receiving the reference fingerprints via the network communication interface from media-receiver devices, and wherein the media-receiver devices receive the reference media streams on their respective channels and generate and provide the reference fingerprints representing the received reference media streams.

11. The computing system of claim 9 , wherein the operations further include obtaining the reference fingerprints, and wherein obtaining the reference fingerprints comprises receiving the reference media streams and generating the reference fingerprints based on the received reference media streams.

12. The computing system of claim 9 , wherein the computing system is an entity other than the media presentation device, wherein the query fingerprint is generated by the media presentation device, and wherein the operations further include:

receiving via the network communication interface, from the media presentation device, the query fingerprint.

13. The computing system of claim 9 , wherein the operations further include correlating each reference fingerprint with the channel on which the reference media stream represented by the reference fingerprint is carried, to facilitate determining, based on the identified reference fingerprint, what channel carries the media stream being rendered by the media presentation device.

14. The computing system of claim 9 , wherein the operations further include, based on the determined channel, causing a portion of the media content to be replaced with alternative content.

15. The computing system of claim 14 , wherein the alternative content comprises a replacement advertisement.

16. The computing system of claim 9 , wherein each reference media stream and the query media stream comprises content selected from the group consisting of video content and audio content.

17. A non-transitory computer readable medium having stored thereon instructions executable by a processing unit to carry out operations comprising:

detecting, based on a comparison of reference fingerprints with each other, that a plurality of the reference fingerprints match each other, the plurality of reference fingerprints defining a multi-match group, wherein each reference fingerprint represents a respective reference media stream carried by a respective known channel of media content;

after detecting that the plurality of reference fingerprints match each other, detecting that a query fingerprint representing a media stream being rendered by a media presentation device matches a given one of the reference fingerprints of the plurality;

based on having detected that the query fingerprint matches the given reference fingerprint of the plurality, and based on having detected that the plurality of reference fingerprints match each other, determining that the query fingerprint matches each reference fingerprint of the plurality;

responsive to the determining that the query fingerprint matches each reference fingerprint of the plurality, using one or more attributes of the query fingerprint as a basis to identify a reference fingerprint of the plurality that best matches the query fingerprint; and

determining, based on the identified reference fingerprint, what channel carries the media stream being rendered by the media presentation device, wherein determining what channel carries the media stream being rendered by the media presentation device comprises determining, as the channel that carries the media stream being rendered by the media presentation device, the channel on which the reference media stream represented by the identified reference fingerprint is carried.

18. The non-transitory computer readable medium of claim 17 , wherein the operations further comprise generating the reference fingerprints and storing each reference fingerprint in correlation with the channel on which the reference media stream represented by the reference fingerprint is carried.

19. The non-transitory computer readable medium of claim 17 , further comprising, based on the determined channel, causing a portion of the media content to be replaced with alternative content.

20. The non-transitory computer readable medium of claim 19 , wherein the alternative content comprises a replacement advertisement.

Assignments (10)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT (REEL/FRAME 056982/0194) Recorded Feb 22, 2023
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROKU, INC.; ROKU DX HOLDINGS, INC.
Reel/Frame 062826/0664 →
PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Jun 29, 2021
From: ROKU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 056982/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056103/0786 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Apr 20, 2021
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC; GRACENOTE, INC.
Reel/Frame 056973/0280 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 15, 2019
From: SEO, CHUNG WON; KWON, YOUNGMOO; LEE, JAEHYUNG
To: GRACENOTE, INC.
Reel/Frame 048010/0489 →