IP Library Granted Patent US 11,617,009
Granted Patent B2
US 11,617,009 · App. 17/651,494 · Granted Mar 28, 2023

Media channel identification and action with multi-match detection and disambiguation based on matching with differential reference-fingerprint feature

Inventors: Jaehyung Lee (Seoul, KR); Dewey Ho Lee (Berkeley, CA); Markus Cremer (Orinda, CA)
Assignee: ROKU, INC.
H04N21/44008C09J7/20E04F13/0887E04F15/02155H04H60/31H04H60/43H04N21/2353H04N21/23109H04N21/23418H04N21/2407H04N21/25841H04N21/431H04N21/435H04N21/4383H04N21/44204H04N21/44222H04N21/4756H04N21/6118H04N21/6543H04N21/6582H04N21/812H04N21/8352H04N21/8358H04N21/84H04N21/8456C09J2203/314C09J2301/124C09J2301/21C09J2301/314C09J2433/00H04H60/56H04H60/65H04H2201/90
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,617,009
App. No.
17/651,494
Granted
Mar 28, 2023
Kind
B2
Abstract

A computing system compares various reference fingerprints each representing a reference media stream broadcast on a different respective known channel, and the computing system determines that a plurality of the reference fingerprints match each other, thus defining a multi-match group of the matching reference fingerprints. In response, the computing system identifies a fingerprint feature that could define a distinction between the reference fingerprints, and the computing system resolves the multi-match based on the identified feature, thereby determining the channel carrying the media stream being rendered by the media presentation device. And the computing system could then take channel-specific action based on the determined channel.

Claims (36)

1. A system comprising:

a network communication interface;

a processing unit;

non-transitory data storage; and

program instructions stored in the non-transitory data storage and executable by the processing unit to carry out operations including:

receiving, from a media presentation device, first query fingerprint data representing video content being received by the media presentation device, wherein the video content includes video frames having video frame regions, the video frame regions comprising a center, an edge, and a corner;

determining that the first query fingerprint data matches multiple instances of reference fingerprint data corresponding with multiple channels; and

responsive to at least determining that the first query fingerprint data matches the multiple instances of reference fingerprint data corresponding with the multiple channels, performing disambiguation by (i) identifying a video frame region, of the video frame regions of the video content, that defines a difference between the multiple channels with which the multiple instance of reference fingerprint data correspond, (ii) requesting and receiving, from the media presentation device, second query fingerprint data specifically focused on the identified video frame region, and (iii) determining that the second query fingerprint data matches reference fingerprint data representing the video frame region of just one channel of the multiple channels, whereby the disambiguation establishes that the media presentation device is receiving the video content on the one channel.

2. The system of claim 1 , wherein the operations further include, for each channel of the multiple channels, establishing respective reference fingerprint data of the identified video frame region,

wherein determining that the second query fingerprint data matches the reference fingerprint data of the video frame region of the one channel of the multiple channels comprises determining that the second query fingerprint data matches the established respective reference fingerprint data of the identified video frame region of the one channel of the multiple channels.

3. The system of claim 1 , wherein the operations further include taking action based on the establishing that the media presentation device is receiving the video content on the one channel.

4. The system of claim 3 , wherein taking action based on the establishing that the media presentation device is receiving the video content on the one channel comprises causing supplemental channel-specific content to be presented by the media presentation device in conjunction with the video content being received by the media presentation device.

5. The system of claim 3 , wherein taking action based on the establishing that the media presentation device is receiving the video content on the one channel comprises causing presentation of a replacement advertisement in place of an advertisement on the channel.

6. The system of claim 3 , wherein taking action based on the establishing that the media presentation device is receiving the video content on the one channel comprises recording channel ratings data.

7. The system of claim 1 , wherein the multiple instances of reference fingerprint data are selected from a plurality of instances of reference fingerprint data in reference data, and wherein determining that the first query fingerprint data matches the multiple instances of reference fingerprint data comprises:

comparing the first query fingerprint data with the plurality of instances of reference fingerprint data in the reference data, and

based on the comparing, determining that the first query fingerprint data matches the multiple instances of reference fingerprint data.

8. The system of claim 1 , wherein the system has access to data that indicates, for the multiple channels with which the multiple instances of reference fingerprint data correspond, the video frame region that defines the difference between the multiple channels, and wherein identifying the video frame region comprises referring to the data to identify the video frame region.

9. The system of claim 1 , wherein the identified video frame region comprises a region at a video frame edge.

10. The system of claim 1 , wherein the identified video frame region comprises a video frame region where channel identification is presented.

11. Non-transitory data storage having stored thereon instructions executable by a processing unit to carry out operations comprising:

receiving, from a media presentation device, a first query fingerprint of video content being rendered by the media presentation device, wherein the video content includes video frames having video frame regions, the video frame regions comprising a center, an edge, and a corner;

determining that the first query fingerprint matches multiple reference fingerprints corresponding with multiple channels; and

responsive to at least determining that the first query fingerprint matches the multiple reference fingerprints corresponding with the multiple channels, performing disambiguation by (i) identifying a video frame region, of the video frame regions of the video content, that defines a difference between the channels corresponding with the multiple reference fingerprints, (ii) requesting and receiving, from the media presentation device, a second query fingerprint specifically focused on the identified video frame region, and (iii) determining that the second query fingerprint matches a reference fingerprint of the video frame region of just one channel of the multiple channels, whereby the disambiguation establishes that the media presentation device is receiving the video content on the one channel.

12. The non-transitory data storage of claim 11 , wherein the operations further include, for each channel of the multiple channels, establishing respective reference fingerprint data of the identified video frame region,

wherein determining that the second query fingerprint data matches the reference fingerprint data of the video frame region of the one channel of the multiple channels comprises determining that the second query fingerprint data matches the established respective reference fingerprint data of the identified video frame region of the one channel of the multiple channels.

13. The non-transitory data storage of claim 11 , wherein the operations further include taking action based on the establishing that the media presentation device is receiving the video content on the one channel.

14. The non-transitory data storage of claim 13 , wherein taking action based on the establishing that the media presentation device is receiving the video content on the one channel comprises causing supplemental channel-specific content to be presented by the media presentation device in conjunction with the video content being received by the media presentation device.

15. The non-transitory data storage of claim 13 , wherein taking action based on the establishing that the media presentation device is receiving the video content on the one channel comprises causing presentation of a replacement advertisement in place of an advertisement on the channel.

16. The non-transitory data storage of claim 13 , wherein taking action based on the establishing that the media presentation device is receiving the video content on the one channel comprises recording channel ratings data.

17. The non-transitory data storage of claim 11 , wherein the multiple instances of reference fingerprint data are selected from a plurality of instances of reference fingerprint data in reference data, and wherein determining that the first query fingerprint data matches the multiple instances of reference fingerprint data comprises:

comparing the first query fingerprint data with the plurality of instances of reference fingerprint data in the reference data, and

based on the comparing, determining that the first query fingerprint data matches the multiple instances of reference fingerprint data.

18. The non-transitory data storage of claim 11 , wherein the processing unit has access to data that indicates, for the multiple channels with which the multiple instances of reference fingerprint data correspond, the video frame region that defines the difference between the multiple channels, and wherein identifying the video frame region comprises referring to the data to identify the video frame region.

19. The non-transitory data storage of claim 11 , wherein the identified video frame region comprises a region at a video frame edge.

20. The non-transitory data storage of claim 11 , wherein the identified video frame region comprises a video frame region where channel identification is presented.

Assignments (3)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 17, 2022
From: LEE, JAEHYUNG; LEE, DEWEY HO; CREMER, MARKUS
To: GRACENOTE, INC.
Reel/Frame 059039/0585 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 17, 2022
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 059175/0572 →
Continuity (7)
Continuation 17249107 · Feb 19, 2021
Continuation 15929180 · Dec 5, 2019
Continuation 16017190 · Jun 25, 2018
Continuation 15982437 · May 17, 2018
Continuation 15442114 · Feb 24, 2017
Provisional Application 62301616 · Feb 29, 2016
Related Publication 20220174352A1 · Jun 2, 2022