IP Library Granted Patent US 11,412,296
Granted Patent B2
US 11,412,296 · App. 17/305,116 · Granted Aug 9, 2022

Media channel identification with video multi-match detection and disambiguation based on audio fingerprint

Inventors: Chung Won Seo (Seoul, KR); Youngmoo Kwon (Goyang, KR); Jaehyung Lee (Seoul, KR)
Assignee: Roku, Inc.
H04N21/44204G06F16/683G06V20/46G06V20/48H04H60/43H04H60/58H04H60/59H04N21/23418H04N21/435H04N21/4394H04N21/44008H04N21/4622H04N21/6118H04N21/812H04N21/84
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,412,296
App. No.
17/305,116
Granted
Aug 9, 2022
Kind
B2
Abstract

Disclosed are methods and systems to help disambiguate channel identification in a scenario where a video fingerprint of media content matches multiple reference video fingerprints corresponding respectively with multiple different channels. Given such a multi-match situation, an entity could disambiguate based on an audio component of the media content, such as by further determining that an audio fingerprint of the media content at issue matches an audio fingerprint of just one of the multiple channels, thereby establishing that that is the channel on which the media content being rendered by the media presentation device is arriving.

Claims (38)

1. A method comprising:

determining, by a computing system, that digital video fingerprint data representing media content being received by a media presentation device matches reference video fingerprint data corresponding with multiple channels;

responsive to at least determining that the digital video fingerprint data matches the reference video fingerprint data corresponding with multiple channels, performing disambiguation by the computing system based at least in part on a determination that digital audio fingerprint data representing the media content being received by the media presentation device matches reference audio fingerprint data corresponding with just a single channel of the multiple channels, the disambiguation establishing that the media presentation device is receiving the media content on the single channel; and

taking action based on the establishing that the media presentation device is receiving the media content on the single channel.

2. The method of claim 1 , wherein the media content has a video track and an audio track, wherein the digital video fingerprint data is fingerprint data representing the video track and the digital audio fingerprint data is fingerprint data representing the audio track.

3. The method of claim 1 , wherein the digital audio fingerprint data represents at least a language track of the media content.

4. The method of claim 1 , wherein taking action based on the establishing that the media presentation device is receiving the media content on the single channel comprises causing presentation of supplemental channel-specific content in conjunction with the media content being received by the media presentation device.

5. The method of claim 4 , wherein the supplemental channel-specific content includes at least one of a pop-up advertisement, a commercial break, or a channel-identification.

6. The method of claim 4 ,

wherein the supplemental channel-specific content comprises an advertisement, and

wherein causing presentation of the supplemental channel-specific content in conjunction with the media content being received by the media presentation device comprises causing presentation of the advertisement as a replacement for a portion of the media content.

7. The method of claim 1 , wherein taking action based on the establishing that the media presentation device is receiving the media content on the single channel comprises inserting an advertisement in place of a portion of the media content.

8. A system comprising:

a network communication interface;

at least one processing unit;

non-transitory data storage; and

program instructions stored in the non-transitory data storage and executable by the at least one processing unit to carry out operations including:

determining that digital video fingerprint data representing media content being received by a media presentation device matches reference video fingerprint data corresponding with multiple channels,

responsive to at least the determining that the digital video fingerprint data matches the reference video fingerprint data corresponding with the multiple channels, performing disambiguation based at least in part on a determination that digital audio fingerprint data representing the media content being received by the media presentation device matches reference audio fingerprint data corresponding with just a single channel of the multiple channels, the disambiguation establishing that the media content being received by the media presentation device is media content of the single channel, and

taking action based on the establishing that the media content being received by the media presentation device is media content of the single channel.

9. The system of claim 8 , wherein the media content has a video track and an audio track, and wherein the digital video fingerprint data is fingerprint data representing the video track and the digital audio fingerprint data is fingerprint data representing the audio track.

10. The system of claim 8 , wherein the digital audio fingerprint data represents at least a language track of the media content.

11. The system of claim 8 , wherein the digital audio fingerprint data represents at least one of background music or a sound effect.

12. The system of claim 8 , wherein taking action based on the establishing that the media content being received by the media presentation device is media content of the single channel comprises causing presentation of supplemental channel-specific content in conjunction with the media content being received by the media presentation device.

13. The system of claim 12 , wherein the supplemental channel-specific content includes at least one of a pop-up advertisement, a commercial break, or a channel-identification.

14. The system of claim 12 ,

wherein the supplemental channel-specific content comprises an advertisement, and

wherein causing presentation of the supplemental channel-specific content in conjunction with the media content being received by the media presentation device comprises causing presentation of the advertisement as a replacement for a portion of the media content.

15. The system of claim 8 , wherein taking action based on the establishing that the media content being received by the media presentation device is media content of the single channel comprises inserting an advertisement in place of a portion of the media content.

16. The system of claim 8 , wherein taking action based on the establishing that the media content being received by the media presentation device is media content of the single channel comprises recording presentation of the single channel for use in a channel ratings system.

17. The system of claim 8 , wherein the system comprises the media presentation device.

18. The system of claim 8 , wherein the system comprises an entity other than the media presentation device, wherein the digital video fingerprint data and the digital audio fingerprint data are generated by the media presentation device, and wherein the operations further include:

receiving by the system from the media presentation device the digital video fingerprint data and the digital audio fingerprint data.

19. The system of claim 18 , wherein receiving by the system the digital audio fingerprint data occurs after the determining that the digital video fingerprint data matches reference video fingerprint data corresponding with the multiple channels.

20. A non-transitory computer readable medium storing instructions executable by at least one processing unit to carry out operations including:

determining that digital video fingerprint data representing media content being received by a media presentation device matches reference video fingerprint data corresponding with multiple channels;

responsive to at least the determining that the digital video fingerprint data matches the reference video fingerprint data corresponding with the multiple channels, performing disambiguation based at least in part on a determination that digital audio fingerprint data representing the media content being received by the media presentation device matches reference audio fingerprint data corresponding with just a single channel of the multiple channels, the disambiguation establishing that the media content being received by the media presentation device is media content of the single channel; and

taking action based on the establishing that the media content being received by the media presentation device is media content of the single channel.

Assignments (3)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2021
From: SEO, CHUNG WON; KWON, YOUNGMOO; LEE, JAEHYUNG
To: GRACENOTE, INC.
Reel/Frame 056728/0596 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2021
From: GRACENOTE, INC.
To: ROKU, INC.
Reel/Frame 056728/0692 →
Continuity (9)
Continuation 16819657 · Mar 16, 2020
Continuation 16274966 · Feb 13, 2019
Continuation 16017203 · Jun 25, 2018
Continuation 15842189 · Dec 14, 2017
Continuation 15253354 · Aug 31, 2016
Continuation In Part 15222405 · Jul 28, 2016
Continuation In Part 15179143 · Jun 10, 2016
Provisional Application 62301616 · Feb 29, 2016
Related Publication 20210329333A1 · Oct 21, 2021