Detecting channel change in automatic content recognition fingerprint matching
View Patent ↗A method includes receiving broadcast fingerprints indicative of broadcast frames of broadcast media streams being streamed to a plurality of channels by a broadcaster and receiving television (TV) fingerprints indicative of an ordered sequence of TV frames of a TV media stream at a corresponding media device. The method further includes matching the TV fingerprints with the broadcast fingerprints by determining a difference between respective broadcast fingerprints and corresponding TV fingerprints of the ordered sequence of TV frames. The matching includes populating a binary tree structure with respective differences. The method also includes detecting a channel change of the media device from a first channel to a second channel in response to locating a value indicative of the channel change in the binary tree structure within a threshold number of children nodes from a root node upon traversing down the binary tree structure.
1. A system comprising:
data processing hardware; and
memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:
receiving broadcast fingerprints indicative of broadcast frames of broadcast media streams being streamed to a plurality of channels by a broadcaster;
receiving television (TV) fingerprints indicative of an ordered sequence of TV frames of a TV media stream at a corresponding media device;
matching the TV fingerprints with the broadcast fingerprints by determining a difference between respective broadcast fingerprints and corresponding TV fingerprints of the ordered sequence of TV frames, wherein the matching comprises populating a binary tree structure with respective differences; and
detecting a channel change of the media device from a first channel to a second channel in response to locating a value indicative of the channel change in the binary tree structure within a threshold number of children nodes from a root node upon traversing down the binary tree structure.
2. The system of claim 1 , wherein the value indicative of the channel change is at or below a threshold maximum value.
3. The system of claim 1 , wherein the value indicative of the channel change is indicative of how different two frames are from each other.
4. The system of claim 1 , wherein the value indicative of the channel change is indicative of a difference between the first and second channels.
5. The system of claim 1 , wherein detecting the channel change comprises locating a corresponding value at a first node of a right sub-tree or a left sub-tree positioned below the root node.
6. The system of claim 1 , wherein detecting the channel change comprises locating a corresponding value at a second node of a right sub-tree or a left sub-tree positioned below the root node.
7. The system of claim 1 , wherein populating the binary tree structure with respective differences comprises:
populating leaf nodes of the binary tree structure with values of the respective differences chronologically from one side to an opposite side of the binary tree structure; and
populating parent nodes with values derived from adding values of children nodes connected to the parent nodes.
8. The system of claim 1 , wherein the operations further comprise determining an identity of the second channel by identifying a channel streaming content with broadcast frames matching those at an end of the ordered sequence of TV frames.
9. The system of claim 8 , wherein the operations further comprise notifying an advertisement (“ad”) targeter of the identity of the second channel being watched in response to detecting the channel change.
10. The system of claim 9 , wherein the ad targeter is configured to:
send a notification of the channel change and the identity of the second channel to an ad server located across a network; and
receive, from the ad server, a replacement ad or overlay content to target commercial slots of the second channel.
11. A method comprising:
receiving, at data processing hardware, broadcast fingerprints indicative of broadcast frames of broadcast media streams being streamed to a plurality of channels by a broadcaster;
receiving, at the data processing hardware, television (TV) fingerprints indicative of an ordered sequence of TV frames of a TV media stream at a corresponding media device;
matching, by the data processing hardware, the TV fingerprints with the broadcast fingerprints by determining a difference between respective broadcast fingerprints and corresponding TV fingerprints of the ordered sequence of TV frames, wherein the matching comprises populating a binary tree structure with respective differences; and
detecting, by the data processing hardware, a channel change of the media device from a first channel to a second channel in response to locating a value indicative of the channel change in the binary tree structure within a threshold number of children nodes from a root node upon traversing down the binary tree structure.
12. The method of claim 11 , wherein the value indicative of the channel change is at or below a threshold maximum value.
13. The method of claim 11 , wherein the value indicative of the channel change is indicative of how different two frames are from each other.
14. The method of claim 11 , wherein the value indicative of the channel change is indicative of a difference between the first and second channels.
15. The method of claim 11 , wherein detecting the channel change comprises locating a corresponding value at a first node of a right sub-tree or a left sub-tree positioned below the root node.
16. The method of claim 11 , wherein detecting the channel change comprises locating a corresponding value at a second node of a right sub-tree or a left sub-tree positioned below the root node.
17. The method of claim 11 , wherein populating the binary tree structure with respective differences comprises:
populating leaf nodes of the binary tree structure with values of the respective differences chronologically from one side to an opposite side of the binary tree structure; and
populating parent nodes with values derived from adding values of children nodes connected to the parent nodes.
18. The method of claim 11 , further comprising determining, by the data processing hardware, an identity of the second channel by identifying a channel streaming content with broadcast frames matching those at an end of the ordered sequence of TV frames.
19. The method of claim 18 , further comprising notifying, by the data processing hardware, an advertisement (“ad”) targeter of the identity of the second channel being watched in response to detecting the channel change.
20. The method of claim 19 , wherein the ad targeter is configured to:
send a notification of the channel change and the identity of the second channel to an ad server located across a network; and
receive, from the ad server, a replacement ad or overlay content to target commercial slots of the second channel.