Automatic content recognition with local matching
A media device and method execute computer instructions to: generate a first query fingerprint of media content; send the first query fingerprint to a server; and receive, from the server, an identification of a first channel being watched in response to the server finding a match to the first query fingerprint. The media device iteratively receives, from the server, a plurality of fingerprints generated from the media content in locations ahead of where the media content is being received; store the plurality of fingerprints in a local database of a computer-readable storage medium; and compare a second query fingerprint of the media content with the plurality of fingerprints to determine whether the media device remains set on the first channel, without continuously pinging the server. When the media device locally detects a non-match with the second query fingerprint, the process starts over with it finding a match at the server.
1. A media device comprising:
at least one processing device; and
a non-transitory computer-readable medium storing program instructions that, when executed by the at least one processing device, cause the media device to perform operations comprising:
generating a first query fingerprint of first media content being consumed by the media device;
sending the first query fingerprint to a server;
in response to the server finding a match to the first query fingerprint:
(i) receiving, from the server, an identification of a first channel being watched via the media device;
(ii) receiving, from the server, a first plurality of fingerprints generated from first upcoming media content to be displayed on the first channel after the first media content; and
(iii) receiving, from the server, a second plurality of fingerprints of second upcoming media content to be displayed on a second channel, the second channel being listed on a channel guide with the first channel and watched via the media device at a threshold watch rate or higher;
storing the first plurality of fingerprints and the second plurality of fingerprints in a local database of the media device;
generating a second query fingerprint of second media content being consumed by the media device;
comparing the second query fingerprint with the first plurality of fingerprints and with the second plurality of fingerprints stored in the local database; and
determining whether the media device remains set on the first channel or has changed to the second channel based on the comparison of the second query fingerprint.
2. The media device of claim 1 , wherein the operations further comprise, responsive to detecting a non-match of the second query fingerprint with the first plurality of fingerprints and the second plurality of fingerprints, sending the second query fingerprint to the server to obtain an identification of a third channel different than the first channel and the second channel.
3. The media device of claim 2 , wherein the operations further comprise receiving, from the server, the identification of the third channel responsive to the second query fingerprint matching a respective fingerprint of a third plurality of fingerprints stored on the server from third media content streamed to the third channel.
4. The media device of claim 2 , wherein detecting the non-match of the second query fingerprint comprises determining that the second query fingerprint fails to meet a threshold of a matching metric between the second query fingerprint and any of the first plurality of fingerprints and the second plurality of fingerprints, wherein the matching metric comprises a confidence level in a match.
5. The media device of claim 1 , wherein the operations further comprise, in response to the server finding the match to the first query fingerprint, receiving, from the server, a third plurality of fingerprints of a third media content to be streamed to a third channel located sequentially adjacent to the first channel on the channel guide.
6. The media device of claim 1 , wherein the first query fingerprint and the second query fingerprint both comprise a sequence of frames of media content spanning a predetermined number of seconds.
7. The media device of claim 1 , wherein the non-transitory computer-readable medium comprises a first-in, first-out (FIFO) memory in which an oldest of the first plurality of fingerprints and of the second plurality of fingerprints exits first.
8. A method comprising,
generating, by a media device, a first query fingerprint of first media content being consumed by the media device;
sending, by the media device, the first query fingerprint to a server;
in response to the server finding a match to the first query fingerprint:
(i) receiving, by the media device from the server, an identification of a first channel being watched via the media device;
(ii) receiving, from the server, a first plurality of fingerprints generated from first upcoming media content to be displayed on the first channel after the first media content; and
(iii) receiving, from the server, a second plurality of fingerprints of second upcoming media content to be displayed on a second channel, the second channel being listed on a channel guide with the first channel and watched via the media device at a threshold watch rate or higher;
storing, by the media device, the first plurality of fingerprints and the second plurality of fingerprints in a local database of the media device;
generating a second query fingerprint of second media content being consumed by the media device;
comparing, by the media device; the second query fingerprint with the first plurality of fingerprints and with the second plurality of fingerprints stored in the local database; and
determining; by the media device, whether the media device remains set on the first channel or has changed to the second channel based on the comparison of the second query fingerprint.
9. The method of claim 8 , wherein the first plurality of fingerprints received from the server include all fingerprints associated with the first upcoming media content.
10. The method of claim 8 , further comprising, responsive to detecting a non-match of the second query fingerprint with the first plurality of fingerprints and the second plurality of fingerprints, sending the second query fingerprint to the server to obtain an identification of a third channel different than the first channel and the second channel.
11. The method of claim 10 , further comprising receiving, from the server, the identification of the third channel responsive to the second query fingerprint matching a respective fingerprint of a third plurality of fingerprints stored on the server from a third media streamed to the third channel.
12. The method of claim 8 , further comprising, in response to the server finding the match to the first query fingerprint, receiving a third plurality of fingerprints of third upcoming media content to be streamed to a third channel located sequentially adjacent to the first channel on the channel guide.
13. A non-transitory computer-readable medium comprising program instructions that, when executed by at least one processor of a media device, cause the media device to perform operations comprising:
generating a first query fingerprint of first media content being consumed by the media device;
sending the first query fingerprint to a server;
in response to the server finding a match to the first query fingerprint:
(i) receiving, from the server, an identification of a first channel being watched via the media device;
(ii) receiving, from the server, a first plurality of fingerprints generated from first upcoming media content to be displayed on the first channel after the first media content; and
(iii) receiving, from the server, a second plurality of fingerprints of second upcoming media content to be displayed on a second channel, the second channel being listed on a channel guide with the first channel and watched via the media device at a threshold watch rate or higher;
storing the first plurality of fingerprints and the second plurality of fingerprints in a local database of the media device;
generating a second query fingerprint of second media content being consumed by the media device;
comparing the second query fingerprint with the first plurality of fingerprints and with the second plurality of fingerprints stored in the local database; and
determining whether the media device remains set on the first channel or has changed to the second channel based on the comparison of the second query fingerprint.
14. The non-transitory computer-readable medium of claim 13 , wherein the operations further comprise, responsive to detecting a non-match of the second query fingerprint with the first plurality of fingerprints and the second plurality of fingerprints, sending the second query fingerprint to the server to obtain an identification of a third channel different than the first channel and the second channel.
15. The non-transitory computer-readable medium of claim 14 , wherein the operations further comprise receiving; from the server, the identification of the third channel responsive to the second query fingerprint matching a respective fingerprint of a third plurality of fingerprints stored on the server from third media content streamed to the third channel.
16. The non-transitory computer-readable medium of claim 13 , wherein the operations further comprise receiving a third plurality of fingerprints of third media content to be streamed to a third channel located sequentially adjacent to the first channel on the channel guide.
17. A media device comprising:
at least one processing device; and
a non-transitory computer-readable medium storing program instructions that, when executed by the at least one processing device, cause the media device to perform operations comprising:
generating a first query fingerprint of first media contentbeing consumed by the media device;
sending the first query fingerprint to a server;
in response to the server finding a match to the first query fingerprint:
(i) receiving, from the server, an identification of a first channel being watched;
(ii) receiving, from the server, a first plurality of fingerprints generated from first upcoming media content scheduled to be displayed on the first channel after the first media content; and
(iii) receiving, from the server, a second plurality of fingerprints of second upcoming media content to be displayed on a second channel, the second channel being listed on a channel guide sequentially adjacent to the first channel;
storing the first plurality of fingerprints and the second plurality of fingerprints in a local database of the media device;
generating a second query fingerprint of second media content being consumed by the media device;
comparing the second query fingerprint with the first plurality of fingerprints and with the second plurality of fingerprints stored in the local database; and
determining whether the media device remains set on the first channel or has changed to the second channel based on the comparison of the second query fingerprint.
18. The media device of claim 17 , wherein the operations further comprise, responsive to detecting a non-match of the second query fingerprint with the first plurality of fingerprints and the second plurality of fingerprints, sending the second query fingerprint to the server to obtain an identification of a third channel different than the first channel and the second channel.
19. The media device of claim 18 , wherein the operations further comprise receiving, from the server, the identification of the third channel responsive to the second query fingerprint matching a respective fingerprint of a third plurality of fingerprints stored on the server from third media content streamed to the third channel.
20. The media device of claim 18 , wherein detecting the non-match of the second query fingerprint comprises determining that the second query fingerprint fails to meet a threshold of a matching metric between the second query fingerprint and any of the first plurality of fingerprints and the second plurality of fingerprints, wherein the matching metric comprises a confidence level in a match.
21. The media device of claim 17 , wherein the operations further comprise, in response to the server finding the match to the first query fingerprint, receiving, from the server, a third plurality of fingerprints of a third media content to be streamed to a third channel located sequentially adjacent to the first channel or the second channel on the channel guide.