Method and system for presenting additional content at a media system
View Patent ↗A media system, receives a received sequence of media content, for presentation at the media system and generates a comparison fingerprint of the received sequence of media content. The comparison fingerprint is for comparison with a plurality of reference fingerprints so as to identify the received sequence of media content. The media system sends a request for identification of additional content to a server system. The request is based at least in part on the comparison fingerprint. The media system receives a response to the request, including information enabling additional content to be selected for display at the media system based at least in part on the identification of the received sequence of media content, and presents a displayed sequence of media content that includes at least a portion of the received sequence of media content and at least a portion of the additional content.
1. A method comprising:
receiving, by a computing system, a query fingerprint for comparison with a plurality of reference fingerprints, wherein the query fingerprint represents media content being received by a client device;
determining, by the computing system, a usage history of the client device, wherein the determining the usage history of the client device comprises identifying a type of media content based on an extent to which the client device has received the type of media content;
using, by the computing system, the determined usage history as a basis to select a first subset of the plurality of reference fingerprints, wherein using the determined usage history as a basis to select the first subset of the plurality of reference fingerprints comprises selecting the first subset of the plurality of reference fingerprints based on the reference fingerprints of the first subset corresponding to the identified type of media content; and
performing, by the computing system, a first fingerprint comparison process comprising:
(i) comparing the query fingerprint to the first subset of the plurality of reference fingerprints;
(ii) determining that the comparison to the first subset does not result in a match between the query fingerprint and one of the reference fingerprints of the first subset; and
(iii) responsive to determining that the comparison to the first subset does not result in a match between the query fingerprint and one of the reference fingerprints of the first subset, performing, by the computing system, a second fingerprint comparison process comprising:
(a) comparing the query fingerprint to a second subset of the plurality of reference fingerprints, wherein the second subset is different from the first subset;
(b) identifying a match between the query fingerprint and one of the reference fingerprints of the second subset; and
(c) using the one of the reference fingerprints of the second subset to identify the media content being received by the client device.
2. The method of claim 1 , wherein:
determining the usage history of the client device further comprises identifying one or more channels based on an extent to which the client device has tuned to the one or more channels; and
using the determined usage history as a basis to select the first subset of the plurality of reference fingerprints further comprises selecting the first subset of the plurality of reference fingerprints based on the reference fingerprints of the first subset corresponding to the identified one or more channels.
3. The method of claim 2 , wherein comparing the query fingerprint to the second subset of the plurality of reference fingerprints comprises comparing the query fingerprint to reference fingerprints that do not correspond to the identified one or more channels.
4. The method of claim 1 , wherein comparing the query fingerprint to the second subset of the plurality of reference fingerprints comprises comparing the query fingerprint to reference fingerprints that do not correspond to the identified type of media content.
5. The method of claim 1 , wherein:
identifying the type of media content comprises identifying a movie or television show based on an extent to which the client device has received the movie or television show;
using the determined usage history as a basis to select the first subset of the plurality of reference fingerprints comprises selecting the first subset of the plurality of reference fingerprints based on the reference fingerprints of the first subset corresponding to the identified movie or television show; and
comparing the query fingerprint to the second subset of the plurality of reference fingerprints comprises comparing the query fingerprint to reference fingerprints that do not correspond to the identified movie or television show.
6. The method of claim 1 , further comprising:
responsive to identifying the media content being received by the client device, sending, by the computing system to the client device, a third subset of the plurality of reference fingerprints, wherein the third subset of the plurality of reference fingerprints corresponds to the identified media content being received by the client device.
7. The method of claim 1 , further comprising:
using, by the computing system, the identified media content being received by the client device as a basis for selecting additional media content; and
causing, by the computing system, the additional media content to be sent to the client device for presentation.
8. The method of claim 7 , wherein identifying the media content being received by the client device comprises identifying a reference position within the identified media content, and wherein the computing system further uses the identified reference position as a basis for selecting the additional media content.
9. The method of claim 7 , wherein the additional media content comprises at least one of (i) replacement media content to replace a portion of the identified media content being received by the client device or (ii) supplemental media content to be overlaid on a portion of the identified media content being received by the client device.
10. A non-transitory computer-readable storage medium having stored thereon program instructions that, when executed by one or more processors of a computing system, cause the computing system to perform operations comprising:
receiving a query fingerprint for comparison with a plurality of reference fingerprints, wherein the query fingerprint represents media content being received by a client device;
determining a usage history of the client device, wherein the determining the usage history of the client device comprises identifying a type of media content based on an extent to which the client device has received the type of media content;
using the determined usage history as a basis to select a first subset of the plurality of reference fingerprints, wherein using the determined usage history as a basis to select the first subset of the plurality of reference fingerprints comprises selecting the first subset of the plurality of reference fingerprints based on the reference fingerprints of the first subset corresponding to the identified type of media content; and
performing a first fingerprint comparison process comprising:
(i) comparing the query fingerprint to the first subset of the plurality of reference fingerprints;
(ii) determining that the comparison to the first subset does not result in a match between the query fingerprint and one of the reference fingerprints of the first subset; and
(iii) responsive to determining that the comparison to the first subset does not result in a match between the query fingerprint and one of the reference fingerprints of the first subset, performing, by the computing system, a second fingerprint comparison process comprising:
(a) comparing the query fingerprint to a second subset of the plurality of reference fingerprints, wherein the second subset is different from the first subset;
(b) identifying a match between the query fingerprint and one of the reference fingerprints of the second subset; and
(c) using the one of the reference fingerprints of the second subset to identify the media content being received by the client device.
11. The non-transitory computer-readable storage medium of claim 10 , wherein:
determining the usage history of the client device further comprises identifying one or more channels based on an extent to which the client device has tuned to the one or more channels; and
using the determined usage history as a basis to select the first subset of the plurality of reference fingerprints further comprises selecting the first subset of the plurality of reference fingerprints based on the reference fingerprints of the first subset corresponding to the identified one or more channels.
12. The non-transitory computer-readable storage medium of claim 11 , wherein comparing the query fingerprint to the second subset of the plurality of reference fingerprints comprises comparing the query fingerprint to reference fingerprints that do not correspond to the identified one or more channels.
13. The non-transitory computer-readable storage medium of claim 10 , wherein comparing the query fingerprint to the second subset of the plurality of reference fingerprints comprises comparing the query fingerprint to reference fingerprints that do not correspond to the identified type of media content.
14. The non-transitory computer-readable storage medium of claim 10 , wherein:
identifying the type of media content comprises identifying a movie or television show based on an extent to which the client device has received the movie or television show;
using the determined usage history as a basis to select the first subset of the plurality of reference fingerprints comprises selecting the first subset of the plurality of reference fingerprints based on the reference fingerprints of the first subset corresponding to the identified movie or television show; and
comparing the query fingerprint to the second subset of the plurality of reference fingerprints comprises comparing the query fingerprint to reference fingerprints that do not correspond to the identified movie or television show.
15. The non-transitory computer-readable storage medium of claim 10 , the operations further comprising:
responsive to identifying the media content being received by the client device, sending, to the client device, a third subset of the plurality of reference fingerprints, wherein the third subset of the plurality of reference fingerprints corresponds to the identified media content being received by the client device.
16. The non-transitory computer-readable storage medium of claim 10 , the operations further comprising:
using the identified media content being received by the client device as a basis for selecting additional media content; and
causing the additional media content to be sent to the client device for presentation.
17. The non-transitory computer-readable storage medium of claim 16 , wherein identifying the media content being received by the client device comprises identifying a reference position within the identified media content, and wherein the computing system further uses the identified reference position as a basis for selecting the additional media content.
18. The non-transitory computer-readable storage medium of claim 16 , wherein the additional media content comprises at least one of (i) replacement media content to replace a portion of the identified media content being received by the client device or (ii) supplemental media content to be overlaid on a portion of the identified media content being received by the client device.
19. A computing system comprising one or more processors and a non-transitory computer-readable storage medium having stored thereon program instructions that, when executed by the one or more processors, cause the computing system to perform operations comprising:
receiving a query fingerprint for comparison with a plurality of reference fingerprints, wherein the query fingerprint represents media content being received by a client device;
determining a usage history of the client device, wherein the determining the usage history of the client device comprises identifying a type of media content based on an extent to which the client device has received the type of media content;
using the determined usage history as a basis to select a first subset of the plurality of reference fingerprints, wherein using the determined usage history as a basis to select the first subset of the plurality of reference fingerprints comprises selecting the first subset of the plurality of reference fingerprints based on the reference fingerprints of the first subset corresponding to the identified type of media content; and
performing a first fingerprint comparison process comprising:
(i) comparing the query fingerprint to the first subset of the plurality of reference fingerprints;
(ii) determining that the comparison to the first subset does not result in a match between the query fingerprint and one of the reference fingerprints of the first subset; and
(iii) responsive to determining that the comparison to the first subset does not result in a match between the query fingerprint and one of the reference fingerprints of the first subset, performing, by the computing system, a second fingerprint comparison process comprising:
(a) comparing the query fingerprint to a second subset of the plurality of reference fingerprints, wherein the second subset is different from the first subset;
(b) identifying a match between the query fingerprint and one of the reference fingerprints of the second subset; and
(c) using the one of the reference fingerprints of the second subset to identify the media content being received by the client device.
20. The computing system of claim 19 , wherein:
determining the usage history of the client device further comprises identifying one or more channels based on an extent to which the client device has tuned to the one or more channels; and
using the determined usage history as a basis to select the first subset of the plurality of reference fingerprints further comprises selecting the first subset of the plurality of reference fingerprints based on the reference fingerprints of the first subset corresponding to the identified one or more channels.
21. The computing system of claim 20 , wherein comparing the query fingerprint to the second subset of the plurality of reference fingerprints comprises comparing the query fingerprint to reference fingerprints that do not correspond to the identified one or more channels.
22. The computing system of claim 19 , wherein comparing the query fingerprint to the second subset of the plurality of reference fingerprints comprises comparing the query fingerprint to reference fingerprints that do not correspond to the identified type of media content.
23. The computing system of claim 19 , wherein:
identifying the type of media content comprises identifying a movie or television show based on an extent to which the client device has received the movie or television show;
using the determined usage history as a basis to select the first subset of the plurality of reference fingerprints comprises selecting the first subset of the plurality of reference fingerprints based on the reference fingerprints of the first subset corresponding to the identified movie or television show; and
comparing the query fingerprint to the second subset of the plurality of reference fingerprints comprises comparing the query fingerprint to reference fingerprints that do not correspond to the identified movie or television show.
24. The computing system of claim 19 , the operations further comprising:
responsive to identifying the media content being received by the client device, sending, to the client device, a third subset of the plurality of reference fingerprints, wherein the third subset of the plurality of reference fingerprints corresponds to the identified media content being received by the client device.
25. The computing system of claim 19 , the operations further comprising:
using the identified media content being received by the client device as a basis for selecting additional media content; and
causing the additional media content to be sent to the client device for presentation.
26. The computing system of claim 25 , wherein identifying the media content being received by the client device comprises identifying a reference position within the identified media content, and wherein the computing system further uses the identified reference position as a basis for selecting the additional media content.
27. The computing system of claim 25 , wherein the additional media content comprises at least one of (i) replacement media content to replace a portion of the identified media content being received by the client device or (ii) supplemental media content to be overlaid on a portion of the identified media content being received by the client device.