Method and device for generating and detecting a fingerprint functioning as a trigger marker in a multimedia signal

1. A non-transitory machine-readable storage medium having stored thereon, program instructions that when executed by a processor of a machine, cause the machine to perform operations comprising:

playing multimedia content on a multimedia playback device;

during the playback of the multimedia content by the multimedia playback device, repeatedly deriving, by the multimedia playback device, fingerprints from respective segments of the multimedia content;

comparing the derived fingerprints to one or more reference fingerprints representing features of the multimedia content, wherein each reference fingerprint is associated with an action;

determining that one of the derived fingerprints matches one of the one or more reference fingerprints; and

in response to determining that the one of the derived fingerprints matches the one of the one or more reference fingerprints, causing execution of the action associated with the one of the one or more reference fingerprints,

wherein the action to be executed is associated with a time point indicating when, in the multimedia content, the action is to be executed.

2. The non-transitory machine-readable storage medium of claim 1 , wherein the multimedia playback device comprises a display, and

wherein playing the multimedia content on the multimedia playback device comprises displaying at least some of the multimedia content on the display.

3. The non-transitory machine-readable storage medium of claim 1 , wherein the multimedia playback device comprises a speaker, and

wherein playing multimedia content on the multimedia playback device comprises playing at least some of the multimedia content via the speaker.

4. The non-transitory machine-readable storage medium of claim 1 , wherein the action to be executed comprises at least one action in the group consisting of:

retrieving and displaying additional information on a display; and

retrieving and playing additional information via a speaker.

5. The non-transitory machine-readable storage medium of claim 1 , wherein the action to be executed comprises playing another multimedia content instead of the multimedia content for a period of time.

6. The non-transitory machine-readable storage medium of claim 1 , wherein the action to be executed comprises at least one action in the group consisting of:

presenting biography data for an actor appearing in the multimedia content;

presenting a link to a website;

playing a local weather forecast;

playing a local commercial;

executing a control command; and

preparing the playback device to receive a user input.

7. The non-transitory machine-readable storage medium of claim 1 , wherein the operations further comprise:

receiving, by the multimedia playback device, the reference fingerprints;

storing the received reference fingerprints in the non-transitory machine readable storage medium for comparison with the derived fingerprints;

receiving, by the multimedia playback device, for each of the received reference fingerprints, representations of the action with which the received reference fingerprint is associated; and

storing each of the received representations in association with its respectively associated reference fingerprint.

8. A non-transitory machine-readable storage medium having stored thereon, program instructions that when executed by a processor of a machine, cause the machine to perform operations comprising:

receiving, by a signal receiver of a media playback device, a first media stream;

playing, on at least one of a display or a speaker associated with the media playback device, the first media stream;

determining, by the processor of the machine, a trigger fingerprint from a segment of the first media stream, wherein the trigger fingerprint is a representation of features of the segment;

matching the trigger fingerprint to a reference fingerprint, wherein the reference fingerprint is stored in a database of reference fingerprints and is associated with a reference action, and wherein the reference action instructs the media playback device to replace playback of the first media stream with playback of a second media stream, wherein the reference action is associated with a time point indicating when, in the first media stream, the reference action is to be performed; and

responsive to matching the trigger fingerprint to the reference fingerprint, playing, on the at least one of the display or the speaker associated with the media playback device, the second media stream in place of the first media stream.

9. The non-transitory machine-readable storage medium of claim 8 , wherein playing of the second media stream in place of the first media stream occurs at the time point.

10. The non-transitory machine-readable storage medium of claim 8 , wherein the trigger fingerprint is one of a plurality of trigger fingerprints determined from respective segments of the first media stream.

11. The non-transitory machine-readable storage medium of claim 8 , wherein the operations further comprise:

before determining the trigger fingerprint, receiving, by the media playback device, a plurality of reference fingerprints that includes the matched reference fingerprint;

storing the received reference fingerprints at the media playback device for comparison with the trigger fingerprint;

receiving, by the media playback device, for each of the received reference fingerprints, representations of one or more actions with which the received reference fingerprint is associated; and

storing each of the received representations in association with its respectively associated reference fingerprint.

12. The non-transitory machine-readable storage medium of claim 8 , wherein playing, on the at least one of a display or a speaker associated with the media playback device, the first media stream comprises playing the first media stream on the display, and

wherein playing, on the at least one of the display or the speaker associated with the media playback device, the second media stream in place of the first media stream comprises playing, on the speaker, the second media stream in place of the first media stream.

13. The non-transitory machine-readable storage medium of claim 8 , wherein playing, on the at least one of a display or a speaker associated with the media playback device, the first media stream comprises playing the first media stream on the display, and

wherein playing, on the at least one of the display or the speaker associated with the media playback device, the second media stream in place of the first media stream comprises playing, on the display, the second media stream in place of the first media stream.

14. A non-transitory machine-readable storage medium having stored thereon, program instructions that when executed by a processor of a machine, cause the machine to perform operations comprising:

accessing, by the processor, a plurality of reference fingerprints generated from respective segments of multimedia content, each of the reference fingerprints being associated with a corresponding action;

determining that a trigger fingerprint generated by a multimedia playback device matches a particular reference fingerprint of the plurality of reference fingerprints, wherein the particular reference fingerprint is associated with a particular action; and

transmitting, by the processor, a representation of the particular action to a recipient device,

wherein reception of the representation of the particular action causes the recipient device to perform the particular action,

wherein the particular action is associated with a time point indicating when, in the multimedia content, the particular action is to be performed.

15. The non-transitory machine-readable storage medium of claim 14 , wherein the operations further comprise:

generating, by the processor, the plurality of reference fingerprints from the respective segments of multimedia content; and

storing, by the processor, the plurality of reference fingerprints and the corresponding action in association in a memory device.

16. The non-transitory machine-readable storage medium of claim 15 , wherein the particular reference fingerprint is also associated with a time point in the multimedia content,

wherein the time point is also stored in the memory, and

wherein the particular action is performed at the time point in the multimedia content associated with the particular reference fingerprint.

17. The non-transitory machine-readable storage medium of claim 14 , wherein the particular action comprises displaying information related to the segment of multimedia content from which the particular reference fingerprint was generated.

18. The non-transitory machine-readable storage medium of claim 14 , wherein the performance of the particular action occurs during playback, by the multimedia playback device, of the segment of multimedia content associated with the particular reference fingerprint.

19. The non-transitory machine-readable storage medium of claim 14 , wherein the recipient device is the multimedia playback device.

20. The non-transitory machine-readable storage medium of claim 14 , wherein the operations further comprise sending, to the multimedia playback device, the plurality of reference fingerprints.