Method and device for generating and detecting a fingerprint functioning as a trigger marker in a multimedia signal

1. A method comprising:

playing back multimedia content on a multimedia playback device, including providing at least some of the multimedia content on a display associated with the multimedia playback device;

determining, by a processor of the multimedia playback device, a trigger fingerprint from a segment of the multimedia content being played back on the multimedia playback device;

accessing a plurality of reference fingerprints, each reference fingerprint among the plurality of reference fingerprints having been previously derived from a respective segment of the multimedia content and associated with at least one corresponding reference action;

obtaining a match between the trigger fingerprint and a particular reference fingerprint among the plurality of reference fingerprints;

identifying a particular corresponding reference action associated with the particular reference fingerprint, the particular corresponding reference action being associated with a time point indicating when, in the multimedia content, the particular corresponding reference action is to be performed; and

performing, by the processor of the multimedia playback device, the particular corresponding reference action, wherein performance of the particular reference action causes the multimedia playback device to provide, on the display associated with the multimedia playback device, information related to the segment of the multimedia content.

2. The method of claim 1 , wherein the trigger fingerprint is a representation of perceptual features of the segment of multimedia content.

3. The method of claim 1 , wherein the identifying of the particular corresponding reference action comprises receiving the particular corresponding reference action from a database.

4. The method of claim 1 , wherein the providing of the information related to the segment of the multimedia content comprises displaying a uniform resource locator (URL) of a web site.

5. The method of claim 1 , wherein the providing of the information related to the segment of the multimedia content comprises displaying biographical data related to an individual represented in the segment of the multimedia content.

6. The method of claim 1 , wherein the providing of the information related to the segment of the multimedia content comprises displaying the information overlaid on the segment of the multimedia content.

7. The method of claim 1 , wherein the providing of the information related to the segment of the multimedia content comprises displaying the information instead of the segment of the multimedia content.

8. The method of claim 1 , wherein the performance of the particular corresponding reference action occurs at the time point.

9. The method of claim 1 , further comprising:

before determining the trigger fingerprint, receiving, by the multimedia playback device, the plurality of reference fingerprints.

10. The method of claim 1 , wherein the trigger fingerprint is one of a plurality of trigger fingerprints determined from respective segments of the multimedia content.

11. A method comprising:

playing back multimedia content on a multimedia playback device, including providing at least some of the multimedia content on a display associated with the multimedia playback device;

during the playback of the multimedia content by the multimedia playback device, repeatedly deriving, by the multimedia playback device, fingerprints from respective segments of the multimedia content;

comparing the derived fingerprints to reference fingerprints representing features of the multimedia content, each reference fingerprint associated with one or more actions;

determining that one of the derived fingerprints matches one of the reference fingerprints; and

in response to the determining that the one of the derived fingerprints matches the one of the reference fingerprints, causing execution of an action associated with the one of the reference fingerprints, the action being associated with a time point indicating when, in the multimedia content, the action is to be performed.

12. The method of claim 11 , wherein each reference fingerprint is also associated with a respective time point in the multimedia content, and wherein the causing of the execution of the action causes the action to be executed at the time point in the multimedia content associated with the one of the reference fingerprints.

13. The method of claim 11 , wherein the causing of the execution of the action comprises providing information related to the multimedia content.

14. The method of claim 11 , further comprising:

in response to the determining that the one of the derived fingerprints matches the one of the reference fingerprints, receiving a representation of the action from a database.

15. The method of claim 11 , further comprising:

identifying the action associated with the one of the reference fingerprints.

16. The method of claim 11 , further comprising:

receiving, by the multimedia playback device, the reference fingerprints; and

storing the received reference fingerprints at the multimedia playback device for comparison with the derived fingerprints.

17. The method of claim 16 , further comprising:

receiving, by the multimedia playback device, for each of the received reference fingerprints, representations of the one or more actions with which the received reference fingerprint is associated; and

storing each of the received representations in association with its respectively associated reference fingerprint.

18. The method of claim 11 , wherein the causing of the execution of the action comprises causing the multimedia playback device to execute the action.

19. A multimedia playback device comprising:

a multimedia signal receiver configured to receive multimedia content;

a display configured to provide at least some of the received multimedia content on the display during playback of the multimedia content; and

a fingerprint detector configured to:

derive fingerprints from respective segments of the multimedia content during playback of the multimedia content;

compare the derived fingerprints to reference fingerprints representing perceptual features of the multimedia content, each reference fingerprint associated with one or more actions;

determine that one of the derived fingerprints matches one of the reference fingerprints; and

in response to the determining that the one of the derived fingerprints matches the one of the reference fingerprints, cause execution of an action associated with the one of the reference fingerprints, the action being associated with a time point indicating when, in the multimedia content, the action is to be performed.

20. The multimedia playback device of claim 19 , wherein each reference fingerprint is also associated with a respective time point in the multimedia content, and wherein the causing of the execution of the action causes the action to be executed at the time point in the multimedia content associated with the one of the reference fingerprints.

21. The multimedia playback device of claim 19 , further comprising:

a receiver configured to receive the reference fingerprints; and

a database configured to store the received reference fingerprints for comparison with the derived fingerprints.

22. The multimedia playback device of claim 21 , wherein:

the receiver is further configured to receive, for each of the received reference fingerprints, representations of the one or more actions with which the received reference fingerprint is associated; and

the database is further configured to store each of the received representations in association with its respectively associated reference fingerprint.

23. The multimedia playback device of claim 21 , wherein the causing of the execution of the action comprises causing the multimedia playback device to execute the action.

24. A method comprising:

generating, by a processor, a plurality of reference fingerprints from respective segments of multimedia content, each of the reference fingerprints being associated with a corresponding action;

storing, by the processor, the plurality of reference fingerprints and the associations in a memory;

determining that a trigger fingerprint generated by a multimedia playback device matches a particular reference fingerprint of the plurality of reference fingerprints, wherein the particular reference fingerprint is associated with a particular action; and

transmitting, by the processor, a representation of the particular action to a recipient device, wherein reception of the representation of the particular action causes the recipient device to perform the particular action, the particular action being associated with a time point indicating when, in the multimedia content, the particular action is to be performed.

25. The method of claim 24 , wherein the particular reference fingerprint is also associated with a time point in the multimedia content, wherein the time point is also stored in the memory, and wherein the particular action is performed at the time point in the multimedia content associated with the particular reference fingerprint.

26. The method of claim 24 , wherein the particular action involves displaying information related to the segment of multimedia content from which the particular reference fingerprint was generated.

27. The method of claim 24 , wherein the execution of the particular action occurs during playback, by the multimedia playback device, of the segment of multimedia content associated with the reference fingerprint.

28. The method of claim 24 , wherein the recipient device is the multimedia playback device.

29. The method of claim 24 , further comprising:

sending, to the multimedia playback device, the plurality of reference fingerprints.