Method and device for generating and detecting a fingerprint functioning as a trigger marker in a multimedia signal
View Patent ↗This invention relates to a device and a method of relating one or more trigger actions with a multimedia signal and corresponding method and device for detecting one or more trigger actions in a multimedia signal. One fingerprint is generated on the basis of a segment of the multimedia signal at each trigger time point. The generated fingerprint(s) is stored in a database and communicated to playback devices. During playback fingerprints of the multimedia signal are generated and matched against fingerprints in the database. When a match is found, associated trigger actions is retrieved. The trigger time point is determined as a time point near or at a segment of the multimedia signal that caused a fingerprint to match. In this way, a simple and reliable way of detecting trigger markers for trigger actions is enabled without modifying the multimedia signal.
1. A method comprising:
providing a trigger time point (T n ; T n+1 ) of a plurality of trigger time points within a multimedia signal,
the trigger time point (T n ; T n+1 ) corresponding to a segment of a plurality of segments of the multimedia signal,
the trigger time point (T n ; T n+1 ) corresponding to at least one of a predetermined distance from the start of the segment or a predetermined distance from the end of the segment,
each segment of the plurality of segments being identified by one of the plurality of trigger time points and corresponding to specific content to be shown to a user;
providing a representation of an action that corresponds to the specific content to be shown in the segment of the multimedia signal,
the trigger time point (T n ; T n+1 ) indicating a time point within the multimedia signal at which the action is to be triggered during a playback of the multimedia signal;
deriving a fingerprint based on the segment of the multimedia signal; and
associating the derived fingerprint with the action.
2. The method according to claim 1 , further comprising:
storing at least one of the derived fingerprint or the representation of the action in a first database.
3. The method according to claim 1 , further comprising
transmitting at least one of the derived fingerprint or the representation of the action to a playback device.
4. The method according to claim 1 , wherein
the multimedia signal includes at least one of an audio signal or a video signal.
5. The method according to claim 1 , wherein
the action is selected from a group consisting of:
retrieving and displaying additional information on a display,
retrieving and playing additional information via a speaker,
playing another multimedia signal instead of the multimedia signal for a period of time,
interrupting the playback of the multimedia signal,
executing control commands, and
preparing a system for user inputs.
6. The method according to claim 2 , further comprising
storing at least one of the derived fingerprint or the representation of the action in a second database; and wherein
the derived fingerprint is at least one of an audio fingerprint or a video fingerprint.
7. A device comprising:
a fingerprint module implemented in hardware, the fingerprint module being configured to:
provide a trigger time point (T n ; T n+1 ) of a plurality of trigger time points within a multimedia signal,
the trigger time point (T n ; T n+1 ) corresponding to a segment of a plurality of segments of the multimedia signal,
the trigger time point (T n ; T n+1 ) corresponding to at least one of a predetermined distance from the start of the segment or a predetermined distance from the end of the segment,
each segment of the plurality of segments being identified by one of the plurality of trigger time points and corresponding to specific content to be shown to a user; and
provide a representation of an action that corresponds to the specific content to be shown in the segment of the multimedia signal,
the trigger time point (T n ; T n+1 ) indicating a time point within the multimedia signal at which the action is to be triggered during a playback of the multimedia signal; and
derive a fingerprint based on the segment of the multimedia signal; and
a database module configured to associate the derived fingerprint with the action.
8. The device according to claim 7 , further comprising:
a first database to store at least one of the derived fingerprint or the representation of the action.
9. The device according to claim 7 , further comprising:
a transmitter to transmit at least one of the derived fingerprint or the representation of the action to a playback device.
10. The device according to claim 7 , wherein
the multimedia signal includes at least one of an audio signal or a video signal.
11. The device according to claim 7 , wherein
the action is selected from a group consisting of:
retrieving and displaying additional information on a display,
retrieving and playing additional information via a speaker,
playing another multimedia signal instead of the multimedia signal for a period of time,
interrupting the playback of the multimedia signal,
executing control commands, and
preparing the device for user inputs.
12. The device according to claim 8 , further comprising
a second database to store at least one of the derived fingerprint or the representation of the action; and wherein
the derived fingerprint is at least one of an audio fingerprint or a video fingerprint.
13. A non-transitory computer readable storage medium comprising instructions that, when executed, cause one or more processors to execute operations comprising:
providing a trigger time point (T n ; T n+1 ) of a plurality of trigger time points within a multimedia signal,
the trigger time point (T n ; T n+1 ) corresponding to a segment of a plurality of segments of the multimedia signal,
the trigger time point (T n ; T n+1 ) corresponding to at least one of a a predetermined distance from the start of the segment or a predetermined distance from the end of the segment,
each segment of the plurality of segments being identified by one of the plurality of trigger time points and corresponding to specific content to be shown to a user;
providing a representation of an action that corresponds to the specific content to be shown by the segment of the multimedia signal,
the trigger time point (T n ; T n+1 ) indicating a time point within the multimedia signal at which the action is to be triggered during a playback of the multimedia signal;
deriving a fingerprint based on the segment of the multimedia signal; and
associating the derived fingerprint with the action.