Media recognition and synchronization to a motion signal
The present document describes a device and method for synchronizing a motion signal corresponding to a media content with a media signal for the media content, the motion signal being for controlling a motion feedback system. The method comprises: receiving a portion of the media signal; obtaining a fingerprint corresponding to the received portion of the media signal; from reference fingerprints associated with time positions of at least one reference media content, identifying a reference time position of the media content corresponding to the obtained fingerprint; obtaining the motion signal associated with the identified reference time position of the media content; and outputting the motion signal synchronized with the media signal using the identified reference time position of the media content for controlling the motion feedback system.
1. A method for synchronizing a viewer-effect signal corresponding to a media content with a media signal for the media content, the viewer-effect signal associated to the media content, the viewer-effect signal for producing an effect for a viewer, the method comprising:
receiving an identity of at least one reference media content;
receiving a portion of the media signal to which the reference media content corresponds;
obtaining a fingerprint corresponding to the received portion of the media signal;
from reference fingerprints associated with time positions of the at least one reference media content, identifying a reference time position of the media content corresponding to the obtained fingerprint;
obtaining the viewer-effect signal associated with the identified reference time position of the media content; and
outputting the viewer-effect signal synchronized with the media signal using the identified reference time position of the media content for producing the effect in synchronization with the media content.
2. The method of claim 1 , wherein the step of identifying a reference time position of the media content is performed using reference fingerprints associated with time positions of the identified reference media content.
3. The method of claim 2 , further comprising receiving at least one reference fingerprint associated with the outputted viewer-effect signal and stopping the output of the viewer-effect signal when the obtained fingerprint does not match any of the at least one reference fingerprint.
4. The method of claim 1 , further comprising receiving at least one reference fingerprint associated with the outputted viewer-effect signal and stopping the outputting the viewer-effect signal when the obtained fingerprint does not match any of the at least one reference fingerprint.
5. The method of claim 1 , wherein the media signal comprises at least one of an audio signal and a video signal.
6. The method of claim 5 , wherein the media content comprises a feature length movie and the audio signal and the video signal comprise the audio signal and the video signal for a feature length movie.
7. The method of claim 1 , wherein the obtaining a fingerprint corresponding to the received portion of the media signal comprises computing the fingerprint of the received portion of the media signal.
8. The method of claim 7 , wherein the computing the fingerprint comprises applying a media fingerprinting technique to generate the fingerprint as a coded identifier uniquely representative of the media content at the reference time position.
9. The method of claim 8 , wherein the identifying a reference time position of the media content comprises consulting a database comprising coded identifiers for the reference fingerprints to which are associated reference time positions and obtaining the reference time position that corresponds to the coded identifier uniquely representative of the media content at the reference time position.
10. The method of claim 1 , wherein the identifying the reference time position comprises continuously performing the obtaining a fingerprint, the identifying a reference time position, and the obtaining the viewer-effect signal steps to keep outputting the stream of viewer-effect signal synchronized with the media signal, thereby ensuring continuous synchronization of the viewer-effect signal.
11. The method of claim 1 , wherein the identifying the reference time position comprises performing the obtaining a fingerprint, the identifying a reference time position, and the obtaining the viewer-effect signal at a given frequency to resynchronize the outputting the viewer-effect signal with the media signal.
12. The method of claim 1 , further comprising receiving a viewer-effect signal corresponding to the media content prior to the identifying a reference time position of the media content, wherein the reference fingerprints are retrieved directly from the received viewer-effect signal.
13. The method of claim 1 , wherein the identifying a reference time position of the media content takes place on a remote networked server.
14. The method of claim 1 , wherein the viewer-effect signal associated with the identified reference time position of the media content is obtained from a remote networked server.
15. The method of claim 1 , wherein the method is performed with the viewer-effect signal being a motion signal, the motion signal for controlling a motion feedback system in synchronization with the media content.
16. The method of claim 1 , wherein the method is performed with the viewer-effect signal being a visual signal, and further comprising displaying the visual signal in synchronization with the media content.
17. The method of claim 16 , wherein displaying the visual signal in synchronization with the media content includes displaying subtitles.
18. The method of claim 1 , wherein the method is performed with the viewer-effect signal being an additional audio signal, and further comprising emitting the additional audio signal for the viewer in synchronization with the media content.
19. The method of claim 18 , wherein emitting the additional audio signal for the viewer in synchronization with the media content includes emitting an alternative language track.
20. The method of claim 18 , wherein emitting the additional audio signal for the viewer in synchronization with the media content includes emitting a track for visual impairment.
21. The method of claim 1 , wherein outputting the viewer-effect signal includes outputting a continuous viewer-effect signal.
22. The method of claim 1 , wherein receiving a portion of the media signal includes receiving the portion of the media signal with at least one microphone.
23. A method for determining if a viewer-effect signal corresponding to a media content is synchronized to a media signal for the media content, the viewer-effect signal for producing an effect for a viewer, the method comprising:
receiving an identity of at least one reference media content;
receiving a portion of the media signal to which the reference media content corresponds;
obtaining a fingerprint of the received portion of the media signal, namely an obtained fingerprint;
retrieving a fingerprint of the media signal at a reference time position of the reference media content based on a current time position of the viewer-effect signal, namely a reference fingerprint;
comparing the obtained fingerprint and the reference fingerprint;
based on the comparing, determining if the viewer-effect signal is synchronized to the media signal; and
according to the determining, outputting the viewer-effect signal synchronized with the media signal for producing the effect in synchronization with the media content.
24. The method of claim 23 , wherein the reference fingerprint is retrieved from a database comprising reference fingerprints associated with time positions for the media content.
25. The method of claim 23 , wherein the reference fingerprint is retrieved directly from the viewer-effect signal.
26. The method of claim 23 , wherein the method is performed with the viewer-effect signal being a motion signal, the motion signal for controlling a motion feedback system in synchronization with the media content.