Method and system for synchronizing vibro-kinetic effects to a virtual reality session
A method for synchronizing an output of a motion signal with a virtual reality program being played comprises mixing a multi-channel audio output of the virtual reality program into at least one mixed audio track. A time position of the virtual reality program being played is obtained using the at least one mixed audio track. A motion signal corresponding to virtual reality program being played and synchronized with the identified time position of the virtual reality program being played is obtained, the motion signal comprising motion platform actuator-driving instructions. The motion signal is output to an actuation system of a motion platform for producing vibro-kinetic effects in the motion platform corresponding to and synchronized with the virtual reality program being played. A motion controller for synchronizing an output of a motion signal with a virtual reality program being played is also provided.
1. A motion controller for synchronizing an output of a motion signal with a virtual reality program being played, comprising:
an audio mixing module for mixing a multi-channel audio output of the virtual reality program into at least one mixed audio track;
an identifier module for obtaining a time position of the virtual reality program being played using the at least one mixed audio track; and
a motion providing module for obtaining a motion signal corresponding to the virtual reality program being played and synchronized with the identified time position of the virtual reality program being played, the motion signal comprising motion platform actuator-driving instructions, and for outputting the motion signal to an actuation system of a motion platform for producing vibro-kinetic movements corresponding to and synchronized with the virtual reality program being played.
2. The motion controller according to claim 1 , wherein the audio mixing module mixes the multi-channel audio output into a monophonic audio signal.
3. The motion controller according to claim 1 , wherein the audio mixing module receives the multi-channel audio output from a headphone jack of a mobile virtual reality processor.
4. The motion controller according to claim 1 , wherein the audio mixing module receives the multi-channel audio output wirelessly from a transmission by the mobile virtual reality processor.
5. The motion controller according to claim 1 , wherein the audio mixing module uses weighted-sum mixing in which
M=w 1* C 1+ w 2* C 2+ . . . + wn*Cn
wherein M is the mixed audio track, Cn are the channels and w is the weight.
6. The motion controller according to claim 1 , wherein the audio mixing module filters human voices out of the mixed audio output.
7. The motion controller according to claim 1 , wherein the audio mixing module excludes at least some channels of the multi-channel audio output from the at least one mixed audio track.
8. The motion controller according to claim 1 , wherein the audio mixing module mixes at least two mixed audio tracks, with each said at least two mixed audio track having an own mixing variation, wherein identifier module and the motion providing module use the at least two mixed audio tracks.
9. The motion controller according to claim 8 , wherein the audio mixing module mixes the at least two mixed audio tracks from different channel combinations of the multi-channel audio output.
10. The motion controller according to claim 1 , wherein the identifier module obtains the identity of the virtual reality program being played, and subsequently receives the time position of the virtual reality program.
11. The motion controller according to claim 1 , wherein the identifier module computes a fingerprint of the at least one mixed audio track.
12. The motion controller according to claim 11 , wherein the identifier module applies a fingerprinting technique to generate the fingerprint as a coded identifier uniquely representative of the mixed audio track at the time position.
13. The motion controller according to claim 11 , wherein the identifier module consults a database of reference fingerprints to which are associated time positions and retrieves the time position that corresponds to the computed fingerprint.
14. The motion controller according to claim 13 , wherein consulting the database of reference fingerprints comprises consulting the database of reference fingerprint locally.
15. The motion controller according to claim 1 , wherein the motion controller continuously obtains the time position, obtains the motion signal and outputs the motion signal, thereby ensuring continuous synchronization of the motion signal.
16. The motion controller according to claim 1 , wherein the motion providing module obtains the motion signal associated with the time position a remote networked server.
17. The motion controller according to claim 1 , further comprising a driving module for driving actuators of the motion platform with the motion signal.