Method, apparatus and system for synchronizing audiovisual content with inertial measurements
View Patent ↗A method, apparatus and system for synchronizing audiovisual content with inertial outputs for content reproduced on a mobile content device include, in response to a vibration of the mobile content device, receiving a recorded audio signal and a corresponding recorded inertial signal generated by the vibration. The recorded signals are each processed to determine a timestamp for a corresponding peak in each of the recorded signals. A time distance between the timestamp of the recorded audio signal and the timestamp of the recorded inertial signal is determine and inertial signals for content reproduced on the mobile content device are shifted by an amount of time equal to the determined time distance between the timestamp of the recorded audio signal and the timestamp of the recorded inertial signal.
1. A method for synchronizing audiovisual content with inertial measurements associated with timestamps on a mobile device recording the audiovisual content, said audiovisual content comprising a synchronized audio track, comprising:
in response to a vibration of the mobile device, recording an audio signal within the audio track and an inertial signal within the inertial measurements, both being generated by said vibration;
processing the recorded audio signal to determine a first timestamp for a peak in the audio signal;
processing the recorded inertial signal to determine a second timestamp for a peak in the inertial signal;
determining a time distance between the first timestamp and the second timestamp; and
adjusting timestamps of the inertial signal by said time distance causing the synchronization of audiovisual content with inertial measurements.
2. The method of claim 1 , wherein said vibration of the mobile is caused by built-in vibrator of the mobile device.
3. The method of claim 1 , wherein said inertial signal comprises an acceleration signal.
4. The method of claim 1 , wherein said inertial signal comprises a signal from a gyroscope.
5. The method of claim 1 , wherein said inertial signal comprises a signal from a magnetometer.
6. The method of claim 1 , wherein the inertial signal is recorded in a file and the file is emptied before a new inertial signal is received.
7. The method of claim 1 , wherein said vibration is caused by a user touching the mobile device to begin a recording process.
8. An apparatus for synchronizing audiovisual content with inertial measurements associated with timestamps on a mobile device recording the audiovisual content, said audiovisual content comprising a synchronized audio track, comprising a memory associated with a processor configured to:
in response to a vibration of the mobile device, record an audio signal and a corresponding inertial signal generated by said vibration;
process the recorded audio signal to determine a first timestamp for a peak in the audio signal;
process the recorded inertial signal to determine a second timestamp for a peak in the inertial signal;
determine a time distance between the first timestamp and the second timestamp; and
adjust timestamps of the inertial signal by said time distance causing the synchronization of audiovisual content with inertial measurements.
9. The apparatus of claim 8 , wherein said processor is further configured to cause the mobile device to vibrate.
10. The apparatus of claim 8 , wherein said inertial signal comprises an acceleration signal.
11. The apparatus of claim 8 , wherein said inertial signal comprises a signal from a gyroscope.
12. The apparatus of claim 8 , wherein said inertial signal comprises a signal from a magnetometer.
13. The apparatus of claim 8 , wherein the inertial signal is recorded in a file and the file is emptied before a new inertial signal is received.
14. The apparatus of claim 8 , wherein said vibration is caused by a user touching the mobile content device to begin a recording process.
15. A system for synchronizing audiovisual content with inertial measurements associated with timestamps on a mobile device recording the audiovisual content, said audiovisual content comprising a synchronized audio track, comprising:
a vibrator configured to vibrate the mobile device;
an audio recorder configured to record an audio signal in response to a vibration of the mobile device;
an inertial signal recorder configured to record a corresponding inertial signal in response to the vibration of the mobile device; and
an apparatus comprising a memory for storing at least one of program routines, audio signal data and inertial signal data and a processor for executing said program routines;
the apparatus configured to:
in response to a vibration of the mobile device, record an audio signal within the audio track from said audio recorder and a corresponding inertial signal from said inertial signal recorder;
process the recorded audio signal to determine a first timestamp for a peak in the audio signal;
process the recorded inertial signal to determine a second timestamp for a peak in the inertial signal;
determine a time distance between the first timestamp and the second timestamp; and
adjust timestamps of the inertial signal by said time distance causing the synchronization of audiovisual content with inertial measurements.
16. The system of claim 15 , wherein said system comprises at least one of a group comprising of a tablet, a mobile phone, a computer and a display device.
17. The system of claim 15 , wherein said vibrator comprises a built-in vibrator embedded in the mobile device and is automatically activated just before the recording of said audio signal and the recording of said corresponding inertial signal.
18. The system of claim 15 , wherein said processor is further configured to cause the mobile device to vibrate using said vibrator.
19. The system of claim 15 , wherein said inertial signal comprises an acceleration signal.
20. The system of claim 15 , wherein said inertial signal comprises a signal from a gyroscope.
21. The system of claim 15 , wherein said inertial signal comprises a signal from a magnetometer.
22. The system of claim 15 , wherein said vibration is caused by a user touching the mobile device to begin a recording process.