Audio/video synchronization using a device with camera and microphone
View Patent ↗Methods, systems, and apparatuses are described for performing a calibration process for synchronizing audio signals with video signals. The calibration process may be performed between one or more devices of an entertainment system and a handheld device. Device(s) (e.g., a television and speaker(s)) of the entertainment system are configured to playback video signal(s) and audio signal(s), respectively. The handheld device is configured to determine an amount of synchronization error between the audio signal and the video signal, determine a synchronization correction value based on the determined amount, and provide the synchronization correction value to device(s) of the entertainment system. The device(s) may use the synchronization correction value to correct the delay between the video signal and the audio signal such that the video signal and the audio signal are synchronized.
1. A method in a handheld device, comprising:
performing one or more iterations of a calibration process to obtain a synchronization correction value for synchronizing an audio signal and a video signal, wherein each of the one or more iterations comprises:
determining a first time at which a test frame included in video content representative of the video signal is detected;
determining a second time at which a test tone included in audio content representative of the audio signal is detected;
determining a difference between the first time and the second time to obtain a minimum synchronization correction value; and
combining the minimum synchronization correction value with a frame duration of the test frame to obtain a maximum synchronization correction value;
determining the synchronization correction value based on at least one of the minimum synchronization correction value and the maximum synchronization correction value; and
providing the synchronization correction value to another device.
2. The method of claim 1 , further comprising:
comparing a first minimum synchronization correction value determined during a first iteration of the one or more iterations to a second minimum synchronization correction value determined during a second iteration of the one or more iterations;
determining that the second minimum synchronization correction value is greater than the first minimum synchronization correction value; and
determining the synchronization correction value based on at least one of the second minimum synchronization correction value and the maximum synchronization correction value.
3. The method of claim 1 , further comprising:
comparing a first maximum synchronization correction value determined during a first iteration of the one or more iterations to a second maximum synchronization correction value determined during a second iteration of the one or more iterations;
determining that the second maximum synchronization correction value is less than the first maximum synchronization correction value; and
determining the synchronization correction value based on at least one of the minimum synchronization correction value and the second maximum synchronization correction value.
4. The method of claim 1 , wherein the test frame is detected by a camera of the handheld device, and wherein the test tone is detected by a microphone of the handheld device.
5. The method of claim 1 , wherein a time between said performing of each of the one or more iterations of the calibration process is based at least in part on the maximum synchronization correction value.
6. The method of claim 1 , wherein the audio signal and the video signal originate from a same source.
7. The method of claim 1 , wherein a duration of the test tone is the same as a duration of the test frame.
8. A handheld device, comprising:
a camera;
a microphone; and
control logic configured to:
perform one or more iterations of a calibration process to obtain a synchronization correction value for synchronizing an audio signal and a video signal, wherein for each of the one or more iterations, the control logic is configured:
determine a first time at which a test frame included in video content representative of the video signal is detected by the camera;
determine a second time at which a test tone included in audio content representative of the audio signal is detected by the microphone;
determine a difference between the first time and the second time to obtain a minimum synchronization correction value; and
combine the minimum synchronization correction value with a frame duration of the test frame to obtain a maximum synchronization correction value;
determine the synchronization correction value based on at least one of the minimum synchronization correction value and the maximum synchronization correction value; and
provide the synchronization correction value to another device.
9. The handheld device of claim 8 , wherein the control logic is further configured to:
compare a first minimum synchronization correction value determined during a first iteration of the one or more iterations to a second minimum synchronization correction value determined during a second iteration of the one or more iterations;
determine that the second minimum synchronization correction value is greater than the first minimum synchronization correction value; and
determine the synchronization correction value based on at least one of the second minimum synchronization correction value and the maximum synchronization correction value.
10. The handheld device of claim 8 , wherein the control logic is further configured to:
compare a first maximum synchronization correction value determined during a first iteration of the one or more iterations to a second maximum synchronization correction value determined during a second iteration of the one or more iterations;
determine that the second maximum synchronization correction value is less than the first maximum synchronization correction value; and
determine the synchronization correction value based on at least one of the minimum synchronization correction value or the second maximum synchronization correction value.
11. The handheld device of claim 8 , wherein a time between said performing of each of the one or more iterations of the calibration process is based at least in part on the maximum synchronization correction value.
12. The handheld device of claim 8 , wherein the audio signal and the video signal originate from a same source.
13. The handheld device of claim 8 , wherein a duration of the test tone is the same as a duration of the test frame.
14. A system, comprising:
one or more processors; and
a memory containing a program, which, when executed by the one or more processors, is configured to perform a process configured to:
perform one or more iterations of a calibration process to obtain a synchronization correction value for synchronizing an audio signal and a video signal, wherein for each of the one or more iterations, the process is configured to:
determine a first time at which a test frame included in video content representative of the video signal is detected;
determine a second time at which a test tone included in audio content representative of the audio signal is detected;
determine a difference between the first time and the second time to obtain a minimum synchronization correction value; and
combine the minimum synchronization correction value with a frame duration of the test frame to obtain a maximum synchronization correction value;
determine the synchronization correction value based on at least one of the minimum synchronization correction value and the maximum synchronization correction value; and
provide the synchronization correction value to another device.
15. The system of claim 14 , the process further configured to:
compare a first minimum synchronization correction value determined during a first iteration of the one or more iterations to a second minimum synchronization correction value determined during a second iteration of the one or more iterations;
determine that the second minimum synchronization correction value is greater than the first minimum synchronization correction value; and
determine the synchronization correction value based on at least one of the second minimum synchronization correction value and the maximum synchronization correction value.
16. The system of claim 14 , the process further configured to:
compare a first maximum synchronization correction value determined during a first iteration of the one or more iterations to a second maximum synchronization correction value determined during a second iteration of the one or more iterations;
determine that the second maximum synchronization correction value is less than the first maximum synchronization correction value; and
determine the synchronization correction value based on at least one of the minimum synchronization correction value and the second maximum synchronization correction value.
17. The system of claim 14 , wherein a time between said performing of each of the one or more iterations of the calibration process is based at least in part on the maximum synchronization correction value.
18. The system of claim 14 , wherein the audio signal and the video signal originate from a same source.
19. The system of claim 14 , wherein the test frame is detected by a camera of the system, and wherein the test tone is detected by a microphone of the system.
20. The system of claim 14 , wherein a duration of the test tone is the same as a duration of the test frame.