System and method for audio and visual synchronization
View Patent ↗Presented herein is a system, method, and apparatus for audio and video synchronization. In one embodiment, there is presented a method for displaying audio data and video data. The method comprises examining a plurality of portions of the audio data, where each of said plurality of portions of audio data is associated with a time stamp; examining a plurality of portions of the video data, where each of said plurality of portions of the video data is associated with a time stamp; decoding one of the portions of the video data; and decoding one of the portions of the audio data while decoding the one of the portions of the video data. The difference between the time stamp associated with the one of the portions of the video data and the time stamp associated with the one of the portions of the audio data is within a certain margin of error from a predetermined offset.
1. A method for displaying audio data and video data, said method comprising:
examining a plurality of portions of the audio data, each of said plurality of portions of audio data associated with a time stamp;
examining a plurality of portions of the video data, each of said plurality of portions of the video data associated with a decode time stamp;
decoding one of the portions of the video data with a circuit; decoding one of the portions of the video data, wherein the decode time stamp for decoding the one of the portions of the video time and the time stamp for decoding the one of the portions of the audio data are offset such that decoding of the one of the portions of the video data ends concurrently with the decoding of the one of the portions of the audio data, wherein the of the portions of the audio data and the one of the portions of the video data were captured concurrently and are to be played concurrently; and wherein the difference between the decode time stamp associated with the one of the portions of the video data that is being decoded and the time stamp associated with the one of the portions of the audio data that is being decoded while decoding the one of the portions of the video data is within a certain margin of error from a predetermined offset, said predetermined offset representing the difference between times for decoding video data and decoding audio data, wherein after decoding, the one of the portions of the audio data and the one of the portions of the video data concurrently become available for playing without delaying presentation of either of the one the portions of the audio data or the portions of the video data;
comparing the decode time stamps associated with the video data with the predetermined offset to a clock reference;
comparing the time stamps associated with the audio data to the clock reference;
wherein the one of the portions of the video data is selected based on the comparison between the decode time stamps associated with the video data and the clock reference; and
wherein the one of the portions of the audio data is selected based on the comparison between the time stamps associated with the audio data and the clock reference.
2. The method of claim 1 , wherein the portions of the video data comprises a picture.
3. The method of claim 1 , wherein the portions of the audio data comprises a frame.
4. The method of claim 1 , wherein the time stamp associated with the one of the portions of the audio data exceeds the decode time stamp associated with the one of the portions of the video data.
5. The method of claim 1 , wherein the predetermined offset is a function of a difference between a time for decoding video data and a time for decoding audio data.
6. The method of claim 1 , further comprising:
storing the audio and video data.
7. A decoder system for displaying audio data and video data, said decoder system comprising:
one or more controllers for examining a plurality of portions of the audio data, each of said plurality of portions of audio data associated with a time stamp and examining a plurality of portions of the video data, each of said plurality of portions of the video data associated with a decode time stamp;
an audio decoder for decoding one of the portions of the audio data; a video decoder for decoding one of the portions of the video data while the audio decoder decodes the one of the portions of the audio data, wherein the decode time stamp for decoding the one of the portions of the video time and the time stamp for decoding the one of the portions of the audio data are offset such that decoding of the one of the portions of the video data ends concurrently with the decoding of the one of the portions of the audio data, wherein the one of the portions of the audio data and the one of the portions of the video data were captured concurrently and are to be played concurrently; and
wherein the difference between the decode time stamp associated with the one of the portions of the video data that is being decoded and the time stamp associated with the one of the portions of the audio data that is being decoded while decoding the one of the portions of the video data is within a certain margin of error from a predetermined offset, said predetermined offset representing the different between times for decoding video data and decoding audio data,
wherein after decoding, the one of the portions of the audio data and the one of the portions of the video data concurrently become available for playing without delaying presentation of either of the one of the portions of the audio data or the portions of the video data;
of the audio data while decoding the one of the portions of the video data, wherein the decode time stamp for decoding the one of the portions of the video time and the time stamp for decoding the one of the portions of the audio data are offset such that decoding of the one of the portions of the video data ends concurrently with the decoding of the one of the portions of the audio data, wherein the one of the portions of the audio data and the one of the portions of the video data were captured concurrently and are to be played concurrently; and
wherein the difference between the decode time stamp associated with the one of the portions of the video data that is being decoded and the time stamp associated with the one of the portions of the audio data that is being decoded while decoding the one of the portions of the video data is within a certain margin of error from a predetermined offset, said predetermined offset representing the difference between times for decoding video data and decoding audio data;
a system clock for providing a time reference; and wherein the one or more controllers compare the decode time stamps associated with the video data with the predetermined offset to the time reference and compare the time stamps associated with the audio data to the time reference;
wherein the controller selects the one of the portions of the video data based on the comparison between the decode time stamps associated with the video data with the predetermined offset and the time reference, and wherein the controller selects the one of the portions of the audio data based on the comparison between the time stamps associated with the audio data and the time reference.
8. The decoder system of claim 7 , wherein the portions of the video data comprises a picture.
9. The decoder system of claim 7 , wherein the portions of the audio data comprises a frame.
10. The decoder system of claim 7 , wherein the time stamp associated the one of the portions of the audio data exceeds the time stamp associated with the one of the portions of the video data.
11. The decoder system of claim 7 , wherein the controller selects the one of the portions of the video data and the one of the portions of audio data.
12. The decoder system of claim 7 , wherein the predetermined offset is a function of a difference between a time for decoding video data and a time for decoding audio data.
13. The decoder system of claim 7 , further comprising:
a memory for storing the audio data and video data.
14. A method for displaying audio data and video data, comprising: selecting one of the portions of the audio data for decoding that has a time stamp which exceeds a predetermined offset of a decode time stamp of one of the portions of the video data within a certain margin of error;
decoding the one of portions of the video data with a circuit;
decoding the one of the portions of the audio data during decoding the one of the portions of the video data, wherein the decoding of the one of the portions of the video data ends concurrently with the decoding of the one of the portions of the audio data,
wherein the predetermined offset represents the difference between times for decoding video data and decoding audio data,
wherein after decoding, the one of the portions of the audio data and the one of the portions of the video data concurrently become available for playing without delaying presentation of either of the one of the portions of the audio data or the portions of the video data;
providing a clock reference; and
comparing decode time stamps associated with the video data with the predetermined offset to the clock reference; and
comparing time stamps associated with the audio data to the clock reference;
wherein the one of the portions of the video data is selected based on the comparison between decode time stamps associated with the video data and the clock reference; and
wherein the one of the portions of the audio data is selected based on the comparison between time stamps associated with the audio data and the clock reference.
15. The method of claim 14 , further comprising:
selecting the one of the portions of the video data to be decoded having the decode time stamp that is within the margin of error from the clock reference.