Synchronization of signals
View Patent ↗A method and system for synchronizing signals. First and second signals are sent (compressed or uncompressed) from a source to a receiving apparatus of a receiving system. The first signal has content of a first modality (e.g., audio) and the second signal has content of a second modality (e.g., video). The first and second signals are to be displayed on a display apparatus of the receiving system. The first and second signals have been time-synchronized at the source. If the first and second signals are not synchronized in time when received at the receiving apparatus, then the first and second signals may be time-synchronized at the receiving apparatus either manually or through timestamping of both signals at the source, in conjunction with use of a real-time clock at the receiving apparatus.
1. A method for synchronizing signals, comprising:
receiving, from a source, a first signal and a second signal by a receiving apparatus of a receiving system, the first and second signals to be synchronously displayed on a display apparatus of the receiving system, the first and second signals having been time-synchronized at the source, the first signal having content of a first modality and a first plurality of time stamps originating from the source, the second signal having content of a second modality and a second plurality of time stamps originating from the source, the second plurality of time stamps being synchronized with the first plurality of time stamps;
determining at a plurality of times on a real-time clock at the receiving system whether the first and second signals are time-synchronized relative to the clock, said determining being based on analyzing the first and second plurality of time stamps in relation to the clock; and
reducing the time rate of displaying one of the first signal and the second signal when said determining determines that the first and second signals are not time-synchronized relative to the clock such that the one is time advanced relative to the remaining other of the first signal and the second signal, said reducing being directed to time-synchronizing said displaying of the first and second signals on the display apparatus.
2. The method of claim 1 ,
wherein the first signal is in an uncompressed format as received by the receiving apparatus, wherein each timestamp of the first plurality of timestamps includes a time corresponding to a location in the first signal at which said timestamp of the first plurality of timestamps is positioned,
wherein the second signal is in an uncompressed format as received by the receiving apparatus, and wherein each timestamp of the second plurality of timestamps includes a time corresponding to a location in the second signal at which said timestamp of the second plurality of timestamps is positioned.
3. The method of claim 1 ,
wherein the first signal is in a compressed format as received by the receiving apparatus, wherein each timestamp of the first plurality of timestamps includes a time corresponding to a location in a first uncompressed signal which was compressed at the source to form the first signal, wherein said timestamp of the first plurality of timestamps further includes an identification of said location in the first uncompressed signal,
wherein the second signal is in a compressed format as received by the receiving apparatus, wherein each timestamp of the second plurality of timestamps includes a time corresponding to a location in a second uncompressed signal which was compressed at the source to form the second signal, and wherein said timestamp of the second plurality of timestamps further includes an identification of said location in the second uncompressed signal.
4. The method of claim 1 ,
wherein the first signal is in an uncompressed format as received by the receiving apparatus, wherein each timestamp of the first plurality of timestamps includes corresponding to a location in the first signal at which said timestamp of the first plurality of timestamps is positioned,
wherein the second signal is in a compressed format as received by the receiving apparatus, wherein each timestamp of the second plurality of timestamps includes a time corresponding to a location in an uncompressed signal which was compressed at the source to form the second signal, and wherein said timestamp of the second plurality of timestamps further includes an identification of said location in the uncompressed signal.
5. The method of claim 1 , wherein said reducing is effectuated by a delay compensation controller of the receiving apparatus.
6. The method of claim 1 , wherein said reducing comprises introducing a time delay gap in the displaying of said one of the first signal and the second signal.
7. The method of claim 1 , wherein said reducing does not comprise introducing a time delay gap in the displaying of said one of the first signal and the second signal.
8. The method of claim 1 , wherein the first modality differs from the second modality.
9. The method of claim 8 , wherein the first modality is a video modality, and wherein the second modality is an audio modality.
10. The method of claim 8 , wherein the first modality is a video modality, and wherein the second modality is an text modality.
11. The method of claim 8 , wherein the first modality is a text modality, and wherein the second modality is an audio modality.
12. The method of claim 1 , wherein said receiving the first signal and the second signal comprises receiving the first signal and the second signal on separate channels.
13. The method of claim 1 , wherein said receiving the first signal and the second signal comprises receiving the first signal and the second signal as not multiplexed with each other.
14. The method of claim 1 , wherein said receiving the first signal and the second signal comprises receiving the first signal and the second signal as multiplexed but not time-synchronized with each other.
15. A system for synchronizing signals, comprising:
receiving means for receiving, from a source, a first signal and a second signal by a receiving apparatus of a receiving system, the first and second signals to be synchronously displayed on a display apparatus of the receiving system, the first and second signals having been time-synchronized at the source, the first signal having content of a first modality and a first plurality of timestamps originating from the source, the second signal having content of a second modality and a second plurality of timestamps originating from the source, the second plurality of time stamps being synchronized with the first plurality of time stamps;
determining means for determining at a plurality of times on a real-time clock C R at the receiving system whether the first and second signals are time-synchronized relative to the clock C R , said determining being based on analyzing the first and second plurality of timestamps in relation to the clock C R ; and
reducing means for reducing the time rate of displaying one of the first signal and the second signal when said determining determines that the first and second signals are not time-synchronized relative to the clock C R such that the one is time advanced relative to the remaining other of the first signal and the second signal, said reducing being directed to time-synchronizing said displaying of the first and second signals on the display apparatus.
16. The system of claim 15 ,
wherein the first signal is in an uncompressed format as received by the receiving apparatus, wherein each timestamp of the first plurality of timestamps includes a time corresponding to a location in the first signal at which said timestamp of the first plurality of timestamps is positioned,
wherein the second signal is in an uncompressed format as-received by the receiving apparatus, and wherein each timestamp of the second plurality of timestamps includes a time corresponding to a location in the second signal at which said timestamp of the second plurality of timestamps is positioned.
17. The system of claim 15 ,
wherein the first signal is in an uncompressed format as received by the receiving apparatus, wherein each timestamp of the first plurality of timestamps includes a time corresponding to a location in a first uncompressed signal which was compressed at the source to form the first signal, wherein said timestamp of the first plurality of timestamps further includes an identification of said location in the first uncompressed signal,
wherein the second signal is in an uncompressed format as received by the receiving apparatus, wherein each timestamp of the second plurality of timestamps includes a time corresponding to a location in a second uncompressed signal which was compressed at the source to form the second signal, and wherein said timestamp of the second plurality of timestamps further includes an identification of said location in the second uncompressed signal.
18. The system of claim 15 ,
wherein the first signal is in an uncompressed format as received by the receiving apparatus, wherein each timestamp of the first plurality of timestamps includes a time corresponding to a location in the first signal at which said timestamp of the first plurality of timestamps is positioned,
wherein the second signal is in an uncompressed format as received by the receiving apparatus, wherein each timestamp of the second plurality of timestamps includes a time corresponding to a location in a second-uncompressed signal which was compressed at the source to form the second signal, and wherein said timestamp of the second plurality of timestamps further includes an identification of said location in the second uncompressed signal.
19. The system of claim 15 , wherein said reducing is effectuated by a delay compensation controller of the receiving apparatus.
20. The system of claim 15 , wherein said reducing comprises introducing a time delay gap in the displaying of said one of the first signal and the second signal.
21. The system of claim 15 , wherein said reducing does not comprise introducing a time delay gap in the displaying of said one of the first signal and the second signal.
22. The system of claim 15 , wherein the first modality differs from the second modality.
23. The system of claim 22 , wherein the first modality is a video modality, and wherein the second modality is an audio modality.
24. The system of claim 22 , wherein the first modality is a video modality, and wherein the second modality is an text modality.
25. The system of claim 22 , wherein the first modality is a text modality, and wherein the second modality is an audio modality.
26. The system of claim 15 , wherein said receiving means comprises means for receiving the first signal and the second signal on separate channels.
27. The system of claim 15 , wherein said receiving means comprises means for receiving the first signal and the second signal as not multiplexed with each other.
28. The system of claim 15 , wherein said receiving means comprises means for receiving the first signal and the second signal as multiplexed but not time-synchronized with each other.