IP Library Granted Patent US 7,283,175
Granted Patent B2
US 7,283,175 · App. 10/533,027 · Granted Oct 16, 2007

System and method for determining lip synchronization between audio and video in a digitized environment using buffer calculation

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,283,175
App. No.
10/533,027
Granted
Oct 16, 2007
Kind
B2
Abstract

The disclosed embodiments relate to a system and method for maintaining synchronization between a video signal and an audio signal that are processed using clocks that are locked. The system may comprise a component that determines at least one initial level of a buffer, a component that determines at least one current level of the buffer, and a component that determines an amount of drift by comparing the at least one initial level of the buffer to the at least one current level of the buffer and adjusts the clocks to maintain the initial midpoint level of the buffer if the amount of drift reaches a threshold level.

Claims (68)

1. A system that maintains synchronization between a video signal and an audio signal that are processed using clocks that are locked, the system comprising:

a component that determines an initial minimum operating level, an initial maximum operating level, and an initial midpoint level of a buffer, the initial midpoint level is computed as being equal to half of the initial maximum operating level plus half of the initial minimum operating level;

a component that determines at least one current level of the buffer; and

a component that determines an amount of drift by comparing at least one of the initial minimum operating level, the initial maximum operating level, and the initial midpoint level of the buffer to the at least one current level of the buffer and adjusts the clocks to maintain the initial midpoint level of the buffer if the amount of drift reaches a threshold level.

2. The system set forth in claim 1 , wherein the at least one current level of the buffer comprises a current midpoint level.

3. The system set forth in claim 1 , wherein the at least one current level of the buffer comprises a current minimum operating level, a current maximum operating level, and a current midpoint level.

4. The system set forth in claim 3 , wherein the current midpoint level is calculated as being equal to the current minimum operating level plus the initial midpoint level minus the initial minimum operating level.

5. The system set forth in claim 1 , wherein the audio signal and the video signal comprise a Motion Picture Experts Group (MPEG) signal.

6. The system set forth in claim 1 , wherein the system comprises a portion of a television set.

7. The system set forth in claim 6 , wherein the television set comprises a High Definition Television (HDTV) set.

8. A system that maintains synchronization between a video signal and an audio signal that are processed using clocks that are locked, the system comprising:

means for determining an initial minimum operating level, an initial maximum operating level, and an initial midpoint level of a buffer, the initial midpoint level is computed as being equal to half of the initial maximum operating level plus half of the initial minimum operating level;

means for determining at least one current level of the buffer;

means for determining an amount of drift by comparing at least one of the initial minimum operating level, the initial maximum operating level, and the initial midpoint level of the buffer to the at least one current level of the buffer; and

means for adjusting the clocks to maintain the initial midpoint level of the buffer if the amount of drift reaches a threshold level.

9. The system set forth in claim 8 , wherein the at least one current level of the buffer comprises a current midpoint level.

10. The system set forth in claim 8 , wherein the at least one current level of the buffer comprises a current minimum operating level, a current maximum operating level, and a current midpoint level.

11. The system set forth in claim 10 , wherein the current midpoint level is calculated as being equal to the current minimum operating level plus the initial midpoint level minus the initial minimum operating level.

12. A method of maintaining synchronization between a video signal and an audio signal that are processed using clocks that are locked, the method comprising:

determining an initial minimum operating level, an initial maximum operating level, and an initial midpoint level of a buffer, the initial midpoint level is computed as being equal to half of the initial maximum operating level plus half of the initial minimum operating level;

determining at least one current level of the buffer; and

determining an amount of drift by comparing at least one of the initial minimum operating level, the initial maximum operating level, and the initial midpoint level of the buffer to the at least one current level of the buffer; and

adjusting the clocks to maintain the initial midpoint level of the buffer if the amount of drift reaches a threshold level.

13. The method set forth in claim 12 , comprising:

defining the at least one current level of the buffer to comprise a current minimum operating level, a current maximum operating level, and a current midpoint level; and

computing the current midpoint level (Cur Mid) as being equal to the current minimum operating level plus the initial midpoint level minus the initial minimum operating level.

14. A system that maintains synchronization between a video signal and an audio signal that are processed using clocks that are locked, the system comprising:

a component that determines an initial minimum operating level, an initial maximum operating level, and an initial midpoint level of a buffer;

a component that determines a current minimum operating level, a current maximum operating level, and a current midpoint level of the buffer, the current midpoint level is calculated as being equal to the current minimum operating level plus the initial midpoint level minus the initial minimum operating level; and

a component that determines an amount of drift by comparing at least one of the initial minimum operating level, the initial maximum operating level, and the initial midpoint level of the buffer to the at least one of the current minimum operating level, the current maximum operating level, and the current midpoint level of the buffer and adjusts the clocks to maintain the initial midpoint level of the buffer if the amount of drift reaches a threshold level.

15. A system that maintains synchronization between a video signal and an audio signal that are processed using clocks that are locked, the system comprising:

means for determining an initial minimum operating level, an initial maximum operating level, and an initial midpoint level of a buffer;

means for determining a current minimum operating level, a current maximum operating level, and a current midpoint level of the buffer, the current midpoint level is calculated as being equal to the current minimum operating level plus the initial midpoint level minus the initial minimum operating level;

means for determining an amount of drift by comparing at least one of the initial minimum operating level, the initial maximum operating level, and the initial midpoint level of the buffer to the at least one of the current minimum operating level, the current maximum operating level, and the current midpoint level of the buffer; and

means for adjusting the clocks to maintain the initial midpoint level of the buffer if the amount of drift reaches a threshold level.

16. A method of maintaining synchronization between a video signal and an audio signal that are processed using clocks that are locked, the method comprising:

determining an initial minimum operating level, an initial maximum operating level, and an initial midpoint level of a buffer;

determining a current minimum operating level, a current maximum operating level, and a current midpoint level of the buffer, the current midpoint level is calculated as being equal to the current minimum operating level plus the initial midpoint level minus the initial minimum operating level;

determining an amount of drift by comparing at least one of the initial minimum operating level, the initial maximum operating level, and the initial midpoint level of the buffer to the at least one of the current minimum operating level, the current maximum operating level, and the current midpoint level of the buffer; and

adjusting the clocks to maintain the initial midpoint level of the buffer if the amount of drift reaches a threshold level.

17. A system that maintains synchronization between a video signal and an audio signal that are processed using clocks, the system comprising:

a component that determines an initial minimum operating level, an initial maximum operating level, and an initial midpoint level of a buffer, the initial midpoint level being derived from the initial maximum operating level and the initial minimum operating level;

a component that determines at least one current level of the buffer; and

a component that determines an amount of drift by comparing at least one of the initial minimum operating level, the initial maximum operating level, and the initial midpoint level of the buffer to the at least one current level of the buffer and adjusts the clocks to maintain the initial midpoint level of the buffer if the amount of drift reaches a threshold level.

18. A system that maintains synchronization between a video signal and an audio signal that are processed using clocks, the system comprising:

means for determining an initial minimum operating level, an initial maximum operating level, and an initial midpoint level of a buffer, the initial midpoint level being derived from the initial maximum operating level and the initial minimum operating level;

means for determining at least one current level of the buffer;

means for determining an amount of drift by comparing at least one of the initial minimum operating level, the initial maximum operating level, and the initial midpoint level of the buffer to the at least one current level of the buffer; and

means for adjusting the clocks to maintain the initial midpoint level of the buffer if the amount of drift reaches a threshold level.

19. A method of maintaining synchronization between a video signal and an audio signal that are processed using clocks, the method comprising:

determining an initial minimum operating level, an initial maximum operating level, and an initial midpoint level of a buffer, the initial midpoint level being derived from the initial maximum operating level and the initial minimum operating level;

determining at least one current level of the buffer; and

determining an amount of drift by comparing at least one of the initial minimum operating level, the initial maximum operating level, and the initial midpoint level of the buffer to the at least one current level of the buffer; and

adjusting the clocks to maintain the initial midpoint level of the buffer if the amount of drift reaches a threshold level.

20. A system that maintains synchronization between a video signal and an audio signal that are processed using clocks that are locked, the system comprising:

a component that determines an initial minimum operating level, an initial maximum operating level, and an initial midpoint level of a buffer;

a component that determines a current minimum operating level, a current maximum operating level, and a current midpoint level of the buffer, the current midpoint level is derived from the current minimum operating level, the initial midpoint level and the initial minimum operating level; and

a component that determines an amount of drift by comparing at least one of the initial minimum operating level, the initial maximum operating level, and the initial midpoint level of the buffer to the at least one of the current minimum operating level, the current maximum operating level, and the current midpoint level of the buffer of the buffer and adjusts the clocks to maintain the initial midpoint level of the buffer if the amount of drift reaches a threshold level.

21. A system that maintains synchronization between a video signal and an audio signal that are processed using clocks, the system comprising:

means for determining an initial minimum operating level, an initial maximum operating level, and an initial midpoint level of a buffer;

means for determining a current minimum operating level, a current maximum operating level, and a current midpoint level of the buffer, the current midpoint level is derived from the current minimum operating level, the initial midpoint level, and the initial minimum operating level;

means for determining an amount of drift by comparing at least one of the initial minimum operating level, the initial maximum operating level, and the initial midpoint level of the buffer to the at least one of the current minimum operating level, the current maximum operating level, and the current midpoint level of the buffer; and

means for adjusting the clocks to maintain the initial midpoint level of the buffer if the amount of drift reaches a threshold level.

22. A method of maintaining synchronization between a video signal and an audio signal that are processed using clocks, the method comprising:

determining an initial minimum operating level, an initial maximum operating level, and an initial midpoint level of a buffer;

determining a current minimum operating level, a current maximum operating level, and a current midpoint level of the buffer, the current midpoint level being derived from the current minimum operating level, the initial midpoint level, and the initial minimum operating level;

determining an amount of drift by comparing at least one of the initial minimum operating level, the initial maximum operating level, and the initial midpoint level of the buffer to the at least one of the current minimum operating level, the current maximum operating level, and the current midpoint level of the buffer; and

adjusting the clocks to maintain the initial midpoint level of the buffer if the amount of drift reaches a threshold level.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 10, 2018
From: THOMSON LICENSING DTV
To: INTERDIGITAL MADISON PATENT HOLDINGS
Reel/Frame 046763/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2017
From: THOMSON LICENSING
To: THOMSON LICENSING DTV
Reel/Frame 043302/0965 →
CHANGE OF NAME Recorded Apr 21, 2017
From: THOMSON LICENSING S.A.
To: THOMSON LICENSING
Reel/Frame 042303/0268 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2005
From: JOHNSON, DEVON MATTHEW; JUNKERSFELD, PHILLIP AARON
To: THOMSON LICENSING S.A.
Reel/Frame 017362/0237 →