IP Library Granted Patent US 8,995,536
Granted Patent B2
US 8,995,536 · App. 10/892,897 · Granted Mar 31, 2015

System and method for audio/video synchronization

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,995,536
App. No.
10/892,897
Granted
Mar 31, 2015
Kind
B2
Abstract

Described herein is a system and method for audio visual synchronization. The picture are displayed by receiving an identifier, said identifier associated with a frame buffer storing a picture; extracting a presentation time stamp associated with the picture, wherein the picture is associated with a time stamp; comparing a local time clock value to the presentation time stamp; determining that the picture is mature for presentation if the presentation time stamp exceeds the local time clock value by less than a first predetermined threshold; and determining that the picture is mature for presentation if the local time clock value exceeds the presentation time stamp by less than a second predetermined threshold.

Claims (80)

1. A method for displaying pictures, said method comprising:

receiving an identifier, said identifier associated with a frame buffer storing a decoded picture at a circuit;

extracting a presentation time stamp associated with the decoded picture, responsive to receiving the identifier;

comparing a local time clock value to the presentation time stamp associated with the decoded picture; and

determining to hold the picture in the frame buffer if the presentation time stamp exceeds the local time clock value by more than a first predetermined threshold but less than a second predetermined threshold; and

responsive to the determination, holding the decoded picture in the frame buffer.

2. The method of claim 1 , wherein extracting the presentation time stamp associated with the decoded picture further comprises:

interpolating the presentation time stamp for the decoded picture if the decoded picture does not comprise a presentation time stamp.

3. The method of claim 1 , further comprising:

comparing a subsequent local time clock value to the presentation time stamp associated with the decoded picture;

determining that the picture has become mature for presentation if (i) the presentation time stamp exceeds the subsequent local time clock value by less than the first predetermined threshold, or (ii) the subsequent local time clock value exceeds the presentation time stamp by less than a third predetermined threshold; and

providing the picture for displaying if the picture is determined to be mature for presentation.

4. The method of claim 1 , further comprising:

comparing a subsequent local time clock value to the presentation time stamp associated with the decoded picture;

determining that the picture has become mature for presentation if (i) the presentation time stamp exceeds the subsequent local time clock value by less than the first predetermined threshold, or (ii) the subsequent local time clock value exceeds the presentation time stamp by less than a third predetermined threshold; and

providing the picture for displaying based on the polarity of the picture and responsive to the determination that the picture is mature for presentation.

5. The method of claim 1 , further comprising:

receiving a second identifier, said second identifier associated with the frame buffer storing a decoded second picture;

extracting a second presentation time stamp associated with the decoded second picture, responsive to receiving the second identifier;

comparing a second local time clock value to the second presentation time stamp associated with the decoded second picture; and

disqualifying the second picture if (i) the second presentation time stamp exceeds the second local time clock value by more than the second threshold and the second threshold is enabled, or (ii) the second presentation time stamp exceeds the second local time clock value by more than the first predetermined threshold and the second threshold is disabled.

6. The method of claim 1 , wherein the second predetermined threshold comprises a discard threshold.

7. The method of claim 1 , further comprising:

providing the picture for displaying if the presentation time stamp exceeds the local time clock value by more than the first predetermined threshold and by less than the second predetermined threshold, a user settable control parameter is in a first state; and

providing a previously displayed picture for displaying, if the presentation time stamp exceeds the local time clock value by more than the first predetermined threshold and by less than the second predetermined threshold, if the user settable control parameter is in a second state.

8. A system for displaying frames, said system comprising:

a buffer manager configured for providing an identifier, said identifier associated with a frame buffer storing a decoded picture;

a buffer descriptor structure for storing a presentation time stamp associated with the decoded picture; and

a display manager configured for:

comparing a local time clock value to the presentation time stamp associated with the decoded picture,

determining to hold the picture in the frame buffer if the presentation time stamp exceeds the local time clock value by more than a first predetermined threshold but less than a second predetermined threshold, and

responsive to the determination, holding the decoded picture in the frame buffer.

9. The system of claim 8 , wherein the display manager comprises a presentation time stamp register for interpolating the presentation time stamp for the decoded picture if the picture does not comprise a presentation time stamp.

10. The system of claim 8 , further comprising:

a display engine configured for providing the picture for displaying if the picture is determined to be mature for presentation; and

wherein the display manager is further configured for:

comparing a subsequent local time clock value to the presentation time stamp associated with the decoded picture, and

determining that the picture has become mature for presentation if (i) the presentation time stamp exceeds the subsequent local time clock value by less than the first predetermined threshold, or (ii) the subsequent local time clock value exceeds the presentation time stamp by less than a third predetermined threshold.

11. The system of claim 8 , further comprising:

a display engine configured for providing the picture for displaying based on the polarity of the picture and a determination that the picture is mature for presentation; and

wherein the display manager is further configured for:

comparing a subsequent local time clock value to the presentation time stamp associated with the decoded picture, and

determining that the picture has become mature for presentation if (i) the presentation time stamp exceeds the subsequent local time clock value by less than the first predetermined threshold, or (ii) the subsequent local time clock value exceeds the presentation time stamp by less than a third predetermined threshold.

12. The system of claim 8 , wherein the display manager is further configured to:

compare a second local time clock value to a second presentation time stamp associated with a decoded second picture, said second picture stored in the frame buffer; and

disqualify the second picture if (i) the second presentation time stamp exceeds the second local time clock value by more than the second threshold and the second threshold is enabled or (ii) the second presentation time stamp exceeds the second local time clock value by more than the first predetermined threshold and the second threshold is disabled.

13. The system of claim 8 , wherein the second predetermined threshold comprises a discard threshold.

14. The system of claim 8 , wherein the display engine is further configured for:

providing the picture for displaying if the presentation time stamp exceeds the local time clock value by more than the first predetermined threshold and by less than the second predetermined threshold, if a user settable control parameter is in a first state; and

providing a previously displayed picture for displaying, if the presentation time stamp exceeds the local time clock value by more than the first predetermined threshold and by less than the second predetermined threshold, if the user settable control parameter is in a second state.

15. A circuit for displaying pictures, said circuit comprising:

a processor;

an instruction memory connected to the processor, the instruction memory storing a plurality of instructions, wherein execution of the plurality of instructions by the processor causes the circuit to:

receive an identifier, said identifier associated with a frame buffer storing a decoded picture;

extract a presentation time stamp associated with the decoded picture, responsive to receiving the identifier;

compare a local time clock value to the presentation time stamp associated with the decoded picture;

determine to hold the picture in the frame buffer if the presentation time stamp exceeds the local time clock value by more than a first predetermined threshold but less than a second predetermined threshold; and

responsive to the determination, hold the decoded picture in the frame buffer.

16. The circuit of claim 15 , wherein execution of the plurality of instructions also causes the circuit to:

interpolate the presentation time stamp for the decoded picture if the decoded picture does not comprise a presentation time stamp.

17. The circuit of claim 15 , wherein execution of the plurality of instructions also causes the circuit to:

compare a subsequent local time clock value to the presentation time stamp associated with the decoded picture;

determine that the picture has become mature for presentation if (i) the presentation time stamp exceeds the subsequent local time clock value by less than the first predetermined threshold, or (ii) the subsequent local time clock value exceeds the presentation time stamp by less than a third predetermined threshold; and

provide the picture for displaying if the picture is determined to be mature for presentation.

18. The circuit of claim 15 , wherein execution of the plurality of instructions also causes the circuit to:

compare a subsequent local time clock value to the presentation time stamp associated with the decoded picture;

determine that the picture has become mature for presentation if (i) the presentation time stamp exceeds the subsequent local time clock value by less than the first predetermined threshold, or (ii) the subsequent local time clock value exceeds the presentation time stamp by less than a third predetermined threshold; and

provide the picture for displaying based on the polarity of the picture and responsive to the determination that the picture is mature for presentation.

19. The circuit of claim 15 , wherein execution of the plurality of instructions also causes the circuit to:

receive a second identifier, said second identifier associated with the frame buffer storing a decoded second picture;

extract a second presentation time stamp associated with the decoded second picture, responsive to receiving the second identifier;

compare a second local time clock value to the second presentation time stamp associated with the decoded second picture; and

disqualify the second picture if (i) the second presentation time stamp exceeds the second local time clock value by more than the second threshold and the second threshold is enabled or (ii) the second presentation time stamp exceeds the second local time clock value by more than the first predetermined threshold and the second threshold is disabled.

20. The circuit of claim 15 , wherein the second predetermined threshold comprises a discard threshold.

21. The circuit of claim 15 , wherein execution of the plurality of instructions also causes the circuit to:

provide the picture for displaying if the presentation time stamp exceeds the local time clock value by more than the first predetermined threshold and by less than the second predetermined threshold, if a user settable control parameter is in a first state; and

provide a previously displayed picture for displaying, if the presentation time stamp exceeds the local time clock value by more than the first predetermined threshold and by less than the second predetermined threshold, if the user settable control parameter is in a second state.

22. The method of claim 1 , wherein the identifier identifies the frame buffer.

23. The method of claim 2 , wherein the pictures are displayed in a different order than the pictures are decoded.

24. The method of claim 1 , wherein the comparing a local time clock value to the presentation time stamp associated with the picture, further comprises comparing the presentation time stamp associated with the picture after decompressing the picture.

Assignments (6)
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENT NUMBER 9,385,856 TO 9,385,756 PREVIOUSLY RECORDED AT REEL: 47349 FRAME: 001. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER. Recorded Mar 22, 2019
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 051144/0648 →
CORRECTIVE ASSIGNMENT TO CORRECT THE EFFECTIVE DATE PREVIOUSLY RECORDED ON REEL 047229 FRAME 0408. ASSIGNOR(S) HEREBY CONFIRMS THE THE EFFECTIVE DATE IS 09/05/2018. Recorded Oct 29, 2018
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 047349/0001 →
MERGER Recorded Oct 4, 2018
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 047229/0408 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Feb 3, 2017
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: BROADCOM CORPORATION
Reel/Frame 041712/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2017
From: BROADCOM CORPORATION
To: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
Reel/Frame 041706/0001 →
PATENT SECURITY AGREEMENT Recorded Feb 11, 2016
From: BROADCOM CORPORATION
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 037806/0001 →