IP Library Granted Patent US 8,797,457
Granted Patent B2
US 8,797,457 · App. 12/067,080 · Granted Aug 5, 2014

Apparatus and method for frame rate preserving re-sampling or re-formatting of a video stream

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,797,457
App. No.
12/067,080
Granted
Aug 5, 2014
Kind
B2
Abstract

An apparatus configured to match an input frame rate of a video stream with an output frame rate of an output stream, the apparatus comprising, at least one memory buffer, an output frame generator, and a threshold measurement unit, the threshold measurement unit configured to generate a control feedback, wherein the box is configured to analyze the control feedback to monitor a state of the at least one memory buffer, the threshold measurement unit further configured analyze the control feedback to regulate between two or more different settings, wherein the two or more different settings include slowing down or speeding up the output frame, wherein the two or more different settings further include slowing down or speeding up of the line rate of the output stream.

Claims (45)

1. An apparatus for matching timing of an input video stream with timing of an output video stream, the apparatus comprising:

at least one memory buffer for receiving and storing video data at an input frame rate of the input video stream,

an output frame generator coupled to the at least one memory buffer for receiving video data from the at least one memory buffer at an output frame rate, and

regulating means coupled to the at least one memory buffer and the output frame generator for implementing feedback control that permits a state of the at least one memory buffer, to be monitored, and for controlling a regulation, based on said state, between two or more different timing settings to selectively slow down or speed up the output frame rate.

2. The apparatus of claim 1 , wherein the regulating means sends at least one threshold signal from the at least one memory buffer to the output frame generator, and wherein the output frame generator samples each said threshold signal at at least one sampling point.

3. The apparatus of claim 2 , wherein, at each said sampling point, the output frame generator selectively switches the output frame rate by selectively switching between the two or more different timing settings.

4. The apparatus of claim 1 , wherein the output frame generator implements the two or more different timing settings as one of alternative output frame layouts, different output frame rates, and different output line lengths.

5. The apparatus of claim 4 , wherein the output frame generator uses respective ones of the alternative output frame layouts to respectively generate:

fast output frames that are slightly shorter in duration than a shortest possible input frame, and

slow output frames that are slightly longer in duration than the longest possible input frame.

6. The apparatus of claim 5 , wherein the output frame generator alternates between output frame sequences of the fast and slow output frames.

7. The apparatus of claim 2 , wherein one of the sampling points corresponds to a position, in an output frame layout implemented by the output frame generator, that guarantees no underflow of the at least one memory buffer.

8. The apparatus of claim 2 , wherein said monitored state is a fullness of the at least one buffer, and comprising setup means that allow the apparatus to be switched from a normal mode of operation into a setup mode which is used to set a threshold so that a corresponding said threshold signal is issued when the at least one memory buffer becomes filled to the threshold.

9. The apparatus of claim 1 , wherein the matching is done on a frame-by-frame or line-by-line basis.

10. The apparatus of claim 8 , wherein the setup mode is used to set a floor threshold and a ceiling threshold to compensate for phase shifts between the input video stream and the output video stream.

11. The apparatus of claim 10 , wherein said output frame generator selects one of

a normal said timing setting if the fullness of the at least one memory buffer is between the floor threshold and the ceiling threshold,

a slow said timing setting if the fullness of the at least one memory buffer falls below the floor threshold, and

a fast said timing setting if the fullness of the at least one memory buffer exceeds the ceiling threshold.

12. A method for processing an input video stream that includes video data transmitted at an input frame rate, comprising:

receiving the video data,

temporarily storing the video data in a memory buffer at the input frame rate,

monitoring the fullness of the memory buffer to determine whether the fullness reaches a pre-defined threshold, and

sampling the threshold signals received from the memory buffer at one or more positions in the output frame;

regulating, based on the fullness of the memory buffer, between two or more different timing settings of an output frame rate at which video data are output by the memory buffer and sent to an output frame generator, to selectively slow down or speed up the output frame rate.

13. The method of claim 12 being employed in order to maintain a frame synchronization between the input video stream and an output video stream produced by the output frame generator.

14. The method of claim 12 being employed in order to match the input frame rate with a frame rate of an output video stream produced by the output frame generator.

15. The method of claim 12 wherein an auto setup is performed in order to define at least one said pre-defined threshold for use in said monitoring.

16. An apparatus configured to match timing of an input video stream with timing of an output video stream, the apparatus comprising:

at least one memory buffer for receiving and storing video data at an input frame rate of the input video stream, the at least one memory buffer configured to generate a threshold signal indicative of a fullness of the at least one memory buffer; and

an output frame generator coupled to the at least one memory buffer for receiving video data from the at least one memory buffer and generating output frames of video data, said output frame generator configured to sample threshold signal;

a threshold measurement unit,

wherein the output frame generator selects among two or more different timing settings depending on the threshold signal, the two or more different timing settings including:

a fast timing setting where the output frame generator generates output frames that are slightly shorter in duration than the shortest possible input frame to ensure that video data is output from the at least one memory buffer faster than video data is input to the at least one memory buffer, and

a slow timing setting where the output frame generator generates output frames that are slightly longer in duration than the longest possible input frame to ensure that video data is output from the at least one memory buffer slower than video data is input to the at least one memory buffer.

17. The apparatus of claim 16 , wherein the at least one memory buffer is configured to send a plurality of threshold signals to the output frame generator, and the output frame generator is configured to sample each of the threshold signals at at least one sampling point.

18. The apparatus of claim 16 , wherein the output frame generator implements the two or more different timing settings as alternative output frame layouts

a fast setting generating output frames that are shorter in duration than a shortest possible input frame, and

a slow setting generating output frames that are longer in duration than the longest possible input frame.

19. The apparatus of claim 16 , wherein the output frame generator implements the two or more different timing settings as one of: alternative output frame layouts, different output frame rates, and different output line lengths.

20. The apparatus of claim 16 , wherein the at least one memory buffer is further configured to support a floor threshold and a ceiling threshold to facilitate monitoring the fullness of the at least one memory buffer in order to compensate for phase shifts between the input video stream and the output video stream;

the output frame generator being further configured to, based on the fullness of the memory buffer, selectively implement one of:

a normal timing setting if the fullness of the memory buffer is between the floor threshold and the ceiling threshold,

the slow timing setting if the fullness of the memory buffer falls below the floor threshold, and

the fast timing setting if the fullness of the memory buffer exceeds the ceiling threshold.

Assignments (19)
SECURITY AGREEMENT Recorded Jul 9, 2021
From: MAXLINEAR, INC.; MAXLINEAR COMMUNICATIONS, LLC; EXAR CORPORATION
To: WELLS FARGO BANK, NATIONAL ASSOCIATION
Reel/Frame 056816/0089 →
RELEASE OF SECURITY INTEREST Recorded Jun 23, 2021
From: MUFG UNION BANK, N.A.
To: MAXLINEAR, INC.; EXAR CORPORATION; MAXLINEAR COMMUNICATIONS LLC
Reel/Frame 056656/0204 →
SUCCESSION OF AGENCY (REEL 042453 / FRAME 0001) Recorded Jul 1, 2020
From: JPMORGAN CHASE BANK, N.A.
To: MUFG UNION BANK, N.A.
Reel/Frame 053115/0842 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 042985 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051029/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 039361 FRAME 0212. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051029/0387 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051030/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 042762 FRAME 0145. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051145/0184 →
RELEASE OF SECURITY INTEREST Recorded Sep 10, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 050745/0001 →
SECURITY AGREEMENT Recorded May 12, 2017
From: MAXLINEAR, INC.; ENTROPIC COMMUNICATIONS, LLC (F/K/A ENTROPIC COMMUNICATIONS, INC.); EXAR CORPORATION
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 042453/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12681366 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded May 9, 2017
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 042985/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12681366 PREVIOUSLY RECORDED ON REEL 039361 FRAME 0212. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded May 9, 2017
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 042762/0145 →
PATENT RELEASE Recorded Aug 17, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 039707/0471 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12092129 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Jul 14, 2016
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 039361/0212 →
SECURITY AGREEMENT SUPPLEMENT Recorded Mar 7, 2016
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 038017/0058 →
MERGER AND CHANGE OF NAME Recorded May 19, 2015
From: ENTROPIC COMMUNICATIONS, INC.; EXCALIBUR SUBSIDIARY, LLC; ENTROPIC COMMUNICATIONS, LLC
To: ENTROPIC COMMUNICATIONS, LLC
Reel/Frame 035717/0628 →
MERGER AND CHANGE OF NAME Recorded May 18, 2015
From: EXCALIBUR ACQUISITION CORPORATION; ENTROPIC COMMUNICATIONS, INC.; ENTROPIC COMMUNICATIONS, INC.
To: ENTROPIC COMMUNICATIONS, INC.
Reel/Frame 035706/0267 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2012
From: TRIDENT MICROSYSTEMS, INC.; TRIDENT MICROSYSTEMS (FAR EAST) LTD.
To: ENTROPIC COMMUNICATIONS, INC.
Reel/Frame 028146/0178 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 13, 2010
From: NXP
To: NXP HOLDING 1 B.V.
Reel/Frame 023928/0489 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 13, 2010
From: TRIDENT MICROSYSTEMS (EUROPE) B.V.; NXP HOLDING 1 B.V.
To: TRIDENT MICROSYSTEMS (FAR EAST) LTD.
Reel/Frame 023928/0641 →