IP Library Granted Patent US 7,738,563
Granted Patent B2
US 7,738,563 · App. 10/887,132 · Granted Jun 15, 2010

Method and system for performing deblocking filtering

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,738,563
App. No.
10/887,132
Granted
Jun 15, 2010
Kind
B2
Abstract

A system and method for filtering a frame, the method includes: (i) processing, by a processing unit executing instructions, at least one portion of a frame to provide at least one processed frame portion; (ii) performing, by a hardware filter, deblocking filtering of the at least one processed frame portion to provide at least one filtered frame portion; and (ii) storing the at least one filtered frame portion in a memory unit that is accessible by the processing unit; whereas the stage of processing is responsive to previously filtered frame portions. The system includes: (i) a processing unit, adapted to execute instructions such as to process at least one portion of a frame to provide at least one processed frame portion; (ii) a hardware filter, connected to the processing unit, adapted to deblocking filter the at least one processed frame portion to provide at least one filtered frame portion; and (iii) a memory unit, connected to the processing unit, adapted to store the at least one filtered frame portion; whereas the processing unit is adapted to process the at least one portion in response to previously filtered frame portions.

Claims (44)

1. A method for filtering a frame, the method comprises:

determining whether to perform loop deblocking filtering or post deblocking filtering;

configuring a hardware filter to operate as a loop deblocking filter or a post deblocking filter according to the determination;

determining, by a mode decision unit of the hardware filter, which filter to be applied by a filter arithmetic unit of the hardware filter;

processing, by a processing unit executing instructions, at least one portion of a frame to provide at least one processed frame portion,

performing, by a hardware filter of an image processing unit that is coupled to the processing unit, deblocking filtering of the at least one processed frame portion to provide at least one filtered frame portion; wherein the processing unit operates independently of the image processing unit;

wherein the at least one filtered frame portion is utilized in response to the determination;

wherein the deblocking filtering utilizes the filter arithmetic unit;

wherein if determining to perform loop deblocking then processing, by the processing unit, a frame portion while loop deblocking filtering another frame portion of the same frame; and

displaying processed frames.

2. The method of claim 1 wherein if determining to perform post deblocking filtering then the stage of performing deblocking filtering of at least one frame portion is executed after the stage of processing of the whole frame is completed.

3. The method of claim 1 further comprising a stage of generating a processed frame indication, indicating that a frame was processed by the processing unit.

4. The method of claim 1 wherein if determining to perform loop deblocking filtering then the at least one filtered frame portion is utilized during a stage of processing another frame.

5. The method of claim 1 further comprising generating, by the processing unit, a processed frame portion indication, indicative of a generation of the processed frame portion.

6. The method of claim 1 further comprising generating, by the hardware filter, a filtered frame indication, indicative of a generation of a filtered frame.

7. The method of claim 1 further comprising generating, if determining to perform post deblocking, a processed frame portion indication, indicative of a generation of the processed frame portion.

8. The method of claim 1 further comprising determining which at least one frame portion to process before proceeding to the stage of performing, by the hardware filter, deblocking filtering.

9. The method of claim 1 wherein the determining, by the mode decision unit of the hardware filter, which filter to be applied by the filter arithmetic unit of the hardware filter is responsive to a boundary strength parameter.

10. The method of claim 1 further comprising operating the processing unit at a low power consuming operational mode after the processing unit completed to process a frame.

11. The method of claim 1 further comprising a preliminary stage of pre-processing at least one frame portion.

12. The method of claim 1 wherein the processing comprises applying variable length encoding, de-quantizing and applying inverse discrete cosine transform operations.

13. A system for filtering a frame, the system comprises:

a hardware filter that is adapted to be configured as a loop deblocking filter or as a post deblocking filter such as to deblocking filter at least one processed frame portion to provide at least one filtered frame portion;

wherein the hardware filter comprises a mode decision unit that determines which filter to be applied by a filter arithmetic unit of the hardware filter; and

a processing unit that operates independently of an image processing unit in which the hardware filter is comprised; wherein the processing unit is adapted to execute instructions such as to determine whether to perform loop deblocking filtering or post deblocking filtering, and to process at least one portion of a frame to provide the at least one processed frame portion;

wherein the at least one filtered frame portion is utilized in response to the determination;

wherein if the processing unit determines to configure the hardware filter as a loop deblocking filter then the processing unit process a frame portion while the hardware filter performs loop deblocking filtering of another frame portion of the same frame.

14. The system of claim 13 wherein if configuring the hardware filter as a post deblocking filter then the hardware filter performs post deblocking of at least one frame portion after the processing unit processes the whole frame.

15. The system of claim 13 wherein the processing unit is adapted to generate a processed frame indication, indicating that a frame was processed by the processing unit.

16. The system of claim 13 wherein the hardware filter is adapted to deblocking filter of an image portion in parallel to a frame portion process by the processing unit.

17. The system of claim 13 wherein the processing unit is adapted to utilize filtered frames during the processing of another frame is the processing unit determined to apply loop deblocking filtering.

18. The system of claim 13 wherein the processing unit is adapted to generate a processed frame portion indication, indicative of a generation of the processed frame portion.

19. The system of claim 13 wherein the hardware filter is adapted to generate a filtered frame indication, indicative of a generation of a filtered frame.

20. The system of claim 13 wherein the processing unit is adapted to generate a processed frame indication if the processing unit determined to apply a post deblocking filtering.

21. The system of claim 13 wherein the processing unit is adapted to determine which at least one frame portion to process before performing deblocking filtering.

22. The system of claim 13 wherein the processing unit is adapted to operate in a low power consuming operational mode after the completing to process a frame.

23. The system according to claim 13 wherein the mode decision unit determines which filter to be applied by the filter arithmetic unit in response to a boundary strength parameter.

24. The system according to claim 13 wherein an order of decoding blocks of the frame by the processing unit differs from an order of the deblocking filtering of blocks of the frame by the hardware filter.

25. The method according to claim 1 wherein an order of decoding blocks of the frame by the processing unit differs from an order of the deblocking filtering of blocks of the frame by the hardware filter.

26. The system of claim 13 , wherein the hardware filter is configured to consume less power than the processing unit for deblocking filtering the processed frame portion.

27. The system of claim 13 , wherein the hardware filter is to receive processed Y, U and V frame portions, start to process the Y frame until a certain row, and filter the remaining Y frame, the U frame and the V frame after the processing unit indicates that processing the whole frame is completed.

28. The system of claim 19 , wherein the hardware filter is adapted to generate the filtered frame indication when an amount of pixels that have been filtered is less than a total number of pixels in a frame.

29. The system of claim 18 , wherein the processing unit is configured to generate the processed frame portion indication whenever the processing unit finishes processing pairs of block sequences, each block sequence extending through the entire width of the frame.

30. The system of claim 13 , wherein the hardware filter is configured to prevent from deblocking filtering processed frame portions of a frame before the processing unit has processed at least a predetermined amount of pixels, said predetermined amount of pixels programmed by a user.

Assignments (21)
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 040925 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Feb 17, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP, B.V. F/K/A FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 052917/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 040928 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Jan 17, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 052915/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 037486 FRAME 0517. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS. Recorded Dec 10, 2019
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 053547/0421 →
323.01(C) ASSIGNMENT OR CHANGE OF NAME IMPROPERLY FILED AND RECORDED BY ANOTHER PERSON AGAINST OWNER'S PATENT Recorded Oct 3, 2019
From: TAIWAN SEMICONDUCTOR MANUFACTURING CO., LTD.
To: TAIWAN SEMICONDUCTOR MANUFACTURING CO., LTD.
Reel/Frame 052459/0656 →
CORRECTIVE ASSIGNMENT TO CORRECT THE TO CORRECT THE APPLICATION NO. FROM 13,883,290 TO 13,833,290 PREVIOUSLY RECORDED ON REEL 041703 FRAME 0536. ASSIGNOR(S) HEREBY CONFIRMS THE THE ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS.. Recorded Feb 20, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: SHENZHEN XINGUODU TECHNOLOGY CO., LTD.
Reel/Frame 048734/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 15, 2017
From: NORTH STAR INNOVATIONS INC.
To: TAIWAN SEMICONDUCTOR MANUFACTURING CO., LTD.
Reel/Frame 041717/0736 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE PATENTS 8108266 AND 8062324 AND REPLACE THEM WITH 6108266 AND 8060324 PREVIOUSLY RECORDED ON REEL 037518 FRAME 0292. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS. Recorded Feb 1, 2017
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 041703/0536 →
RELEASE OF SECURITY INTEREST Recorded Nov 7, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 040928/0001 →
RELEASE OF SECURITY INTEREST Recorded Sep 21, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP, B.V., F/K/A FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 040925/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 4, 2016
From: FREESCALE SEMICONDUCTOR, INC.
To: NORTH STAR INNOVATIONS INC.
Reel/Frame 037694/0264 →
ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS Recorded Jan 13, 2016
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 037518/0292 →
ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS Recorded Jan 12, 2016
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 037486/0517 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037356/0143 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037356/0553 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037354/0225 →
SECURITY AGREEMENT Recorded Nov 6, 2013
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 031591/0266 →
SECURITY AGREEMENT Recorded Jun 18, 2013
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 030633/0424 →
SECURITY AGREEMENT Recorded May 13, 2010
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 024397/0001 →
SECURITY AGREEMENT Recorded Mar 15, 2010
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A.
Reel/Frame 024085/0001 →
SECURITY AGREEMENT Recorded Feb 2, 2007
From: FREESCALE SEMICONDUCTOR, INC.; FREESCALE ACQUISITION CORPORATION; FREESCALE ACQUISITION HOLDINGS CORP.; FREESCALE HOLDINGS (BERMUDA) III, LTD.
To: CITIBANK, N.A. AS COLLATERAL AGENT
Reel/Frame 018855/0129 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2004
From: PELC, OSKAR; ZARUBINSKY, MICHAEL; YOUNG, DAVID
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 015291/0124 →