IP Library Granted Patent US 8,509,552
Granted Patent B1
US 8,509,552 · App. 12/574,078 · Granted Aug 13, 2013

Digital image processing error concealment method

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,509,552
App. No.
12/574,078
Granted
Aug 13, 2013
Kind
B1
Abstract

In one embodiment the present invention includes a digital image processing method for concealing errors. The method includes determining error pixel locations based on motion vectors and determining if the error pixel locations in a current frame are on an edge of an object in the current frame. If an error pixel location is on an edge, then a search of pixel values is performed in the current frame along the edge for a replacement pixel value. If the error pixel location is not on an edge, then a search of pixel values is performed in a region adjacent to the edge for the replacement pixel value.

Claims (34)

1. A method comprising:

comparing, by one or more processors, a plurality of pixel values in a current frame to a plurality of reference values, wherein the plurality of reference values are based on a plurality of pixel values in a previous frame modified by a plurality of motion vectors associated with the plurality of pixel values in the previous frame; and

for each pixel value in the current frame that differs from a corresponding reference value by an amount greater than a predefined threshold:

determining, by the one or more processors, if an error pixel location corresponding to the pixel value in the current frame is on an edge of an object in the current frame;

if the error pixel location is on the edge, then performing a search of pixel values in the current frame along the edge for a replacement pixel value, and

if the error pixel location is not on the edge, then performing a search of pixel values in a region adjacent to the edge for the replacement pixel value.

2. The method of claim 1 wherein the comparing produces a plurality of difference values corresponding to the plurality of pixel values in the current frame.

3. The method of claim 2 , wherein the region is a first region, the method further comprising defining a second region around each pixel in the current frame, the second region including a plurality of pixel values, wherein each difference value comprises a sum of absolute values of differences between the pixel values in the second region and corresponding reference values.

4. The method of claim 2 wherein if the error pixel location is not on the edge, then a first error pixel having a corresponding difference value greater than the threshold located on a first side of the edge is replaced with a foreground pixel, and a second error pixel having a corresponding difference value greater than the threshold located on a second side of the edge is replaced with a background pixel.

5. The method of claim 1 further comprising receiving an edge mask, wherein the determining is performed using the edge mask.

6. The method of claim 1 wherein each pixel value in the previous frame has a corresponding motion vector specifying motion of one or more objects represented in the previous frame.

7. The method of claim 1 wherein performing the search along the edge for the replacement pixel value comprises selecting a candidate pixel value that results in a minimum error for a pixel at the error pixel location of the current frame.

8. The method of claim 7 wherein performing the search along the edge for the replacement pixel value further comprises weighting candidate pixel values based on a distance from the error pixel location.

9. The method of claim 1 wherein if the error pixel location is not on the edge the method further comprises:

defining a second region around the error pixel location, the second region comprising a plurality of pixel values;

assigning a value to a pixel at the error pixel location of the current frame, said value equal to a mean of a distribution of values across the region.

10. The method of claim 9 further comprising determining a number of modalities of the distribution and selecting a modality having the largest number of values, wherein the mean is determined from the selected modality.

11. An image processing system comprising:

a front end to receive transmitted image data in a transmitted format and produce digital image data;

a format converter to convert the digital image data into a native system format;

a motion compensator to compare a plurality of pixel values in a current frame to a plurality of reference values, wherein the plurality of reference values are based on a plurality of pixel values in a previous frame modified by a plurality of motion vectors associated with the plurality of pixel values in the previous frame, and for each pixel value in the current frame that differs from a corresponding reference value by an amount greater than a predefined threshold:

determining if an error pixel location corresponding to the pixel value in the current frame is on an edge of an object in the current frame;

if the error pixel location is on the edge, then performing a search of pixel values in the current frame along the edge for a replacement pixel value, and

if the error pixel location is not on the edge, then performing a search of pixel values in a region adjacent to the edge for the replacement pixel value; and

a display driver to drive a liquid crystal display.

12. The system of claim 11 wherein the motion compensator comparison produces a plurality of difference values corresponding to the plurality of pixel values in the current frame.

13. The system of claim 12 , wherein the region is a first region, the motion compensator further defining a second region around each pixel in the current frame, the second region including a plurality of pixel values, wherein each difference value comprises a sum of absolute values of differences between the pixel values in the second region and corresponding reference values.

14. The system of claim 12 wherein if the error pixel location is not on the edge, then a first error pixel having a corresponding difference value greater than the threshold located on a first side of the edge is replaced with a foreground pixel, and a second error pixel having a corresponding difference value greater than the threshold located on a second side of the edge is replaced with a background pixel.

15. The system of claim 11 wherein the motion compensator further receives an edge mask, wherein the determining is performed using the edge mask.

16. The system of claim 11 wherein each pixel value in the previous frame has a corresponding motion vector specifying motion of one or more objects represented in the previous frame.

17. The system of claim 11 wherein performing the search along the edge for the replacement pixel value comprises selecting a candidate pixel value that results in a minimum error for a pixel at the error pixel location of the current frame.

18. The system of claim 17 wherein performing the search along the edge for the replacement pixel value further comprises weighting candidate pixel values based on a distance from the error pixel location.

19. The system of claim 11 wherein if the error pixel location is not on the edge, then the motion compensator defines a second region around the error pixel location, the second region comprising a plurality of pixel values, and assigns a value to a pixel at the error pixel location of the current frame, said value equal to a mean of a distribution of values across the region.

20. The system of claim 19 wherein the motion compensator determines a number of modalities of the distribution and selects a modality having the largest number of values, wherein the mean is determined from the selected modality.

Assignments (6)
SECURITY INTEREST Recorded Sep 27, 2017
From: SYNAPTICS INCORPORATED
To: WELLS FARGO BANK, NATIONAL ASSOCIATION
Reel/Frame 044037/0896 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 19, 2017
From: MARVELL INTERNATIONAL LTD.
To: SYNAPTICS INCORPORATED; SYNAPTICS LLC
Reel/Frame 043853/0827 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 19, 2009
From: BISWAS, MAINAK
To: MARVELL SEMICONDUCTOR, INC.
Reel/Frame 023388/0727 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 19, 2009
From: NAMBOODIRI, VIPIN
To: MARVELL INDIA PVT. LTD.
Reel/Frame 023388/0754 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 19, 2009
From: MARVELL SEMICONDUCTOR, INC.
To: MARVELL INTERNATIONAL LTD.
Reel/Frame 023388/0800 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 19, 2009
From: MARVELL INDIA PVT. LTD.
To: MARVELL INTERNATIONAL LTD.
Reel/Frame 023388/0895 →