Method and apparatus for deblurring and re-blurring image segments
View Patent ↗Using image segmentation in video compression brings about a limitation in video quality when a segment moves in position from frame to frame. The limitation arises because color contributions (bleeding or blurring) naturally occur between neighboring segments. The above-identified problem is overcome by providing solutions to compensate for color contributions between neighboring segments. In accordance with one embodiment, a method and apparatus de-blurs an image segment. De-blurring involves removing from the segment approximate color contributions from neighboring segments. This results in a segment that is approximately independent of color contributions from neighboring segments. In accordance with another embodiment, a method and apparatus re-blurs an image segment. Re-blurring involves adding to the segment approximate color contributions from a new arrangement of neighboring segments. This results in more realistic rendering of the segment, as it is located in the new arrangement.
1. A method of de-blurring a segment of an image, the method comprising:
selecting the segment;
identifying pixels of interest near a boundary of the segment;
calculating blur contributions for the pixels by determining a first color vector relating to the segment, a second color vector relating to at least one adjacent segment in proximity to the pixels, and a third color vector relating to the pixels, wherein the blur contributions are in a same direction as a first difference vector comprising the second color vector minus the first color vector and comprise projections of a second difference vector onto the first difference vector, wherein the second difference vector comprises the third color vector minus the first color vector; and
subtracting the blur contributions from color vectors of the pixels to remove blurring from the segment.
2. The method of claim 1 , wherein the first color vector comprises a representative color of the segment, the second color vector comprises a color contribution of the at least one adjacent segment, and the third color vector comprises representative colors of the pixels.
3. A method of de-blurring a segment of an image, the method comprising:
selecting the segment;
identifying pixels of interest near a boundary of the segment;
calculating blur contributions for the pixels by determining a first color vector relating to the segment, a second color vector relating to at least one adjacent segment in proximity to the pixels, and a third color vector relating to the pixels, wherein the blur contributions are in a same direction as a first difference vector comprising the second color vector minus the first color vector and are proportional to a blur coefficient, wherein the blur coefficient comprises a first dot product between the second and first difference vectors divided by a second dot product between two first difference vectors; and
subtracting the blur contributions from color vectors of the pixels to remove blurring from the segment.
4. The method of claim 3 , wherein the blur coefficients are calculated by an image processing apparatus.
5. The method of claim 3 , wherein the blur coefficients are calculated by a video processing apparatus.
6. The method of claim 3 , wherein the blur coefficients are provided as segment field data relating to the segment.
7. A method of blurring a two-dimensional segment of an image, the method comprising:
selecting the two-dimensional segment;
identifying boundary pixels in a boundary region near a border between the two-dimensional segment and one or more adjacent two-dimensional segments;
determining blur contributions to the boundary pixels from the one or more adjacent two-dimensional segments; and
adding the blur contributions to color vectors of the boundary pixels to add blurring to the two-dimensional segment.
8. The method of claim 7 , wherein calculating the blur contributions comprises:
determining a first color vector relating to the two-dimensional segment;
determining a second color vector relating to at least one adjacent two-dimensional segment in proximity to the boundary pixels; and
determining a measure of blurring relating to the boundary pixels.
9. The method of claim 8 , wherein the blur contributions are in a same direction as a first difference vector comprising the second color vector minus the first color vector.
10. The method of claim 8 , wherein the first color vector comprises a representative color of the two-dimensional segment, and the second color vector comprises a color contribution of the at least one adjacent segment.
11. The method of claim 8 , wherein the measure of blurring comprises a blur coefficient.
12. The method of claim 11 , wherein the blur coefficients are calculated by a video encoder apparatus.
13. The method of claim 11 , wherein the blur coefficients are retrieved by a video decoder apparatus from segment field data relating to the two-dimensional segment.
14. An apparatus for determining blur contributions to a particular two-dimensional segment from adjacent two-dimensional segments of an image, the apparatus comprising:
means for selecting the particular two-dimensional segment;
means for identifying boundary pixels in a boundary region near a border between the particular two-dimensional and one or more adjacent two-dimensional segments; and
means for determining the blur contributions for the boundary pixels from the adjacent two-dimensional segment;
means for subtracting the blur contributions from color vectors of the boundary pixels to remove blurring from the particular two-dimensional segment.
15. The apparatus of claim 14 , further comprising:
means for calculating blur coefficients representing the blur contributions.