IP Library Granted Patent US 9,025,903
Granted Patent B2
US 9,025,903 · App. 13/221,950 · Granted May 5, 2015

Image processing device and image processing method

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,025,903
App. No.
13/221,950
Granted
May 5, 2015
Kind
B2
Abstract

An image processing device includes: a first edge strength calculation part that calculates a first edge strength for a focus pixel based on pixel values in a first region that includes the focus pixel in an input image; a second edge strength calculation part that calculates a second edge strength for the focus pixel based on pixel values in a second region that is smaller than the first region and that includes the focus pixel; and a filter processing part that determines a filter coefficient such that a first smoothing strength is higher than a second smoothing strength and that filters the input image using the filter coefficient. The first smoothing strength is obtained where the first edge strength is higher than a first reference value and where the second edge strength is lower than a second reference value, and the second smoothing strength is obtained in other cases.

Claims (57)

1. An image processing device, comprising:

a first edge strength calculation part that calculates a first edge strength for a focus pixel based on pixel values in a first region that includes the focus pixel in an input image;

a second edge strength calculation part that calculates a second edge strength for the focus pixel based on pixel values in a second region that is smaller than the first region and that includes the focus pixel;

a flatness calculation part

that calculates a plurality of first flatnesses for a plurality of fourth regions within a third region, first flatness increasing as variation of pixel values within a respective fourth region decreases, the third region including the focus pixel and pixels neighboring the focus pixel, and at least one of the plurality of fourth regions not including the focus pixel, and

that selects as a second flatness a maximum first flatness from among the plurality of first flatnesses, the second flatness indicating a most flat fourth region from among the plurality of fourth regions; and

a filter determination part that determines a filter coefficient, so that strength of the filter

becomes stronger as the first edge strength becomes larger, the second edge strength becomes smaller, and the second flatness becomes larger, and

becomes weaker as the first edge strength becomes smaller, the second edges strength becomes larger, and the second flatness becomes smaller; and

a filter processing part that filters the input image using the determined filter coefficient and obtains filtered pixel values of the focus pixel.

2. The image processing device of claim 1 , wherein

the filter determination part determines the filter coefficient such that a smoothing strength of the filter becomes higher as a difference value between the first edge strength and the second edge strength increases.

3. The image processing device of claim 2 , wherein

the first edge strength is a difference value between a maximum value and a minimum value of the pixel values included in the first region, and

the second edge strength is a difference value between a maximum value and a minimum value of the pixel values included in the second region.

4. The image processing device of claim 2 , wherein

the first edge strength is one of:

a maximum value of first-order derivative values respectively calculated for pixels in the first region,

a maximum value of second-order derivative values respectively calculated for pixels in the first region,

a difference between a maximum value and a minimum value of luminance values respectively obtained at the pixels in the first region, and

a maximum value of luminance gradients of the luminance values respectively obtained at the pixels in the first region, and

the second edge strength is one of:

a maximum value of first-order derivative values respectively calculated for pixels in the second region,

a maximum value of second-order derivative values respectively calculated for pixels in the second region,

a first-order derivative value for the focus pixel,

a second-order derivative value for the focus pixel,

a difference between a maximum value and a minimum value of luminance values respectively obtained at the pixels in the second region, and

a value of a luminance gradient of the focus pixel.

5. The image processing device of claim 1 , wherein

the filter is an ε filter, and

the strength of the filter is a threshold value ε of the ε filter.

6. The image processing device of claim 1 , wherein

the filter is a Gaussian filter, and

the strength of the filter is a standard deviation a of the Gaussian filter.

7. The image processing device of claim 1 , wherein

the filter is a bilateral filter, and

the strength of the filter is a standard deviation σ d in a domain direction and a range direction standard deviation σ r in a range direction of the bilateral filter.

8. An image processing method, comprising:

calculating a first edge strength for a focus pixel based on values of pixels in a first region that includes the focus pixel in an input image;

calculating a second edge strength for the focus pixel based on values of pixels in a second region that is smaller than the first region and that includes the focus pixel;

calculating a plurality of first flatnesses for a plurality of fourth regions within a third region, first flatness increasing as variation of pixel values within a respective fourth region decreases, the third region including the focus pixel and pixels neighboring the focus pixel, and at least one of the plurality of fourth regions not including the focus pixel, and

selecting as a second flatness a maximum first flatness from among the plurality of first flatnesses, the second flatness indicating a most flat fourth region from among the plurality of fourth regions; and

determines a filter coefficient, so that strength of the filter

becomes stronger as the first edge strength becomes larger, the second edge strength becomes smaller, and the second flatness becomes larger, and

becomes weaker as the first edge strength becomes smaller, the second edges strength becomes larger, and the second flatness becomes smaller; and

filters the input image using the determined filter coefficient and obtaining filtered pixel values of the focus pixel.

9. The image processing device of claim 8 , wherein

the filter is an ε filter, and

the strength of the filter is calculated as a threshold value ε of the ε filter.

10. The image processing method of claim 8 , wherein

the filter is a Gaussian filter, and

the strength of the filter is calculated as a standard deviation ε of the Gaussian filter.

11. The image processing method of claim 8 , wherein

the filter is a bilateral filter, and

the strength of the filter is calculated as a standard deviation ε d in a domain direction and a range direction standard deviation ε r in a range direction of the bilateral filter.

12. The device according to claim 1 , wherein

the first flatness is a number of pixels, at which absolute values of first order derivative values in x direction and y direction is less than or equal to a threshold.

Assignments (6)
CHANGE OF NAME Recorded Dec 3, 2021
From: MAXELL HOLDINGS, LTD.
To: MAXELL, LTD.
Reel/Frame 058666/0407 →
MERGER Recorded Nov 29, 2021
From: MAXELL, LTD.
To: MAXELL HOLDINGS, LTD.
Reel/Frame 058255/0579 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 25, 2021
From: HISENSE VISUAL TECHNOLOGY CO., LTD.
To: MAXELL, LTD.
Reel/Frame 056681/0441 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 7, 2020
From: TOSHIBA VISUAL SOLUTIONS CORPORATION
To: HISENSE VISUAL TECHNOLOGY CO., LTD.
Reel/Frame 051493/0333 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 21, 2018
From: KABUSHIKI KAISHA TOSHIBA
To: TOSHIBA VISUAL SOLUTIONS CORPORATION
Reel/Frame 046640/0626 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 20, 2011
From: WADA, YASUAKI; TAGUCHI, YASUNORI
To: KABUSHIKI KAISHA TOSHIBA
Reel/Frame 027090/0125 →