IP Library Granted Patent US 9,875,523
Granted Patent B2
US 9,875,523 · App. 15/029,302 · Granted Jan 23, 2018

Image processing apparatus and image processing method

Inventors: Yoshitaka Toyoda (Tokyo, JP); Kohei Kurihara (Tokyo, JP); Shotaro Moriya (Tokyo, JP); Takeo Fujita (Tokyo, JP); Narihiro Matoba (Tokyo, JP)
Assignee: MITSUBISHI ELECTRIC CORPORATION
G06T3/4053G06T3/40H04N1/387H04N1/3871
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,875,523
App. No.
15/029,302
Granted
Jan 23, 2018
Kind
B2
Abstract

An image processing apparatus and image processing method enlarge an input image (Din) to generate a low-resolution enlarged image (D 101 ). Depending on a result of identification of the pattern of the input image (Din), coefficient data (D 108 ) for conversion to a high-resolution are selected, and a feature component (D 102 H) of a low resolution is converted to a feature component (D 103 H) of a high resolution. Decision as to whether or not the pattern of a local region of the input image (Din) is flat is made. If it is flat, the coefficient data are so selected that no substantial alteration is made to pixel values in a high-resolution conversion unit ( 103 ). It is possible to reduce the circuit size and the memory capacity, and to improve the noise immunity, and achieve conversion to a high resolution suitable for implementation by hardware.

Claims (41)

1. An image processing apparatus comprising:

an image enlarging unit for enlarging an input image to generate a low-resolution enlarged image;

a feature component separating unit for separating said low-resolution enlarged image into a feature component of a low resolution and a non-feature component for each patch;

a high-resolution conversion unit for converting said feature component of the low resolution into a feature component of a high resolution;

a feature component combining unit for combining said feature component of the high resolution and said non-feature component to generate a high-resolution patch;

a patch averaging unit for averaging, for each pixel, values of one or more high-resolution patches to generate an output image;

a coefficient data storage memory that stores a plurality of sets of coefficient data respectively corresponding to a plurality of mutually different patterns;

a pattern identification unit for identifying a pattern of a local region in said input image, corresponding to a patch in said low-resolution enlarged image, and outputting a pattern identification signal indicating a result of the identification; and

a coefficient data selection unit for selecting, from among the plurality of sets of coefficient data stored in said coefficient data storage memory, a set of coefficient data corresponding to said pattern identification signal, and outputting the selected set of coefficient data; wherein

said high-resolution conversion unit converts said feature component of the low resolution into said feature component of the high resolution, using said coefficient data selected by said coefficient data selection unit.

2. The image processing apparatus as set forth in claim 1 , wherein

said pattern identification unit includes a flatness decision unit for deciding whether or not the pattern of said local region in said input image is flat, and

said coefficient data selection unit performs the selection of said coefficient data based on a result of the decision by said flatness decision unit.

3. The image processing apparatus as set forth in claim 2 , wherein said coefficient data selected when the result of the decision by said flatness decision unit indicates flatness are such coefficient data by which no substantial alteration is made to the pixel values in the conversion at said high-resolution conversion unit.

4. The image processing apparatus as set forth in claim 1 , wherein

said pattern identification unit includes a flatness decision unit for deciding whether or not the pattern of the local region in said input image is flat;

when the result of the decision by said flatness decision unit indicates non-flatness, said high-resolution conversion unit outputs, as said feature component of the high resolution, a result of the conversion of said feature component of the low-resolution using said coefficient data, and

when the result of the decision by said flatness decision unit indicates flatness, said high-resolution conversion unit outputs, as said feature component of the high resolution, entirety or part of said feature component of the low resolution, as it is, without using said coefficient data.

5. The image processing apparatus as set forth in claim 1 , wherein said pattern identification unit includes:

an average unit for taking, as a pixel of interest, a pixel at a position in said input image, corresponding to a center of the patch in said low-resolution enlarged image, and determining an average value of pixel values of pixels in the local region centered around said pixel of interest;

an LBP calculation unit for comparing pixel values of pixels neighboring said pixel of interest, with said average value, and generating a pattern number representing a combination of results of the comparison pertaining to the respective pixels;

a flatness decision unit for deciding whether or not said local region is flat, based on whether or not an average of absolute values of differences between the pixel values of the pixels neighboring said pixel of interest and said average value is smaller than a predetermined threshold value, and outputting a flatness decision signal indicating a result of the decision; and

a pattern identification signal generating unit for generating the pattern identification signal from said pattern number and said flatness decision signal.

6. The image processing apparatus as set forth in claim 1 , wherein said pattern identification unit includes:

an average unit for taking, as a pixel of interest, a pixel at a position in said input image, corresponding to a center of the patch in said low-resolution enlarged image, and determining an average value of pixel values of pixels in the local region centered around said pixel of interest;

an LBP calculation unit for comparing pixel values of pixels neighboring said pixel of interest, with said average value, and generating a pattern number representing a combination of results of the comparison pertaining to the respective pixels, as said pattern identification signal; and

a flatness decision unit for deciding whether or not said local region is flat, based on whether or not an average of absolute values of differences between the pixel values of the pixels neighboring said pixel of interest and said average value is smaller than a predetermined threshold value, and outputting a flatness decision signal indicating a result of the decision; wherein

said high-resolution conversion unit receives said flatness decision signal,

when said flatness decision signal indicates non-flatness, said high-resolution conversion unit outputs, as said feature component of the high-resolution, a result of the conversion from said feature component of the low resolution using said coefficient data, and

when said flatness decision signal indicates flatness, said high-resolution conversion unit outputs, entirety or part of said feature component of the low resolution, as it is, without using said coefficient data.

7. The image processing apparatus as set forth in claim 1 , wherein said non-feature component separated by said feature component separating unit is a mean value of pixel values of pixels constituting said patch, and said feature component of the low-resolution separated by said feature component separating unit is formed of differences of the pixel values of the pixels constituting said patch, from said mean value.

8. The image processing apparatus as set forth in claim 7 , wherein said feature component combining unit performs the combination by adding said non-feature component to said feature component.

9. An image processing method comprising:

an image enlarging step for enlarging an input image to generate a low-resolution enlarged image;

a feature component separating step for separating said low-resolution enlarged image into a feature component of a low resolution and a non-feature component for each patch;

a high-resolution conversion step for converting said feature component of the low resolution into a feature component of a high resolution;

a feature component combining step for combining said feature component of the high resolution and said non-feature component to generate a high-resolution patch;

a patch averaging step for averaging, for each pixel, values of one or more high-resolution patches to generate an output image;

a pattern identification step for identifying a pattern of a local region in said input image, corresponding to a patch in said low-resolution enlarged image, and outputting a pattern identification signal indicating a result of the identification; and

a coefficient data selection step for selecting, from among a plurality of sets of coefficient data stored respectively corresponding to a plurality of mutually different patterns in a coefficient data storage memory, a set of coefficient data corresponding to said pattern identification signal, and outputting the selected set of coefficient data; wherein

said high-resolution conversion step converts said feature component of the low resolution into said feature component of the high resolution, using said coefficient data selected by said coefficient data selection step.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2016
From: TOYODA, YOSHITAKA; KURIHARA, KOHEI; MORIYA, SHOTARO; FUJITA, TAKEO; MATOBA, NARIHIRO
To: MITSUBISHI ELECTRIC CORPORATION
Reel/Frame 038279/0836 →
Priority Claims (1)
JP 2013-249879 · Dec 3, 2013 · national
Continuity (1)
Related Publication 20160247259A1 · Aug 25, 2016