IP Library Granted Patent US 10,192,286
Granted Patent B2
US 10,192,286 · App. 14/847,125 · Granted Jan 29, 2019

Device and method for image enlargement and display panel driver using the same

Inventors: Hirobumi Furihata (Tokyo, JP); Takashi Nose (Tokyo, JP); Masao Orio (Tokyo, JP)
Assignee: Synaptics Japan GK
G06T3/4007G06T3/40G06T3/403G09G5/391G09G2310/0216G09G2340/04H04N1/00469
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,192,286
App. No.
14/847,125
Granted
Jan 29, 2019
Kind
B2
Abstract

A display panel driver includes a scaler circuit performing image enlargement processing on input image data corresponding to an input image to generate α-times enlarged image data corresponding to an α-times enlarged image (α is a number larger than one which cannot be represented as 2 k ); and a driver section driving a display panel. In calculating a pixel value of a target pixel of the α-times enlarged image, the scaler circuit generates enlarged image data including 2 n -times enlarged image data corresponding to a 2 n -times enlarged image obtained by enlarging the input image with an enlargement factor of 2 n (n is the smallest integer determined so that 2 n is larger than α), and calculates the pixel value of the target pixel from the 2 n -times enlarged image data through interpolation processing of pixel values of pixels of the 2 n -times enlarged image corresponding to the target pixel of the α-times enlarged image.

Claims (77)

1. A display panel driver, comprising:

a scaler circuit configured to enlarge an input image with an enlargement factor of α (α is a number larger than one which cannot be represented as 2k for k being any natural number) to obtain α-times enlarged image data by:

generating an intermediate pixel image composed of intermediate pixels, the intermediate pixels obtained by:

dividing the input image into a plurality of 2×2 pixel arrays having four pixel values; and

selecting an average value of two pixel values of the four pixel values in each of the 2×2 pixel arrays, the two pixel values being other than a maximum and a minimum value of the four pixel values;

calculating an interpolated pixel image composed of interpolated pixels by enlarging the input image with an enlargement factor of 2n (n is the smallest integer determined so that 2n is larger than α) to obtain a 2n-times enlarged image, wherein values of the interpolated pixels are determined by interpolation of pixel values of selected pixels of the 2n-times enlarged image; and

incorporating the input image, the intermediate pixel image, and the interpolated pixel image into the α-times enlarged image;

an edge enhancement circuit configured to generate output image data by performing edge enhancement processing on the α-times enlarged image; and

a driver section configured to drive a display panel at least partially based on the output image data.

2. The display panel driver according to claim 1 , wherein the scaler circuit further includes:

a twice-enlarged image generator circuit configured to generate twice-enlarged image data corresponding to a twice-enlarged image obtained by enlarging the input image with an enlargement factor of two; and

an α-times enlarged image generator circuit configured to generate the α-times enlarged image from the twice-enlarged image.

3. The display panel driver according to claim 1 , wherein the scaler circuit further includes:

first to n-th twice-enlarged image generator circuits connected in series;

an α-times enlarged image generator circuit,

wherein the first twice-enlarged image generator circuit is configured to generate a 2 1 -times enlarged image data corresponding to a 2 1 -times enlarged image obtained by enlarging the input image with an enlargement factor of two, and

wherein the p-th twice-enlarged image generator circuit (p is an integer from two to n) is configured to generate 2 p -times enlarged image data corresponding to a 2 p -times enlarged image obtained by enlarging the 2 (p-1) -times enlarged image with an enlargement factor of two;

an intermediate pixel image generator circuit configured to generate intermediate pixel image data corresponding to a second intermediate pixel image composed of second intermediate pixels each corresponding to 2×2 pixel arrays included in the input image or the 2 (q-1) -times enlarged image; and

an interpolated image generator circuit configured to generate interpolated image data corresponding to a second interpolated image composed of second interpolation pixels each corresponding to combinations of two pixels of the input image or the 2 (q-1) -times enlarged image adjacent in a horizontal or vertical direction,

wherein, in generating the intermediate pixel image data, the intermediate pixel image generator circuit calculates a pixel value of each of the second intermediate pixels as an average value of selected two of pixel values of four pixels of a 2×2 pixel array in the input image or the 2 (q-1) -times enlarged image corresponding to each of the second intermediate pixels, the selected two pixel values being selected other than maximum and minimum values of the pixel values of the four pixels,

wherein, in generating the interpolated image data, the interpolated image generator circuit calculates a pixel value of each of the second interpolation pixels as an average value of pixel values of two pixels of a corresponding one of the combinations corresponding to each of the second interpolation pixels,

wherein the 2 1 -times enlarged image data generated by the first twice-enlarged image generator circuit incorporate the input image, the intermediate pixel image data generated by the first twice-enlarged image generator circuit and the interpolated image data generated by the first twice-enlarged image generator circuit, and

wherein the 2 p -times enlarged image data generated by the p-th twice-enlarged image generator incorporate the 2 p -times enlarged image data, the intermediate pixel image data generated by the p-th twice-enlarged image generator circuit and the interpolated image data generated by the p-th twice-enlarged image generator circuit.

4. The display panel driver according to claim 1 ,

wherein, in calculating a pixel value of a second target pixel of the output image data in the edge enhancement processing, the edge enhancement circuit is configured to calculate a first edge enhancement strength based on a difference between a pixel value of the second target pixel and a pixel value of a pixel adjacent to the second target pixel, calculate a second edge enhancement strength by performing limiting processing on the first edge enhancement strength so that an absolute value of the second edge enhancement strength does not exceed a predetermined limit value, and calculate the pixel value of the second target pixel of the output image data by correcting the pixel value of the second target pixel of the α-times enlarged image described in the α-times enlarged image in response to the second edge enhancement strength.

5. A display device, comprising:

a display panel; and

a display panel driver configured to drive the display panel in response to input image data corresponding to an input image,

wherein the display panel driver includes:

a scaler circuit configured to enlarge the input image with an enlargement factor of α (α is a number larger than one which cannot be represented as 2 k for k being any natural number) to obtain an α-times enlarged image; and

a driver section configured to drive a display panel in response to the α-times enlarged image, and

wherein the scalar circuit obtains the α-times enlarged image by:

generating an intermediate pixel image composed of intermediate pixels, the intermediate pixels obtained by:

dividing the input image into a plurality of 2×2 pixel arrays having four pixel values;

selecting an average value of two pixel values of the four pixel values in each of the 2×2 pixel arrays, the two pixel values being other than a maximum and a minimum value of the four pixel values;

calculating an interpolated pixel image composed of interpolated pixels by enlarging the input image with an enlargement factor of 2n (n is the smallest integer determined so that 2n is larger than α) to obtain a 2n-times enlarged image, wherein values of the interpolated pixels are determined by interpolation of pixel values of selected pixels of the 2n-times enlarged image; and

incorporating the input image, the intermediate pixel image, and the interpolated pixel image into the α-times enlarged image; and

an edge enhancement circuit configured to generate output image data by performing edge enhancement processing on the α-times enlarged image data,

wherein the driver section is further configured to drive the display panel at least partially based on the output image data.

6. The display device according to claim 5 , wherein the scaler circuit includes:

a twice-enlarged image generator circuit configured to generate twice-enlarged image data corresponding to a twice-enlarged image obtained by enlarging the input image with an enlargement factor of two; and

an α-times enlarged image generator circuit configured to generate the α-times enlarged image data from the twice-enlarged image data.

7. The display device according to claim 5 , wherein the scaler circuit includes:

first to n-th twice-enlarged image generator circuits connected in series; and

an α-times enlarged image generator circuit,

wherein the first twice-enlarged image generator circuit is configured to generate a 2 1 -times enlarged image data corresponding to a 2 1 -times enlarged image obtained by enlarging the input image with an enlargement factor of two,

wherein the p-th twice-enlarged image generator circuit (p is an integer from two to n) is configured to generate 2 p -times enlarged image data corresponding to a 2 p -times enlarged image obtained by enlarging the 2 (p-1) -times enlarged image with an enlargement factor of two,

wherein the q-th twice-enlarged image generator circuit of the first to n-th twice-enlarged image generator circuits (q is an integer from one to n) includes:

an intermediate pixel image generator circuit configured to generate intermediate pixel image data corresponding to a second intermediate pixel image composed of second intermediate pixels each corresponding to 2×2pixel arrays included in the input image or the 2 (q-1) -times enlarged image; and

an interpolated image generator circuit configured to generate interpolated image data corresponding to a second interpolated image composed of second interpolation pixels each corresponding to combinations of two pixels of the input image or the 2 (q-1) -times enlarged image adjacent in a horizontal or vertical direction,

wherein, in generating the intermediate pixel image data, the intermediate pixel image generator circuit calculates a pixel value of each of the second intermediate pixels as an average value of two of pixel values of four pixels of a 2×2 pixel array in the input image or the 2 (q-1) -times enlarged image corresponding to each of the second intermediate pixels, the two pixel values being selected other than maximum and minimum values of the pixel values of the four pixels,

wherein, in generating the interpolated image data, the interpolated image generator circuit calculates a pixel value of each of the second interpolation pixels as an average value of pixel values of two pixels of a corresponding one of the combinations corresponding to each of the second interpolation pixels,

wherein the 2 1 -times enlarged image data generated by the first twice-enlarged image generator circuit incorporate the input image, the intermediate pixel image data generated by the first twice-enlarged image generator circuit and the interpolated image data generated by the first twice-enlarged image generator circuit, and

wherein the 2 p -times enlarged image data generated by the p-th twice-enlarged image generator incorporate the 2 p -times enlarged image data, the intermediate pixel image data generated by the p-th twice-enlarged image generator circuit and the interpolated image data generated by the p-th twice-enlarged image generator circuit.

8. The display device according to claim 5 ,

wherein, in calculating a pixel value of a second target pixel of the output image data in the edge enhancement processing, the edge enhancement circuit calculates a first edge enhancement strength based on a difference between a pixel value of the second target pixel and a pixel value of a pixel adjacent to the second target pixel, calculates a second edge enhancement strength by performing limiting processing on the first edge enhancement strength so that an absolute value of the second edge enhancement strength does not exceed a predetermined limit value, and calculates the pixel value of the second target pixel of the output image data by correcting the pixel value of the second target pixel of the α-times enlarged image described in the α-times enlarged image in response to the second edge enhancement strength.

9. An image processing device, comprising:

a scaler circuit configured to enlarge an input image with an enlargement factor of α (α is a number larger than one which cannot be represented as 2 k for k being any natural number) to obtain an α-times enlarged image by:

generating an intermediate pixel image composed of intermediate pixels, the intermediate pixels obtained by:

dividing the input image into a plurality of 2×2 pixel arrays having four pixel values; and

selecting an average value of two pixel values of the four pixel values in each of the 2×2 pixel arrays, the two pixel values being other than a maximum and a minimum value of the four pixel values;

calculating an interpolated pixel image composed of interpolated pixels by enlarging the input image with an enlargement factor of 2n (n is the smallest integer determined so that 2n is larger than α ) to obtain a 2n-times enlarged image, wherein values of the interpolated pixels are determined by interpolation of pixel values of selected pixels of the 2n-times enlarged image; and

incorporating the input image, the intermediate pixel image, and the interpolated pixel image into the α-times enlarged image;

an edge enhancement circuit configured to generate output image data by performing edge enhancement processing on the α-times enlarged image; and

a driver section configured to drive a display panel at least partially based on the output image data.

10. The image processing device according to claim 9 ,

wherein, in calculating a pixel value of a second target pixel of the output image data in the edge enhancement processing, the edge enhancement circuit calculates a first edge enhancement strength based on a difference between a pixel value of the second target pixel and a pixel value of a pixel adjacent to the second target pixel, calculates a second edge enhancement strength by performing limiting processing on the first edge enhancement strength so that an absolute value of the second edge enhancement strength does not exceed a predetermined limit value, and calculates the pixel value of the second target pixel of the output image data by correcting the pixel value of the second target pixel of the α-times enlarged image described in the α-times enlarged image in response to the second edge enhancement strength.

11. An image processing method for performing image enlargement processing on input image data corresponding to an input image to generate α-times enlarged image data corresponding to an α-times enlarged image obtained by enlarging the input image with an enlargement factor of α (α is a number larger than one which cannot be represented as 2 k for k being any natural number), the method comprising:

generating an intermediate pixel image composed of intermediate pixels, the intermediate pixels obtained by:

dividing the input image into a plurality of 2×2 pixel arrays having four pixel values; and

selecting an average value of two pixel values of the four pixel values in each of the 2×2 pixel arrays, the two pixel values being other than a maximum and a minimum value of the four pixel values;

calculating an interpolated pixel image composed of interpolated pixels by enlarging the input image with an enlargement factor of 2n (n is the smallest integer determined so that 2n is larger than α) to obtain a 2n-times enlarged image, wherein values of the interpolated pixels are determined by interpolation of pixel values of selected pixels of the 2n-times enlarged image;

incorporating the input image, the intermediate pixel image, and the interpolated pixel image into the α-times enlarged image;

generating, using an edge enhancement circuit, output image data through performing edge enhancement processing on the α-times enlarged image data; and

driving, using a driver section, the display panel at least partially based on the output image data.

12. The image processing method according to claim 11 ,

wherein, in calculating a pixel value of a second target pixel of the output image data in the edge enhancement processing, a first edge enhancement strength is calculated based on a difference between a pixel value of the second target pixel and a pixel value of a pixel adjacent to the second target pixel, a second edge enhancement strength is calculated by performing limiting processing on the first edge enhancement strength so that an absolute value of the second edge enhancement strength does not exceed a predetermined limit value, and the pixel value of the second target pixel of the output image data is calculated by correcting the pixel value of the second target pixel of the α-times enlarged image described in the α-times enlarged image in response to the second edge enhancement strength.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 20, 2024
From: SYNAPTICS JAPAN GK
To: SYNAPTICS INCORPORATED
Reel/Frame 067793/0211 →
SECURITY INTEREST Recorded Sep 27, 2017
From: SYNAPTICS INCORPORATED
To: WELLS FARGO BANK, NATIONAL ASSOCIATION
Reel/Frame 044037/0896 →
CHANGE OF NAME Recorded Aug 8, 2016
From: SYNAPTICS DISPLAY DEVICES GK
To: SYNAPTICS JAPAN GK
Reel/Frame 039711/0862 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 8, 2015
From: FURIHATA, HIROBUMI; NOSE, TAKASHI; ORIO, MASAO
To: SYNAPTICS DISPLAY DEVICES GK
Reel/Frame 036508/0172 →
Priority Claims (1)
JP 2014-185612 · Sep 11, 2014 · national
Continuity (1)
Related Publication 20160078599A1 · Mar 17, 2016
Cited By (1)
US 12,475,755