Display device and visibility improvement method of image therefor

1 . A display device, comprising:

processing circuitry; and

a memory coupled to the processing circuitry, wherein the processing circuitry is configured to:

obtain input frame data corresponding to an image;

classify content represented in the image as at least one first class of a plurality of classes;

obtain image brightness level information of the input frame data;

obtain an illuminance signal for the image;

generate global compensation information based on the input frame data, the at least one first class, the image brightness level information, and the illuminance signal;

identify a plurality of unit areas of the image;

generate local compensation information for each unit area of the plurality of unit areas;

generate output frame data based on blending the global compensation information and the local compensation information; and

output the generated output frame data to a display,

wherein the processing circuitry is further configured to:

generate visibility reduction modeling information for compensation of a preset high luminance area and a preset low luminance area of the global compensation information; and

output the visibility reduction modeling information.

2 . The display device according to claim 1 , wherein the processing circuitry is further configured to:

generate the image brightness level information of the input frame data.

3 . The display device according to claim 1 , wherein the processing circuitry is further configured to:

store class information of the plurality of classes on pre-classified content; and

classify the content represented in the image as the at least one first class based on the stored class information.

4 . The display device according to claim 1 , wherein the processing circuitry is further configured to:

calculate average brightness of the input frame data, wherein the obtained image brightness level information is the calculated result.

5 . The display device according to claim 1 , wherein the processing circuitry is further configured to:

store a plurality of pieces of global compensation graph data;

select one or more pieces of global compensation graph data corresponding to the illuminance signal, the at least one first class, and the image brightness level information;

generate a global compensation graph corresponding to the selected one or more pieces of global compensation graph data; and

output the global compensation information by calculating the input frame data using the global compensation graph.

6 . The display device according to claim 5 ,

wherein the global compensation graph data comprises a brightness value table and a saturation table, and

wherein the brightness value table and the saturation table are set to have values corresponding to a plurality of preset levels among luminance ranges of the input frame data.

7 . The display device according to claim 6 , wherein the global compensation graph corresponds to the brightness value table and the saturation table, and wherein the processing circuitry is further configured to:

convert a first brightness value and a first saturation of the input frame data into a second brightness value and a second saturation corresponding to the brightness value table and the saturation table; and

output the global compensation information having values corresponding to the second brightness value and the second saturation.

8 . The display device according to claim 1 , wherein the processing circuitry is further configured to:

generate the local compensation information by performing the local compensation on the input frame data; and

generate the output frame data by blending the global compensation information and the local compensation information.

9 . The display device according to claim 8 , wherein the processing circuitry is further configured to:

obtain a local contrast map in which a proportional relationship between visibility reduction modeling information and the input frame data is normalized;

obtain a local contrast weighted map, wherein the local contrast weighted map is obtained by applying a weight corresponding to the image brightness level information to the local contrast map; and

compensate the preset high luminance area and the preset low luminance area of the global compensation information based on the local contrast weighted map.

10 . The display device according to claim 9 , wherein the weight is set by a weight calculation formula such that a larger brightness value is set to be smaller and a lower brightness value is set to be larger with respect to a preset range of the image brightness level information.

11 . The display device according to claim 9 , wherein the processing circuitry is further configured to:

convert the input frame data according to a blending calculation formula, wherein the blending calculation formula is based on the local compensation information, the local contrast weighted map, and the global compensation information.

12 . A method for improving visibility of an image for a display device, the method comprising:

obtaining input frame data corresponding to an image;

classifying content represented in the image as at least one first class of a plurality of classes;

calculating image brightness level informative of the input frame data;

obtaining an illuminance signal for the image;

generating global compensation information based on the input frame data, the at least one first class, the image brightness level information, and the illuminance signal;

generating output frame data based on the global compensation information; and

outputting the generated output frame data to a display,

wherein the method further comprises:

identifying a plurality of unit areas of the image; and

generating local compensation information for each unit area of the plurality of unit areas,

wherein the generating the output frame data comprises blending the local compensation information and the global compensation information, and

wherein the method further comprises:

generating visibility reduction modeling information for compensating for a preset high luminance area and a preset low luminance area of the global compensation information; and

outputting the visibility reduction modeling information, wherein the generating the output frame data comprises controlling the blending of the local compensation information and the global compensation information corresponding to the visibility reduction modeling information and the image brightness level information.

13 . The method according to claim 12 , further comprising:

generating the local compensation information by performing the local compensation on the input frame data; and

generating the output frame data by blending the global compensation information and the local compensation information.

14 . The method according to claim 13 , further comprising:

obtaining a local contrast map in which a proportional relationship between visibility reduction modeling information and the input frame data is normalized;

obtaining a local contrast weighted map, wherein the local contrast weighted map is obtained by applying a weight corresponding to the image brightness level information to the local contrast map; and

compensating the preset high luminance area and the preset low luminance area of the global compensation information based on the local contrast weighted map.

15 . The method according to claim 14 , wherein the weight is set by a weight calculation formula such that a larger brightness value is set to be smaller and a lower brightness value is set to be larger with respect to a preset range of the image brightness level information.

16 . The method according to claim 14 , further comprising:

converting the input frame data according to a blending calculation formula, wherein the blending calculation formula is based on the local compensation information, the local contrast weighted map, and the global compensation information.

17 . A computer program product comprising a non-transitory computer readable medium storing computer readable instructions, wherein, when executed by processing circuitry, the computer readable instructions cause the processing circuitry to:

obtain input frame data corresponding to an image;

classify content represented in the image as at least one first class of a plurality of classes;

obtain image brightness level information of the input frame data;

obtain an illuminance signal for the image;

generate global compensation information based on the input frame data, the at least one first class, the image brightness level information, and the illuminance signal;

identify a plurality of unit areas of the image;

generate local compensation information for each unit area of the plurality of unit areas;

generate output frame data based on blending the global compensation information and the local compensation information;

output the generated output frame data to a display,

generate visibility reduction modeling information for compensation of a preset high luminance area and a preset low luminance area of the global compensation information; and

output the visibility reduction modeling information.