Image enhancement system to receive image data from imager and display data for executing image enhancement and edge enhancement modification of image data

1 . An image enhancement system for a vehicle, the image enhancement system comprising:

an imager configured to capture image data;

a display operably coupled to the imager and including display data, the display data including an operational state of the display; and

an electronic control unit (ECU) communicatively coupled to the imager and the display and including data processing hardware configured to execute an image enhancement application, the image enhancement application configured to receive the image data from the imager and the display data from the display and being configured to execute an image enhancement and edge enhancement modification of the image data based on the display data including executing bit-plane splicing configured to detect display modulation consisting of flickering or banding and to remove image artifacts by dividing a pixel density of the image data into respective bit planes, the image enhancement application being configured to render an image in response to the image enhancement and the edge enhancement modification.

2 . The image enhancement system of claim 1 , wherein the image enhancement application includes an image signal process configured to receive the display data from the display.

3 . The image enhancement system of claim 2 , wherein the image signal process is configured to render the image data based on the display data received from the display into the image.

4 . The image enhancement system of claim 1 , wherein the image enhancement includes at least one of tone mapping restoration, contrast restoration, luma restoration, and chroma adjustment.

5 . The image enhancement system of claim 4 , wherein the display data includes at least one of a backlight ratio, a contrast ratio, and a display density, and the data processing hardware is configured to execute the image enhancement based on at least one of the operational state, the backlight ratio, the contrast ratio, and the display density.

6 . The image enhancement system of claim 5 , wherein the image enhancement application is configured to compare the pixel density from the image data and the display density of the display data.

7 . The image enhancement system of claim 1 , wherein the edge enhancement modification includes image composition, the data processing hardware configured to execute the image composition in response to the image enhancement.

8 . An image enhancement system comprising:

a display including display data;

an imager operably coupled to and disposed behind the display, the imager being configured to capture image data; and

an electronic control unit (ECU) communicatively coupled to the imager and the display and including data processing hardware configured to execute an image enhancement application, the image enhancement application configured to receive the image data from the imager and the display data from the display and to execute an image enhancement and edge enhancement modification of the image data based on the display data including executing bit-plane splicing configured to detect display modulation consisting of flickering or banding and to remove image artifacts by dividing a pixel density of the image data into respective bit planes.

9 . The image enhancement system of claim 8 , wherein the image enhancement application includes an image signal process configured to receive the display data from the display.

10 . The image enhancement system of claim 9 , wherein the image signal process is configured to render the image data based on the display data received from the display.

11 . The image enhancement system of claim 8 , wherein the image enhancement includes at least one of tone mapping restoration, contrast restoration, luma restoration, and chroma adjustment.

12 . The image enhancement system of claim 11 , wherein the display data includes at least one of an operational state, a backlight ratio, a contrast ratio, and a display density, and the data processing hardware is configured to execute the image enhancement based on at least one of the operational state, the backlight ratio, the contrast ratio, and the display density.

13 . The image enhancement system of claim 12 , wherein the image enhancement application is configured to compare the pixel density from the image data and the display density of the display data.

14 . The image enhancement system of claim 8 , wherein the edge enhancement modification includes image composition, the data processing hardware configured to execute the image composition in response to the image enhancement.

15 . A computer-implemented method when executed by data processing hardware causes the data processing hardware to perform operations comprising:

acquiring display data from a display including an operational state;

monitoring, via a lookup table value, a display data of the display;

acquiring image data from an imager;

rendering, via an image enhancement application, the acquired image data in response to the operational state of the display;

executing, via the image enhancement application, image enhancement of the rendered image data based on the display data;

executing, via the image enhancement application, an edge enhancement modification of the image data;

executing bit-plane splicing configured to detect display modulation consisting of flickering or banding and to remove image artifacts by dividing a pixel density of the image data into respective bit planes; and

composing the enhanced image data.

16 . The method of claim 15 , wherein executing the image enhancement includes one or more of performing tone mapping restoration of the image data, performing contrast restoration of the image data, performing luma restoration of the image data, and performing chroma adjustment of the image data.

17 . The method of claim 15 , further including constructing the imager behind the display.

18 . The method of claim 15 , wherein acquiring the display data includes acquiring a backlight ratio, a contrast ratio, and a display density.

19 . The method of claim 15 , wherein executing the image enhancement and executing the edge enhancement modification includes referencing the display data.

20 . The method of claim 15 , further including:

bypassing the image enhancement when the operational state of the display is an inactive state; and

composing the image data via an image signal directly.