Viewing system to dynamic real time optimize image quality for every customer viewport
Systems, methods, and apparatus are provided for real-time adjustment of image quality parameters. The system includes a controller configured to: acquire an image frame, having a fixed-pixel region that defines a region-of-interest, from one or more imaging devices; apply image processing techniques to determine a modified fixed-pixel region that excludes non-relevant object pixels; alter one or more image quality parameters based on statistics of pixels in the modified fixed-pixel region; and provide the altered one or more image quality parameters to the one or more imaging devices for use with subsequent image frames; wherein the one or more imaging devices produce an image that is tuned, based on the altered one or more image quality parameters, to the portions of the image in the region-of-interest that does not include the non-relevant object pixels.
1. A system in a motor vehicle for real-time adjustment of image quality parameters for images taken by image sensors, the system comprising:
an HMI (human machine interface) comprising a display screen in the motor vehicle;
an optical imaging device on the motor vehicle;
a controller, the controller configured to:
acquire an image frame from the optical imaging device, the image frame having a fixed-pixel region that defines a region-of-interest for viewing on the display screen of the HMI, the region-of-interest including pixels representing an environment exterior to the motor vehicle and pixels representing one or more external components of the motor vehicle;
determine a boundary for the region-of-interest in the fixed-pixel region that excludes the pixels representing the one or more external components of the motor vehicle by applying a morphological processing algorithm;
based on the boundary, determine a modified fixed-pixel region by removing the pixels representing the one or more external components of the motor vehicle;
alter a tone-mapping parameter to an altered tone-mapping parameter based on statistics of pixels in the modified fixed-pixel region;
alter an auto-exposure parameter to an altered auto-exposure parameter based on statistics of the pixels in the modified fixed-pixel region; and
provide the altered tone-mapping parameter and the altered auto-exposure parameter to the optical imaging devices for use with subsequent image frames; and
wherein the optical imaging devices is configured to apply the altered tone-mapping parameter and the altered auto-exposure parameter produce an image of the region-of-interest that is tuned based on the altered tone-mapping parameter and the altered auto-exposure parameter;
wherein the display screen of the HMI is configured to display the image of the region-of-interest that is tuned based on the altered tone-mapping parameter and the altered auto-exposure parameter.
2. The system of claim 1 , wherein the controller is configured to:
resize the fixed-pixel region in accordance with the boundary.
3. The system of claim 2 , wherein the controller is further configured to:
apply object recognition techniques to recognize the pixels representing the one or more external components of the motor vehicle in the fixed-pixel region.
4. The system of claim 2 , wherein the controller is further configured to apply edge contouring processing techniques to determine the boundary for the region-of-interest in the fixed-pixel region that excludes the pixels representing the one or more external components of the motor vehicle.
5. The system of claim 4 , wherein the display screen of the HMI is on a vehicle HMI.
6. The system of claim 1 , wherein the display screen of the HMI is on a mobile device.
7. The system of claim 1 , wherein the controller is further configured to:
receive an indication that a series of images are to be captured for use with a consuming device; and
instruct the motor vehicle to interact with the optical imaging devices to acquire a plurality of image frames for a viewport.
8. A method in a motor vehicle for real-time adjustment of image quality parameters for images taken by image sensors, the method comprising:
acquiring an image frame from an optical imaging device on the motor vehicle, the image frame having a fixed-pixel region that defines a region-of-interest for viewing on a display screen of an HMI (human machine interface) in the motor vehicle, the region-of-interest including pixels representing an environment exterior to the motor vehicle and pixels representing one or more external components of the motor vehicle;
determining a boundary for the region-of-interest in the fixed-pixel region that excludes the pixels representing the one or more external components of the motor vehicle;
determining a modified fixed-pixel region by removing the pixels representing the one or more external components of the motor vehicle;
altering a tone-mapping parameter to an altered tone-mapping parameter based on statistics of pixels in the modified fixed-pixel region;
altering an auto-exposure parameter to an altered auto-exposure parameter based on statistics of the pixels in the modified fixed-pixel region;
providing the altered tone-mapping parameter and the altered auto-exposure parameter to the optical imaging devices for use with subsequent image frames;
applying, by the optical imaging device, the altered tone-mapping parameter and the altered auto-exposure parameter to produce an image of the region-of-interest that is tuned based on the altered tone-mapping parameter and the altered auto-exposure parameter; and
displaying, by the display screen of the HMI, the image of the region-of-interest that is tuned based on the altered tone-mapping parameter and the altered auto-exposure parameter.
9. The method of claim 8 , further comprising:
resizing the fixed-pixel region in accordance with the boundary.
10. The method of claim 8 , further comprising:
applying object recognition techniques to recognize the pixels representing the one or more external components of the motor vehicle in the fixed-pixel region.
11. The method of claim 8 , further comprising applying edge contouring processing techniques to determine the boundary for the region-of-interest in the fixed-pixel region that excludes the pixels representing the one or more external components of the motor vehicle.
12. The method of claim 8 , further comprising applying morphological processing techniques to determine the boundary for the region-of-interest in the fixed-pixel region that excludes the pixels representing the one or more external components of the motor vehicle.
13. The method of claim 8 , wherein the display screen of the HMI is on a mobile device.
14. The method of claim 8 , further comprising:
receiving an indication that a series of images are to be captured for use with a consuming device; and
instructing the motor vehicle to interact with the optical imaging devices to acquire a plurality of image frames for a viewport.
15. A vehicle comprising:
an optical imaging devices;
a controller configured to:
acquire an image frame from the optical imaging device, the image frame having a fixed-pixel region that defines a region-of-interest for viewing on a display screen of an HMI (human machine interface), the region-of-interest including pixels representing an environment exterior to the vehicle and pixels representing one or more external components of the vehicle;
determine a boundary for the region-of-interest in the fixed-pixel region that excludes the pixels representing the one or more external components of the vehicle;
based on the boundary, determine a modified fixed-pixel region by removing the pixels representing the one or more external components of the vehicle;
alter a tone-mapping parameter to an altered tone-mapping parameter based on statistics of pixels in the modified fixed-pixel region;
alter an auto-exposure parameter to an altered auto-exposure parameter based on statistics of the pixels in the modified fixed-pixel region; and
provide the altered tone-mapping parameter and the altered auto-exposure parameter to the optical imaging devices for use with subsequent image frames; and
wherein the optical imaging device is configured to apply the altered tone-mapping parameter and the altered auto-exposure parameter to produce an image of the region-of-interest that is tuned based on the altered tone-mapping parameter and the altered auto-exposure parameter;
wherein the display screen of the HMI is configured to display the image of the region-of-interest that is tuned based on the altered tone-mapping parameter and the altered auto-exposure parameter.
16. The vehicle of claim 15 , wherein the controller is configured to:
resize the fixed-pixel region in accordance with the boundary.
17. The vehicle of claim 15 , wherein the controller is further configured to:
apply object recognition techniques to recognize the pixels representing the one or more external components of the vehicle in the fixed-pixel region.
18. The vehicle of claim 15 , wherein the controller is further configured to apply edge contouring processing techniques to determine the boundary for the region-of-interest in the fixed-pixel region that excludes the pixels representing the one or more external components of the vehicle.
19. The vehicle of claim 15 , wherein the controller is further configured to apply morphological processing techniques to determine the boundary for the region-of-interest in the fixed-pixel region that excludes the pixels representing the one or more external components of the vehicle.
20. The vehicle of claim 15 , wherein the display screen of the HMI is on a mobile device.