IP Library › Granted Patent US 11,783,450
Granted Patent B2
US 11,783,450 · App. 17/212,993 · Granted Oct 10, 2023

Method and device for image processing, terminal device and storage medium

Inventors: Chiaho Pan (Beijing, CN); Lin Liu (Beijing, CN)
Assignee: Beijing Xiaomi Mobile Software Co., Ltd.
G06T5/001G06T7/90G06T2207/10024G06T2207/20081G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,783,450
App. No.
17/212,993
Granted
Oct 10, 2023
Kind
B2
Abstract

Provided are a method and device for image processing, a terminal device and a storage medium. The method includes: a high-brightness region is determined based on brightness of pixels in a first image, the brightness of the pixels in the high-brightness region being higher than the brightness of the pixels around the high-brightness region; a diffraction region in the first image is determined based on the high-brightness region, the diffraction region being an image region around the high-brightness region; and brightness of the diffraction region is reduced to obtain a second image. Through the method, after the brightness of the diffraction region is reduced, an overlap image formed by diffraction is alleviated, and the image is more real.

Claims (67)

1. A method for image processing, comprising:

determining a high-brightness region based on brightness of pixels in a first image, wherein brightness of pixels in the high-brightness region is higher than brightness of pixels around the high-brightness region;

determining a diffraction region in the first image based on the high-brightness region, wherein the diffraction region is an image region around the high-brightness region; and

reducing brightness of the diffraction region to obtain a second image,

wherein determining the high-brightness region based on the brightness of the pixels in the first image comprises:

performing clustering based on a brightness value of each pixel in the first image to obtain different regions, wherein a brightness difference between pixels in any region is within a preset difference range; and

determining a region with a maximum average brightness value from the obtained different regions as the high-brightness region.

2. The method of claim 1 , wherein determining the diffraction region in the first image based on the high-brightness region comprises:

determining a light field distribution of the brightness of the pixels in the first image;

determining whether an image region meeting a diffraction phenomenon exists in a brightness reduction direction of the high-brightness region in the first image or not based on the light field distribution; and

when the image region meeting the diffraction phenomenon exists, determining the image region as the diffraction region.

3. The method of claim 2 , wherein determining whether the image region meeting the diffraction phenomenon exists in the brightness reduction direction of the high-brightness region in the first image or not based on the light field distribution comprises:

determining whether a high-order position exists or not based on the light field distribution and a brightness characteristic of the diffraction phenomenon, wherein the high-order position is a position of pixels of a first partial region in a region of the first image other than the high-brightness region when a difference value between pixel brightness of the first partial region and pixel brightness of a second partial region is greater than a first threshold, and the pixel brightness of the first partial region is higher than the pixel brightness of the second partial region; and

when the high-order position exists, determining that the image region meeting the diffraction phenomenon exists.

4. The method of claim 3 , wherein determining that the image region meeting the diffraction phenomenon exists when the high-order position exists comprises:

determining whether a similarity between a shape formed by the pixels at the high-order position and a shape of the high-brightness region is greater than a first similarity threshold or not; and

when the similarity is greater than the first similarity threshold, determining that the image region meeting the diffraction phenomenon exists.

5. The method of claim 3 , wherein the first image comprises high-order positions of K orders, K being larger than or equal to 2, and pixel brightness at the high-order position of a Kth order is equal to pixel brightness at the high-order position of a (K−1)th order or is negatively correlated with a value of K.

6. The method of claim 1 , further comprising:

determining whether a dispersion phenomenon exists in the diffraction region or not based on a color difference between pixels in the diffraction region and pixels outside the diffraction region, and

wherein reducing the brightness of the diffraction region to obtain the second image comprises: when the dispersion phenomenon exists in the diffraction region, reducing color saturation and the brightness of the diffraction region to obtain the second image.

7. The method of claim 6 , wherein determining whether the dispersion phenomenon exists in the diffraction region or not based on the color difference between the pixels in the diffraction region and the pixels outside the diffraction region comprises:

acquiring a color difference value between the pixels in the diffraction region and the pixels outside the diffraction region; and

when the color difference value is greater than a preset color threshold, determining that the dispersion phenomenon exists in the diffraction region.

8. The method of claim 1 , wherein reducing the brightness of the diffraction region to obtain the second image comprises:

determining a brightness value to be regulated based on a brightness value of each pixel in the diffraction region and a positive relationship with the brightness value of the each pixel; and

subtracting the brightness value to be regulated corresponding to the each pixel from the brightness value of the each pixel in the diffraction region to obtain the second image with a Gaussian distribution of brightness values.

9. The method of claim 1 , wherein reducing the brightness of the diffraction region to obtain the second image comprises:

reducing the brightness of the diffraction region based on an inverse Gamma function to obtain the second image with regulated brightness.

10. The method of claim 1 , wherein reducing the brightness of the diffraction region to obtain the second image comprises:

inputting the first image comprising the diffraction region to a preset image quality compensation model to obtain the second image with regulated brightness, wherein the preset image quality compensation model is obtained by training through a neural network.

11. A device for image processing, comprising:

a processor; and

a memory, storing instructions executable by the processor;

wherein the processor is configured to:

determine a high-brightness region based on brightness of pixels in a first image, wherein brightness of pixels in the high-brightness region is higher than brightness of pixels around the high-brightness region;

determine a diffraction region in the first image based on the high-brightness region, wherein the diffraction region is an image region around the high-brightness region; and

reduce brightness of the diffraction region to obtain a second image,

wherein the processor is further configured to:

perform clustering based on a brightness value of each pixel in the first image to obtain different regions, wherein a brightness difference between pixels in any region is within a preset difference range; and determine a region with a maximum average brightness value from the obtained different regions as the high-brightness region.

12. The device of claim 11 , wherein the processor is further configured to:

determine a light field distribution of the brightness of the pixels in the first image;

determine whether an image region meeting a diffraction phenomenon exists in a brightness reduction direction of the high-brightness region in the first image or not based on the light field distribution and;

when the image region meeting the diffraction phenomenon exists, determine the image region as the diffraction region.

13. The device of claim 12 , wherein the processor is further configured to:

determine whether a high-order position exists or not based on the light field distribution and a brightness characteristic of the diffraction phenomenon, wherein the high-order position is a position of pixels of a first partial region in a region of the first image other than the high-brightness region when a difference value between pixel brightness of the first partial region and pixel brightness of a second partial region is greater than a first threshold, and the pixel brightness of the first partial region is higher than the pixel brightness of the second partial region.

14. The device of claim 13 , wherein the processor is further configured to:

determine whether a similarity between a shape formed by the pixels at the high-order position and a shape of the high-brightness region is greater than a first similarity threshold or not; and

when the similarity is greater than the first similarity threshold, determine that the image region meeting the diffraction phenomenon exists.

15. The device of claim 13 , wherein the first image comprises high-order positions of K orders, K being larger than or equal to 2, and pixel brightness at the high-order position of a Kth order is equal to pixel brightness at the high-order position of a (K−1)th order or is negatively correlated with a value of K.

16. The device of claim 11 , wherein the processor is further configured to:

determine whether a dispersion phenomenon exists in the diffraction region or not based on a color difference between pixels in the diffraction region and pixels outside the diffraction region; and

when the dispersion phenomenon exists in the diffraction region, reduce color saturation and the brightness of the diffraction region to obtain the second image.

17. The device of claim 16 , wherein the processor is further configured to:

acquire a color difference value between the pixels in the diffraction region and the pixels outside the diffraction region; and

when the color difference value is greater than a preset color threshold, determine that the dispersion phenomenon exists in the diffraction region.

18. The device of claim 11 , wherein the processor is further configured to:

determine a brightness value to be regulated based on a brightness value of each pixel in the diffraction region and a positive relationship with the brightness value of the each pixel; and subtract the brightness value to be regulated corresponding to the each pixel from the brightness value of the each pixel in the diffraction region to obtain the second image with a Gaussian distribution of brightness values; or

reduce the brightness of the diffraction region based on an inverse Gamma function to obtain the second image with regulated brightness; or

input the first image comprising the diffraction region to a preset image quality compensation model to obtain the second image with regulated brightness, the preset image quality compensation model being obtained by training through a neural network.

19. A non-transitory computer-readable storage medium, storing instructions that, when executed by a processor of a computer, cause the computer to implement:

determining a high-brightness region based on brightness of pixels in a first image, wherein brightness of pixels in the high-brightness region is higher than brightness of pixels around the high-brightness region;

determining a diffraction region in the first image based on the high-brightness region, wherein the diffraction region is an image region around the high-brightness region; and

reducing brightness of the diffraction region to obtain a second image,

wherein determining the high-brightness region based on the brightness of the pixels in the first image comprises:

performing clustering based on a brightness value of each pixel in the first image to obtain different regions, wherein a brightness difference between pixels in any region is within a preset difference range; and

determining a region with a maximum average brightness value from the obtained different regions as the high-brightness region.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 25, 2021
From: PAN, CHIAHO; LIU, LIN
To: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
Reel/Frame 055724/0235 →
Priority Claims (1)
CN 202010761645.2 · Jul 31, 2020 · national
Continuity (1)
Related Publication 20220036511A1 · Feb 3, 2022
Cited By (1)
US 12,267,601