Granted Patent B2

US 12,217,388 · App. 17/739,963 · Granted Feb 4, 2025

Inventor: Kun Yao (Yufengshan, CN)

Assignee: REALME CHONGQING MOBILE TELECOMMUNICATIONS CORP, LTD.

G06T3/4053G06T5/50G06T2207/20221

Abstract

Claims (60)

1. An image processing method, comprising:

acquiring a first image and a second image, wherein a resolution of the second image is greater than a resolution of the first image;

determining difference information between a target pixel in the second image and a reference pixel in the first image corresponding to the target pixel; and

acquiring a target image with the same resolution as the second image by applying an image differencing process to a predetermined image with the same resolution as the first image based on the difference information.

2. The image processing method of claim 1 , wherein determining difference information between the target pixel in the second image and the reference pixel in the first image corresponding to the target pixel comprises:

using every pixel in the second image as the target pixel;

determining a corresponding coordinate in the first image based on a coordinate of the target pixel to determine the reference pixel in the first image;

acquiring a difference coefficient between a pixel value of the target pixel and a pixel value of the reference pixel; and

generating the difference information based on the difference coefficient.

3. The image processing method of claim 2 , wherein acquiring the difference coefficient between the pixel value of the target pixel and the pixel value of the reference pixel comprises:

calculating predetermined difference coefficients in multiple directions between the pixel value of the target pixel and the pixel value of the reference pixel to obtain the difference coefficient.

4. The image processing method of claim 3 , wherein calculating the predetermined difference coefficients in the multiple directions between the pixel value of the target pixel and the pixel value of the reference pixel to obtain the difference coefficient comprises:

splicing the predetermined difference coefficients in the multiple directions to obtain the difference coefficient between the target pixel and the reference pixel.

5. The image processing method of claim 2 , wherein generating the difference information based on the difference coefficient comprises:

combining the difference coefficient of every pixel to generate the difference information.

6. The image processing method of claim 1 , wherein performing difference processing on the predetermined image that conforms to the resolution of the first image based on the difference information, and acquiring a target image that conforms to the resolution of the second image comprises:

performing a logical operation on the pixel value of all pixels in the predetermined image based on the difference information, and adjusting the pixel value of all pixels to the pixel value with the same resolution as the second image to obtain the target image.

7. The image processing method of claim 6 , wherein performing the logical operation on the pixel value of all pixels in the predetermined image based on the difference information, and adjusting the pixel value of all pixels to the pixel value that with the same resolution as the second image to obtain the target image comprises:

fusing the difference information with the predetermined image, and converting the predetermined image with the same resolution as the first image into an image with the same resolution as the second image through results of fusing and conversion to obtain the target image.

8. The image processing method of claim 2 , wherein the method further comprises:

acquiring a second auxiliary image after a predetermined period, and updating the difference coefficient based on the second auxiliary image to determine the difference information based on the updated difference coefficient.

9. The image processing method of claim 8 , wherein acquiring the second auxiliary image after the predetermined period, and updating the difference coefficient based on the second auxiliary image to determine the difference information based on the updated difference coefficient comprises:

acquiring at least one frame of the second auxiliary image based on the reference information;

re-determining the target pixel is based on the at least one frame of the second auxiliary image, updating the difference coefficient based on the re-determined second auxiliary image and the corresponding reference pixel, and determining the difference information based on the updated difference coefficient.

10. The image processing method of claim 9 , wherein acquiring the at least one frame of the second auxiliary image based on the reference information comprises:

collecting multiple frames of the second auxiliary image if the reference information satisfies an update condition; or

collecting one frame of the second auxiliary image if the reference information does not satisfy the update condition.

11. The image processing method of claim 9 , wherein updating the difference coefficient based on the re-determined second auxiliary image and the corresponding reference pixel, and determining the difference information based on the updated difference coefficient if the second auxiliary image is one frame comprises:

updating the original difference coefficient based on the difference coefficient composed of all pixels in the second auxiliary image in multiple directions, and determining the difference information based on the updated difference coefficient.

12. The image processing method of claim 9 , wherein updating the difference coefficient based on the re-determined second auxiliary image and the corresponding reference pixel, and determining the difference information based on the updated difference coefficient if the second auxiliary image includes multiple frames comprises:

re-determining the target pixel of each frame of the second auxiliary image, and determine the difference coefficient of each frame of the second auxiliary image based on the re-determined target pixel of each frame of the second auxiliary image and its corresponding reference pixel; and

performing an averaging processing on the difference coefficient of each frame of the second auxiliary image to obtain an average difference coefficient, and updating the difference information based on the average difference coefficient.

13. An electronic device, comprising:

an image sensor;

a processor; and

a memory, configured to store executable instructions of the processor;

wherein the processor is configured to execute the executable instructions on an image acquired by the image sensor to:

acquire a first image and a second image, wherein a resolution of the second image is greater than a resolution of the first image;

determine difference information between a target pixel in the second image and a reference pixel in the first image corresponding to the target pixel; and

acquire a target image with the same resolution as the second image by applying an image differencing process to a predetermined image with the same resolution as the first image based on the difference information.

14. The electronic device of claim 13 , wherein determine difference information between the target pixel in the second image and the reference pixel in the first image corresponding to the target pixel comprises:

use every pixel in the second image as the target pixel;

determine a corresponding coordinate in the first image based on a coordinate of the target pixel to determine the reference pixel in the first image;

acquire a difference coefficient between a pixel value of the target pixel and a pixel value of the reference pixel; and

generate the difference information based on the difference coefficient.

15. The electronic device of claim 14 , wherein acquire the difference coefficient between the pixel value of the target pixel and the pixel value of the reference pixel comprises:

calculate predetermined difference coefficients in multiple directions between the pixel value of the target pixel and the pixel value of the reference pixel to obtain the difference coefficient.

16. The electronic device of claim 13 , wherein acquire a target image with the same resolution as the second image by applying an image differencing process to a predetermined image with the same resolution as the first image based on the difference information comprises:

perform a logical operation on the pixel value of all pixels in the predetermined image based on the difference information, and adjusting the pixel value of all pixels to the pixel value with the same resolution as the second image to obtain the target image.

17. The electronic device of claim 16 , wherein perform a logical operation on the pixel value of all pixels in the predetermined image based on the difference information, and adjusting the pixel value of all pixels to the pixel value with the same resolution as the second image to obtain the target image comprises:

fuse the difference information with the predetermined image, and converting the predetermined image with the same resolution as the first image into an image that with the same resolution as the second image through results of fusing and conversion to obtain the target image.

18. The electronic device of claim 14 , the instructions further cause the one or more processors to:

acquire a second auxiliary image after a predetermined period, and updating the difference coefficient based on the second auxiliary image to determine the difference information based on the updated difference coefficient.

19. The electronic device of claim 18 , wherein acquire the second auxiliary image after the predetermined period, and updating the difference coefficient based on the second auxiliary image to determine the difference information based on the updated difference coefficient comprises:

acquire at least one frame of the second auxiliary image based on the reference information;

re-determine the target pixel is based on the at least one frame of the second auxiliary image, updating the difference coefficient based on the re-determined second auxiliary image and the corresponding reference pixel, and determining the difference information based on the updated difference coefficient.

20. A non-transitory computer-readable storage medium having stored therein instructions that, when executed by a processor, cause the processor to:

acquire a first image and a second image, wherein a resolution of the second image is greater than a resolution of the first image;

determine difference information between a target pixel in the second image and a reference pixel in the first image corresponding to the target pixel; and

acquire a target image with the same resolution as the second image by applying an image differencing process to a predetermined image with the same resolution as the first image based on the difference information.

Assignments (1)

Priority Claims (1)

Continuity (2)

References Cited (14)