Granted Patent B2

US 12,301,992 · App. 18/038,578 · Granted May 13, 2025

Inventors: Tiantian Zhang (Shenzhen, CN); Yu Wang (Shenzhen, CN); Zhiqi Li (Shenzhen, CN); Ning Wang (Shenzhen, CN); Congchao Zhu (Shenzhen, CN)

Assignee: Honor Device Co., Ltd.

H04N23/6811H04N23/6812H04N23/687

Abstract

Claims (71)

1. An image blur degree determining method, the method comprising:

obtaining, by an electronic device, an original image;

determining, by the electronic device, for each image block arranged in a column direction in the original image, a homography transformation matrix corresponding to the image block, wherein the column direction is perpendicular to a row direction in which the electronic device performs row-by-row exposure; and

determining, by the electronic device, a blur degree of the original image based on the homography transformation matrices corresponding to the image blocks, wherein the determining the blur degree of the original image comprises:

determining, for each image block, based on the image block and the corresponding homography transformation matrix, a blur degree corresponding to the image block; and

determining an average value of blur degrees corresponding to the image blocks, wherein the average value is the blur degree of the original image.

2. The image blur degree determining method according to claim 1 , wherein the electronic device comprises a gyro sensor and an optical image stabilization (OIS) controller, and the method further comprises:

obtaining original gyro data by using the gyro sensor;

determining, based on the original gyro data, first gyro data separately corresponding to each image block at an exposure start moment and an exposure end moment;

obtaining original OIS data by using the OIS controller; and

determining, based on the original OIS data, first OIS data separately corresponding to each image block at the exposure start moment and the exposure end moment.

3. The image blur degree determining method according to claim 2 , wherein the determining, for each image block arranged in the column direction in the original image, the homography transformation matrix corresponding to the image block comprises:

determining, for each image block based on the first gyro data separately corresponding to the image block at the exposure start moment and the exposure end moment and the first OIS data separately corresponding to the image block at the exposure start moment and the exposure end moment, the homography transformation matrix corresponding to the image block.

4. The image blur degree determining method according to claim 3 , wherein the determining, for each image block based on the first gyro data separately corresponding to the image block at the exposure start moment and the exposure end moment and the first OIS data separately corresponding to the image block at the exposure start moment and the exposure end moment, the homography transformation matrix corresponding to the image block comprises:

determining a rotation matrix for each image block based on the first gyro data separately corresponding to the image block at the exposure start moment and the exposure end moment;

determining a first camera intrinsic parameter matrix based on the first OIS data separately corresponding to the image block at the exposure start moment and the exposure end moment, wherein the first camera intrinsic parameter matrix is used to indicate a corresponding camera intrinsic parameter matrix used when the OIS controller is enabled; and

determining the homography transformation matrix based on the rotation matrix and the first camera intrinsic parameter matrix by using a formula H=KRK ois −1 ,

wherein H represents the homography transformation matrix, K represents a standard camera intrinsic parameter, R represents the rotation matrix, and K ois −1 represents an inverse of the first camera intrinsic parameter matrix.

5. The image blur degree determining method according to claim 1 , wherein the determining, for each image block, based on the image block and the corresponding homography transformation matrix, the blur degree corresponding to the image block comprises:

determining, for any target point in the image block, first coordinates of the target point in the image block;

transforming the first coordinates of the target point by using the homography transformation matrix corresponding to the image block, to determine second coordinates corresponding to the target point after transformation; and

determining, based on coordinate differences between the first coordinates and the second coordinates, the blur degree corresponding to the image block, wherein the coordinate differences comprise a coordinate difference in the row direction and a coordinate difference in the column direction.

6. An electronic device, comprising:

a camera configured to obtain an original image;

a processor; and

a memory configured to store a computer program that, when run on the processor, causes the electronic device to perform operations comprising:

determining, for each image block arranged in a column direction in the original image, a homography transformation matrix corresponding to the image block, wherein the column direction is perpendicular to a row direction in which the electronic device performs row-by-row exposure; and

determining a blur degree of the original image based on the homography transformation matrices corresponding to the image blocks, wherein the determining the blur degree of the original image comprises:

determining, for each image block, based on the image block and the corresponding homography transformation matrix, a blur degree corresponding to the image block; and

determining an average value of blur degrees corresponding to the image blocks, wherein the average value is the blur degree of the original image.

7. The electronic device according to claim 6 , further comprising:

a gyro sensor; and

an optical image stabilization (OIS) controller;

wherein the computer program, when run on the processor, further causes the electronic device to perform operations comprising:

obtaining original gyro data by using the gyro sensor;

determining, based on the original gyro data, first gyro data separately corresponding to each image block at an exposure start moment and an exposure end moment;

obtaining original OIS data by using the OIS controller; and

determining, based on the original OIS data, first OIS data separately corresponding to each image block at the exposure start moment and the exposure end moment.

8. The electronic device according to claim 7 , wherein the determining, for each image block arranged in the column direction in the original image, the homography transformation matrix corresponding to the image block comprises:

determining, for each image block based on the first gyro data separately corresponding to the image block at the exposure start moment and the exposure end moment and the first OIS data separately corresponding to the image block at the exposure start moment and the exposure end moment, the homography transformation matrix corresponding to the image block.

9. The electronic device according to claim 8 , wherein the determining, for each image block based on the first gyro data separately corresponding to the image block at the exposure start moment and the exposure end moment and the first OIS data separately corresponding to the image block at the exposure start moment and the exposure end moment, the homography transformation matrix corresponding to the image block comprises:

determining a rotation matrix for each image block based on the first gyro data separately corresponding to the image block at the exposure start moment and the exposure end moment;

determining a first camera intrinsic parameter matrix based on the first OIS data separately corresponding to the image block at the exposure start moment and the exposure end moment, wherein the first camera intrinsic parameter matrix is used to indicate a corresponding camera intrinsic parameter matrix used when the OIS controller is enabled; and

determining the homography transformation matrix based on the rotation matrix and the first camera intrinsic parameter matrix by using a formula H=KRK ois −1 ,

wherein H represents the homography transformation matrix, K represents a standard camera intrinsic parameter, R represents the rotation matrix, and K ois −1 represents an inverse of the first camera intrinsic parameter matrix.

10. The electronic device according to claim 6 , wherein the determining, for each image block, based on the image block and the corresponding homography transformation matrix, the blur degree corresponding to the image block comprises:

determining, for any target point in the image block, first coordinates of the target point in the image block;

transforming the first coordinates of the target point by using the homography transformation matrix corresponding to the image block, to determine second coordinates corresponding to the target point after transformation; and

determining, based on coordinate differences between the first coordinates and the second coordinates, the blur degree corresponding to the image block, wherein the coordinate differences comprise a coordinate difference in the row direction and a coordinate difference in the column direction.

11. A non-transitory computer-readable storage medium that stores a computer program, wherein the computer program comprises program instructions, and when the program instructions are executed by a processor of an electronic device, the processor is enabled to perform operations comprising:

obtaining an original image;

determining, for each image block arranged in a column direction in the original image, a homography transformation matrix corresponding to the image block, wherein the column direction is perpendicular to a row direction in which the electronic device performs row-by-row exposure; and

determining a blur degree of the original image based on the homography transformation matrices corresponding to the image blocks, wherein the determining the blur degree of the original image comprises:

determining, for each image block, based on the image block and the corresponding homography transformation matrix, a blur degree corresponding to the image block; and

determining an average value of blur degrees corresponding to the image blocks, wherein the average value is the blur degree of the original image.

12. The computer-readable storage medium according to claim 11 , wherein the electronic device comprises a gyro sensor and an optical image stabilization (OIS) controller, and the operations further comprise:

obtaining original gyro data by using the gyro sensor;

determining, based on the original gyro data, first gyro data separately corresponding to each image block at an exposure start moment and an exposure end moment;

obtaining original OIS data by using the OIS controller; and

determining, based on the original OIS data, first OIS data separately corresponding to each image block at the exposure start moment and the exposure end moment.

13. The computer-readable storage medium according to claim 12 , wherein the determining, for each image block arranged in the column direction in the original image, the homography transformation matrix corresponding to the image block comprises:

determining, for each image block based on the first gyro data separately corresponding to the image block at the exposure start moment and the exposure end moment and the first OIS data separately corresponding to the image block at the exposure start moment and the exposure end moment, the homography transformation matrix corresponding to the image block.

14. The computer-readable storage medium according to claim 13 , wherein the determining, for each image block based on the first gyro data separately corresponding to the image block at the exposure start moment and the exposure end moment and the first OIS data separately corresponding to the image block at the exposure start moment and the exposure end moment, the homography transformation matrix corresponding to the image block comprises:

determining a rotation matrix for each image block based on the first gyro data separately corresponding to the image block at the exposure start moment and the exposure end moment;

determining a first camera intrinsic parameter matrix based on the first OIS data separately corresponding to the image block at the exposure start moment and the exposure end moment, wherein the first camera intrinsic parameter matrix is used to indicate a corresponding camera intrinsic parameter matrix used when the OIS controller is enabled; and

determining the homography transformation matrix based on the rotation matrix and the first camera intrinsic parameter matrix by using a formula H=KRK ois −1 ,

wherein H represents the homography transformation matrix, K represents a standard camera intrinsic parameter, R represents the rotation matrix, and K ois −1 represents an inverse of the first camera intrinsic parameter matrix.

15. The computer-readable storage medium according to claim 11 , wherein the determining, for each image block, based on the image block and the corresponding homography transformation matrix, the blur degree corresponding to the image block comprises:

determining, for any target point in the image block, first coordinates of the target point in the image block;

transforming the first coordinates of the target point by using the homography transformation matrix corresponding to the image block, to determine second coordinates corresponding to the target point after transformation; and

determining, based on coordinate differences between the first coordinates and the second coordinates, the blur degree corresponding to the image block, wherein the coordinate differences comprise a coordinate difference in the row direction and a coordinate difference in the column direction.

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (20)