Image processing method
View Patent ↗An image processing method includes obtaining two-dimensional and three-dimensional images of an object, extracting luminance and depth information from the three-dimensional image to generate luminance and depth image for the object, graying the two-dimensional image to obtain a single-channel grayscale image, selecting at least three same-location points from each of the grayscale and luminance image, calculating a coordinate transformation matrix between the grayscale and luminance images based on coordinates of the at least three same-location points in each of the grayscale and luminance images, and aligning the two-dimensional image with the luminance and depth images based on the coordinate transformation matrix to obtain fused image data. The fused image data includes color information of the two-dimensional image and the luminance and depth information of the three-dimensional image.
1. An image processing method, comprising:
obtaining a two-dimensional image and a three-dimensional image of an object;
extracting luminance information and depth information from the three-dimensional image to generate a luminance image and a depth image for the object;
graying the two-dimensional image to obtain a single-channel grayscale image;
selecting at least three same-location points from each of the grayscale image and the luminance image;
calculating a coordinate transformation matrix between the grayscale image and the luminance image based on coordinates of the at least three same-location points in each of the grayscale image and the luminance image; and
aligning the two-dimensional image with the luminance image and the depth image based on the coordinate transformation matrix, to obtain fused image data, wherein the fused image data comprises color information of the two-dimensional image and the luminance information and the depth information of the three-dimensional image.
2. The image processing method according to claim 1 , wherein the at least three same-location points are points of the object with specificity.
3. The image processing method according to claim 1 , wherein the at least three same-location points comprise three non-collinear reference points.
4. The image processing method according to claim 3 , wherein a maximum interior angle of a triangle formed by the three reference points is not greater than 160°.
5. The image processing method according to claim 1 , wherein aligning the two-dimensional image with the luminance image and the depth image to obtain fused image data comprises:
aligning the luminance image and the depth image with the two-dimensional image based on the coordinate transformation matrix using coordinates in the two-dimensional image as reference; and
generating a fused image containing three-channel information using grayscale information of the grayscale image, and the luminance information and the depth information that are aligned to the coordinates in the two-dimensional image, as information of three channels, respectively.
6. The image processing method according to claim 1 , further comprising, before aligning the two-dimensional image with the luminance image and the depth image:
normalizing depth values in the depth image to generate a normalized depth image.
7. The image processing method according to claim 1 , wherein the object is one selected from: a battery surface, a battery top cover weld, and a battery sealing pin.
8. A non-transitory storage medium storing instructions that, when executed by a processor, cause the processor to:
obtain a two-dimensional image and a three-dimensional image of an object;
extract luminance information and depth information from the three-dimensional image to generate a luminance image and a depth image for the object;
gray the two-dimensional image to obtain a single-channel grayscale image;
select at least three same-location points from each of the grayscale image and the luminance image;
calculate a coordinate transformation matrix between the grayscale image and the luminance image based on coordinates of the at least three same-location points in each of the grayscale image and the luminance image; and
align the two-dimensional image with the luminance image and the depth image based on the coordinate transformation matrix, to obtain fused image data, wherein the fused image data comprises color information of the two-dimensional image and the luminance information and the depth information of the three-dimensional image.
9. The non-transitory storage medium according to claim 8 , wherein the at least three same-location points are points of the object with specificity.
10. The non-transitory storage medium according to claim 8 , wherein the at least three same-location points comprise three non-collinear reference points.
11. The non-transitory storage medium according to claim 10 , wherein a maximum interior angle of a triangle formed by the three reference points is not greater than 160°.
12. The non-transitory storage medium according to claim 8 , wherein the instructions further cause the processor to align the two-dimensional image with the luminance image and the depth image to obtain fused image data by:
aligning the luminance image and the depth image with the two-dimensional image based on the coordinate transformation matrix using coordinates in the two-dimensional image as reference; and
generating a fused image containing three-channel information using grayscale information of the grayscale image, and the luminance information and the depth information that are aligned to the coordinates in the two-dimensional image, as information of three channels, respectively.
13. The non-transitory storage medium according to claim 8 , wherein the instructions further cause the processor to, before aligning the two-dimensional image with the luminance image and the depth image:
normalize depth values in the depth image to generate a normalized depth image.
14. The non-transitory storage medium according to claim 8 , wherein the object is one selected from: a battery surface, a battery top cover weld, and a battery sealing pin.