Image stabilization method and apparatus, terminal and storage medium

1. An image stabilization method, applied in a terminal equipped with at least two camera modules corresponding to different focal length ranges, the method comprising:

obtaining a first image outputted from a first camera module of the at least two camera modules and a second image outputted from a second camera module of the at least two camera modules;

processing, in a zooming process, the first image and the second image in a predetermined processing scheme to obtain a target image, the predetermined processing scheme comprising an electric image stabilization process and a zooming process, the zooming process being a process of switching from the first camera module to the second camera module; and

displaying the target image on a viewfinder screen,

wherein said processing the first image and the second image in the predetermined processing scheme to obtain the target image comprises: performing the electric image stabilization process on the first image and the second image, and then performing the zooming process on matrix information outputted in the electric image stabilization process to obtain the target image, or performing the zooming process on the first image and the second image, and then performing the electric image stabilization process on matrix information outputted in the zooming process to obtain the target image.

2. The method according to claim 1 , wherein said performing the electric image stabilization process on the first image and the second image, and then performing the zooming process on the matrix information outputted in the electric image stabilization process to obtain the target image comprises:

performing the electric image stabilization process on the first image and the second image based on first extrinsic parameter change matrix information to obtain a first stabilized image and a second stabilized image, the first extrinsic parameter change matrix information indicating changes in extrinsic parameters as measured when the camera modules are shaking; and

performing the zooming process on the first stabilized image and the second stabilized image based on the first extrinsic parameter change matrix information and second extrinsic parameter change matrix information to obtain the target image, the second extrinsic parameter change matrix information indicating a difference in extrinsic parameters between the first camera module and the second camera module in the zooming process.

3. The method according to claim 2 , wherein said performing the zooming process on the first stabilized image and the second stabilized image based on the first extrinsic parameter change matrix information and the second extrinsic parameter change matrix information to obtain the target image comprises:

zooming the first stabilized image digitally based on a current focal length range to obtain a first digitally-zoomed stabilized image corresponding to a Field of View (FOV) that is same as a FOV corresponding to the current focal length range;

re-projecting the second stabilized image based on the second extrinsic parameter change matrix information and the first extrinsic parameter change matrix information to obtain a second re-projected stabilized image; and

fusing the first digitally-zoomed stabilized image and the second re-projected stabilized image to obtain the target image.

4. The method according to claim 1 , wherein said performing the zooming process on the first image and the second image, and then performing the electric image stabilization process on the matrix information outputted in the zooming process to obtain the target image comprises:

performing the zooming process on the first image and the second image based on third extrinsic parameter change matrix information to obtain a zoomed image, the third extrinsic parameter change matrix information indicating a difference of extrinsic parameters between the first camera module and the second camera module in the zooming process; and

performing the electric image stabilization process on the zoomed image based on the third extrinsic parameter change matrix information and fourth extrinsic parameter change matrix information to obtain the target image, the fourth extrinsic parameter change matrix information indicating changes in extrinsic parameters as measured when the camera modules are shaking.

5. The method according to claim 4 , wherein said performing the electric image stabilization process on the zoomed image based on the third extrinsic parameter change matrix information and the fourth extrinsic parameter change matrix information to obtain the target image comprises:

re-projecting pixels in the zoomed image based on the third extrinsic parameter change matrix information and the fourth extrinsic parameter change matrix information to obtain re-projected pixels; and

generating the target image based on the re-projected pixels.

6. The method according to claim 1 , wherein the first camera module and/or the second camera module has an optical image stabilization function, and

wherein the method further comprises, prior to obtaining the first image outputted from the first camera module of the at least two camera modules and the second image outputted from the second camera module of the at least two camera modules:

obtaining camera module shake data collected by a gyroscope; and

performing an optical image stabilization process on the first camera module and/or the second camera module based on the camera module shake data, and

wherein said processing the first image and the second image in the predetermined processing scheme to obtain the target image is performed when the camera module shake data indicates that a shake amplitude is greater than an amplitude threshold.

7. A terminal, comprising at least two camera modules corresponding to different focal length ranges, a processor, a memory, and a display module, the memory storing at least one instruction that is executed by the processor to:

obtain a first image outputted from a first camera module of the at least two camera modules and a second image outputted from a second camera module of the at least two camera modules;

process, in a zooming process, the first image and the second image in a predetermined processing scheme to obtain a target image, the predetermined processing scheme comprising an electric image stabilization process and a zooming process, the zooming process being a process of switching from the first camera module to the second camera module; and

control the display module to display the target image on a viewfinder screen,

wherein the processor is configured to: perform the electric image stabilization process on the first image and the second image, and then perform the zooming process on matrix information outputted in the electric image stabilization process to obtain the target image, or perform the zooming process on the first image and the second image, and then perform the electric image stabilization process on matrix information outputted in the zooming process to obtain the target image.

8. The terminal according to claim 7 , wherein the processor is configured to:

perform the electric image stabilization process on the first image and the second image based on first extrinsic parameter change matrix information to obtain a first stabilized image and a second stabilized image, the first extrinsic parameter change matrix information indicating changes in extrinsic parameters as measured when the camera modules are shaking; and

perform the zooming process on the first stabilized image and the second stabilized image based on the first extrinsic parameter change matrix information and second extrinsic parameter change matrix information to obtain the target image, the second extrinsic parameter change matrix information indicating a difference in extrinsic parameters between the first camera module and the second camera module in the zooming process.

9. The terminal according to claim 8 , wherein the processor is configured to:

zoom the first stabilized image digitally based on a current focal length range to obtain a first digitally-zoomed stabilized image corresponding to a Field of View (FOV) that is same as a FOV corresponding to the current focal length range;

re-project the second stabilized image based on the second extrinsic parameter change matrix information and the first extrinsic parameter change matrix information to obtain a second re-projected stabilized image; and

fuse the first digitally-zoomed stabilized image and the second re-projected stabilized image to obtain the target image.

10. The terminal according to claim 7 , wherein the processor is configured to:

perform the zooming process on the first image and the second image based on third extrinsic parameter change matrix information to obtain a zoomed image, the third extrinsic parameter change matrix information indicating a difference of extrinsic parameters between the first camera module and the second camera module in the zooming process; and

perform the electric image stabilization process on the zoomed image based on the third extrinsic parameter change matrix information and fourth extrinsic parameter change matrix information to obtain the target image, the fourth extrinsic parameter change matrix information indicating changes in extrinsic parameters as measured when the camera modules are shaking.

11. The terminal according to claim 10 , wherein the processor is configured to:

re-project pixels on the zoomed image based on the third extrinsic parameter change matrix information and the fourth extrinsic parameter change matrix information to obtain re-projected pixels; and

generate the target image based on the re-projected pixels.

12. The terminal according to claim 7 , wherein the processor is configured to:

obtain camera module shake data collected by a gyroscope; and

perform an optical image stabilization process on the first camera module and/or the second camera module based on the camera module shake data, and

the processor is further configured to:

process the first image and the second image in the predetermined processing scheme to obtain the target image when the camera module shake data indicates that a shake amplitude is greater than an amplitude threshold.

13. A non-transitory computer-readable storage medium, storing at least one instruction that is executed by a processor to implement an image stabilization method applied in a terminal equipped with at least two camera modules corresponding to different focal length ranges, the method comprising:

obtaining a first image outputted from a first camera module of the at least two camera modules and a second image outputted from a second camera module of the at least two camera modules;

processing, in a zooming process, the first image and the second image in a predetermined processing scheme to obtain a target image, the predetermined processing scheme comprising an electric image stabilization process and a zooming process, the zooming process being a process of switching from the first camera module to the second camera module; and

displaying the target image on a viewfinder screen,

wherein said processing the first image and the second image in the predetermined processing scheme to obtain the target image comprises: performing the electric image stabilization process on the first image and the second image, and then performing the zooming process on matrix information outputted in the electric image stabilization process to obtain the target image, or performing the zooming process on the first image and the second image, and then performing the electric image stabilization process on matrix information outputted in the zooming process to obtain the target image.

14. The non-transitory computer-readable storage medium according to claim 13 wherein said performing the electric image stabilization process on the first image and the second image, and then performing the zooming process on the matrix information outputted in the electric image stabilization process to obtain the target image comprises:

performing the electric image stabilization process on the first image and the second image based on first extrinsic parameter change matrix information to obtain a first stabilized image and a second stabilized image, the first extrinsic parameter change matrix information indicating changes in extrinsic parameters as measured when the camera modules are shaking; and

performing the zooming process on the first stabilized image and the second stabilized image based on the first extrinsic parameter change matrix information and second extrinsic parameter change matrix information to obtain the target image, the second extrinsic parameter change matrix information indicating a difference in extrinsic parameters between the first camera module and the second camera module in the zooming process.

15. The non-transitory computer-readable storage medium according to claim 14 , wherein said performing the zooming process on the first stabilized image and the second stabilized image based on the first extrinsic parameter change matrix information and the second extrinsic parameter change matrix information to obtain the target image comprises:

zooming the first stabilized image digitally based on a current focal length range to obtain a first digitally-zoomed stabilized image corresponding to a Field of View (FOV) that is same as a FOV corresponding to the current focal length range;

re-projecting the second stabilized image based on the second extrinsic parameter change matrix information and the first extrinsic parameter change matrix information to obtain a second re-projected stabilized image; and

fusing the first digitally-zoomed stabilized image and the second re-projected stabilized image to obtain the target image.

16. The non-transitory computer-readable storage medium according to claim 13 , wherein said performing the zooming process on the first image and the second image, and then performing the electric image stabilization process on the matrix information outputted in the zooming process to obtain the target image comprises:

performing the zooming process on the first image and the second image based on third extrinsic parameter change matrix information to obtain a zoomed image, the third extrinsic parameter change matrix information indicating a difference of extrinsic parameters between the first camera module and the second camera module in the zooming process; and

performing the electric image stabilization process on the zoomed image based on the third extrinsic parameter change matrix information and fourth extrinsic parameter change matrix information to obtain the target image, the fourth extrinsic parameter change matrix information indicating changes in extrinsic parameters as measured when the camera modules are shaking.

17. The non-transitory computer-readable storage medium according to claim 16 , wherein said performing the electric image stabilization process on the zoomed image based on the third extrinsic parameter change matrix information and the fourth extrinsic parameter change matrix information to obtain the target image comprises:

re-projecting pixels in the zoomed image based on the third extrinsic parameter change matrix information and the fourth extrinsic parameter change matrix information to obtain re-projected pixels; and

generating the target image based on the re-projected pixels.