Video processing method and apparatus, electronic device, and storage medium
A video processing method and apparatus, an electronic device, and a storage medium. The video processing method includes: in a first zoom mode or a second zoom mode, obtaining a video shot through a camera lens; in the first zoom mode, processing a video image of a first exposure frame by using a super-resolution algorithm; in the first zoom mode, fusing a video image of a first exposure frame processed by using the super-resolution algorithm and a video image of a second exposure frame not processed by using the super-resolution algorithm, to obtain a fused video; and in the second zoom mode, fusing the video image of a first exposure frame and the video image of a second exposure frame, to obtain a fused video.
1. A method, comprising:
obtaining a video shot through a camera lens in a first zoom mode or a second zoom mode, wherein the video comprises a video image of a first exposure frame and a video image of a second exposure frame that are alternated, and wherein a duration for which the video image of the first exposure frame is exposed is greater than a duration for which the video image of the second exposure frame is exposed;
processing, in the first zoom mode, the video image of the first exposure frame with a super-resolution algorithm to increase a resolution and obtain a super-resolution processed video image;
fusing, in the first zoom mode, the super-resolution processed video image and the video image of the second exposure frame not processed with the super-resolution algorithm, to obtain a fused video, wherein the super-resolution processed video image has a first weight; and
fusing, in the second zoom mode, the video image of the first exposure frame and the video image of the second exposure frame, to obtain a fused video, wherein the video image of the first exposure frame fused in the second zoom mode has a second weight, and the first weight is greater than the second weight.
2. The method of claim 1 , further comprising:
displaying the first zoom mode if a currently used camera lens is a first camera lens, a scaling factor of shooting is in a first scaling range, and a luminance of a currently shot image is greater than a first luminance threshold;
displaying the second zoom mode if the currently used camera lens is the first camera lens, and the scaling factor of shooting is in a second scaling range that is less than the first scaling range; and
displaying the second zoom mode if the currently used camera lens is the first camera lens, the scaling factor of shooting is in the first scaling range, and the luminance of a currently shot image is less than or equal to the first luminance threshold.
3. The method of claim 2 , further comprising:
displaying the first zoom mode if the currently used camera lens is a second camera lens, the scaling factor of shooting is in a third scaling range that is less than the second scaling range, an ISO of the camera lens is in a first ISO range, wherein a focal length of the second camera lens is less than a focal length of the first camera lens;
displaying the second zoom mode if the currently used camera lens is the second camera lens, the scaling factor of shooting is in the third scaling range, the ISO of the camera lens is in a second ISO range that is greater than the first ISO range, and a luminance of a currently shot image is greater than a second luminance threshold; and
displaying the second zoom mode if the currently used camera lens is the second camera lens, the scaling factor of the camera lens is in a fourth scaling range that is less than the third scaling range, and the luminance of a currently shot image is greater than a third luminance threshold.
4. The method of claim 3 , further comprising:
displaying the second zoom mode if the currently used camera lens is the second camera lens, the scaling factor of shooting is in the second scaling range, and the luminance of a shot image is less than or equal to a fourth luminance threshold;
displaying the second zoom mode if the currently used camera lens is the second camera lens, the scaling factor of shooting is in the second scaling range, and a shooting distance is less than a distance threshold;
displaying the second zoom mode if the currently used camera lens is the second camera lens, the scaling factor of shooting is in the first scaling range, and the luminance of a shot image is less than or equal to the first luminance threshold; and
displaying the first zoom mode if the currently used camera lens is the second camera lens, the scaling factor of shooting is in the first scaling range, and the shooting distance is less than the distance threshold.
5. The method of claim 1 , further comprising:
processing, in the first zoom mode, the fused video with a logarithm (LOG) curve corresponding to a current photosensitivity ISO of the camera lens, to obtain a LOG video; and
processing the LOG video based on a look up table (LUT), to obtain a video processed with the LUT.
6. The method of claim 5 , wherein processing the fused video with the LOG curve and processing the LOG video based on the LUT are performed in a first video processing procedure, wherein the method further comprises a second video processing procedure comprising:
processing the fused video with the LOG curve corresponding to the current photosensitivity ISO of the camera lens, to obtain a second LOG video; and
processing the second LOG video based on the LUT, to obtain a second video processed with the LUT,
wherein the method further comprises:
storing the video processed with the LUT in the first video processing procedure; and
previewing the second video processed with the LUT in the second video processing procedure.
7. The method of claim 1 , wherein processing the video image of the first exposure frame with the super-resolution algorithm comprises:
obtaining statistical information corresponding to the video image of the first exposure frame; and
providing the statistical information and a RAW image of the video image of the first exposure frame as inputs to be processed by using with the super-resolution algorithm, to obtain a processed RAW image of the video image of the first exposure frame.
8. An electronic device, comprising:
a camera lens;
one or more processors coupled to the camera lens; and
a memory coupled to the one or more processors, wherein the memory is configured to store instructions that, when executed by the one or more processors, cause the electronic device to be configured to:
obtain a video shot through the camera lens in a first zoom mode or a second zoom mode, wherein the video comprises a video image of a first exposure frame and a video image of a second exposure frame that are alternated, and wherein a duration for which the video image of the first exposure frame is exposed is greater than a duration for which the video image of the second exposure frame is exposed;
process, in the first zoom mode, the video image of the first exposure frame with a super-resolution algorithm to increase a resolution and obtain a super-resolution processed video image;
fuse, in the first zoom mode, the super-resolution processed video image and the video image of the second exposure frame not processed with the super-resolution algorithm, to obtain a fused video, wherein the super-resolution processed video image has a first weight; and
fuse, in the second zoom mode, the video image of the first exposure frame and the video image of the second exposure frame, to obtain a fused video, wherein the video image of the first exposure frame fused in the second zoom mode has a second weight, and the first weight is greater than the second weight.
9. The electronic device of claim 8 , wherein the instructions, when executed by the one or more processors, further cause the electronic device to be configured to:
display the first zoom mode if a currently used camera lens is a first camera lens, a scaling factor of shooting is in a first scaling range, and a luminance of a currently shot image is greater than a first luminance threshold;
display the second zoom mode if the currently used camera lens is the first camera lens, and the scaling factor of shooting is in a second scaling range that is less than the first scaling range; and
display the second zoom mode if the currently used camera lens is the first camera lens, the scaling factor of shooting is in the first scaling range, and the luminance of a currently shot image is less than or equal to the first luminance threshold.
10. The electronic device of claim 9 , wherein the instructions, when executed by the one or more processors, further cause the electronic device to be configured to:
display the first zoom mode if the currently used camera lens is a second camera lens, the scaling factor of shooting is in a third scaling range that is less than the second scaling range, an ISO of the camera lens is in a first ISO range, wherein a focal length of the second camera lens is less than a focal length of the first camera lens;
display the second zoom mode if the currently used camera lens is the second camera lens, the scaling factor of shooting is in the third scaling range, the ISO of the camera lens is in a second ISO range that is greater than the first ISO range, and a luminance of a currently shot image is greater than a second luminance threshold; and
display the second zoom mode if the currently used camera lens is the second camera lens, the scaling factor of the camera lens is in a fourth scaling range that is less than the third scaling range, and the luminance of a currently shot image is greater than a third luminance threshold.
11. The electronic device of claim 10 , wherein the instructions, when executed by the one or more processors, further cause the electronic device to be configured to:
display the second zoom mode if the currently used camera lens is the second camera lens, the scaling factor of shooting is in the second scaling range, and the luminance of a shot image is less than or equal to a fourth luminance threshold;
display the second zoom mode if the currently used camera lens is the second camera lens, the scaling factor of shooting is in the second scaling range, and a shooting distance is less than a distance threshold;
display the second zoom mode if the currently used camera lens is the second camera lens, the scaling factor of shooting is in the first scaling range, and the luminance of a shot image is less than or equal to the first luminance threshold; and
display the first zoom mode if the currently used camera lens is the second camera lens, the scaling factor of shooting is in the first scaling range, and the shooting distance is less than the distance threshold.
12. The electronic device of claim 8 , wherein the instructions, when executed by the one or more processors, further cause the electronic device to be configured to:
process, in the first zoom mode, the fused video with a logarithm (LOG) curve corresponding to a current photosensitivity ISO of the camera lens, to obtain a LOG video; and
process the LOG video based on a look up table (LUT), to obtain a video processed with the LUT.
13. The electronic device of claim 12 , wherein processing the fused video with the LOG curve and processing the LOG video based on the LUT are performed in a first video processing procedure, wherein the instructions, when executed by the one or more processors, further cause the electronic device to be configured to perform a second video processing procedure, comprising:
processing the fused video with the LOG curve corresponding to the current photosensitivity ISO of the camera lens, to obtain a second LOG video; and
processing the second LOG video based on the LUT, to obtain a video processed with the LUT,
wherein the instructions, when executed by the one or more processors, further cause the electronic device to be configured to:
store the video processed with the LUT in the first video processing procedure; and
preview the second video processed with the LUT in the second video processing procedure.
14. The electronic device of claim 8 , wherein processing the video image of the first exposure frame with the super-resolution algorithm comprises:
obtaining statistical information corresponding to the video image of the first exposure frame; and
providing the statistical information and a RAW image of the video image of the first exposure frame as inputs to be processed with the super-resolution algorithm, to obtain a processed RAW image of the video image of the first exposure frame.
15. A non-transitory computer-readable storage medium storing instructions that, when executed by one or more processors of an electronic device, cause the electronic device to be configured to:
obtain a video shot through a camera lens in a first zoom mode or a second zoom mode, wherein the video comprises a video image of a first exposure frame and a video image of a second exposure frame that are alternated, and wherein a duration for which the video image of the first exposure frame is exposed is greater than a duration for which the video image of the second exposure frame is exposed;
process, in the first zoom mode, the video image of the first exposure frame with a super-resolution algorithm to increase a resolution and obtain a super-resolution processed video image;
fuse, in the first zoom mode, the super-resolution processed video image and the video image of the second exposure frame not processed with the super-resolution algorithm, to obtain a fused video, wherein the super-resolution processed video image has a first weight; and
fuse, in the second zoom mode, the video image of the first exposure frame and the video image of the second exposure frame, to obtain a fused video, wherein the video image of the first exposure frame fused in the second zoom mode has a second weight, and the first weight is greater than the second weight.
16. The non-transitory computer-readable storage medium of claim 15 , wherein the instructions, when executed by the one or more processors, further cause the electronic device to be configured to:
display the first zoom mode if a currently used camera lens is a first camera lens, a scaling factor of shooting is in a first scaling range, and a luminance of a currently shot image is greater than a first luminance threshold;
display the second zoom mode if the currently used camera lens is the first camera lens, and the scaling factor of shooting is in a second scaling range that is less than the first scaling range; and
display the second zoom mode if the currently used camera lens is the first camera lens, the scaling factor of shooting is in the first scaling range, and the luminance of a currently shot image is less than or equal to the first luminance threshold.
17. The non-transitory computer-readable storage medium of claim 16 , wherein the instructions, when executed by the one or more processors, further cause the electronic device to be configured to:
display the first zoom mode if the currently used camera lens is a second camera lens, the scaling factor of shooting is in a third scaling range that is less than the second scaling range, an ISO of the camera lens is in a first ISO range, wherein a focal length of the second camera lens is less than a focal length of the first camera lens;
display the second zoom mode if the currently used camera lens is the second camera lens, the scaling factor of shooting is in the third scaling range, the ISO of the camera lens is in a second ISO range that is greater than the first ISO range, and a luminance of a currently shot image is greater than a second luminance threshold; or
display the second zoom mode if the currently used camera lens is the second camera lens, the scaling factor of the camera lens is in a fourth scaling range that is less than the third scaling range, and the luminance of a currently shot image is greater than a third luminance threshold.
18. The non-transitory computer-readable storage medium of claim 17 , wherein the instructions, when executed by the one or more processors, further cause the electronic device to be configured to:
display the second zoom mode if the currently used camera lens is the second camera lens, the scaling factor of shooting is in the second scaling range, and the luminance of a shot image is less than or equal to a fourth luminance threshold;
display the second zoom mode if the currently used camera lens is the second camera lens, the scaling factor of shooting is in the second scaling range, and a shooting distance is less than a distance threshold;
display the second zoom mode if the currently used camera lens is the second camera lens, the scaling factor of shooting is in the first scaling range, and the luminance of a shot image is less than or equal to the first luminance threshold; or
display the first zoom mode if the currently used camera lens is the second camera lens, the scaling factor of shooting is in the first scaling range, and the shooting distance is less than the distance threshold.
19. The non-transitory computer-readable storage medium of claim 15 , wherein the instructions, when executed by the one or more processors, further cause the electronic device to be configured to:
process, in the first zoom mode, the fused video with a logarithm (LOG) curve corresponding to a current photosensitivity ISO of the camera lens, to obtain a LOG video; and
process the LOG video based on a look up table (LUT), to obtain a video processed with the LUT.
20. The non-transitory computer-readable storage medium of claim 15 , wherein processing the video image of the first exposure frame with the super-resolution algorithm comprises:
obtaining statistical information corresponding to the video image of the first exposure frame; and
providing the statistical information and a RAW image of the video image of the first exposure frame as inputs to be processed with the super-resolution algorithm, to obtain a processed RAW image of the video image of the first exposure frame.