IP Library › Granted Patent US 12,294,787
Granted Patent B2
US 12,294,787 · App. 18/275,311 · Granted May 6, 2025

Video processing method and apparatus, electronic device, and storage medium

Inventors: Hantao Cui (Shenzhen, CN); Jirun Xu (Shenzhen, CN); Bin Chen (Shenzhen, CN); Xiaochao Ren (Shenzhen, CN)
Assignee: HONOR DEVICE CO., LTD.
H04N23/81H04N23/617H04N23/667H04N23/71H04N23/741
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,294,787
App. No.
18/275,311
Granted
May 6, 2025
Kind
B2
Abstract

Embodiments of this application relate to the technical field of video shooting and provide a video processing method and apparatus, an electronic device, and a storage medium. The video processing method includes: in a first night mode or in a second night mode, obtaining a video shot through a camera lens; in the first night mode, processing a video image of a first exposure frame, where processing is used for reducing noise and increasing a luminance; in the first night mode, fusing a video image of a first exposure frame processed and the video image of a second exposure frame not processed, to obtain a fused video; and in the second night mode, fusing the video image of a first exposure frame and the video image of a second exposure frame, to obtain a fused video.

Claims (75)

1. A video processing method, comprising:

in a first night mode or a second night mode, obtaining a video shot through a camera lens, wherein the video comprises a video image of a first exposure frame and a video image of a second exposure frame that are alternated, and a time for which the video image of a first exposure frame is exposed is greater than a time for which the video image of a second exposure frame is exposed;

in the first night mode, processing the video image of a first exposure frame by using an artificial intelligence AI night algorithm, wherein processing by using the AI night algorithm is used for reducing noise and increasing a luminance;

in the first night mode, fusing a video image of a first exposure frame processed by using the AI night algorithm and the video image of a second exposure frame not processed by using the AI night algorithm, to obtain a fused video, wherein the video image of a first exposure frame has a first weight; and

in the second night mode, fusing the video image of a first exposure frame and the video image of a second exposure frame, to obtain a fused video, wherein the video image of a first exposure frame has a second weight, and the first weight is greater than the second weight.

2. The video processing method according to claim 1 , further comprising:

in the first night mode, processing the fused video by using a logarithm LOG curve corresponding to a current photosensitivity ISO of the camera lens, to obtain a LOG video; and

processing the LOG video based on a look up table (LUT), to obtain a video processed by using the LUT.

3. The video processing method according to claim 1 , wherein:

the processing the video image of a first exposure frame by using an AI night algorithm comprises:

obtaining statistical information corresponding to the video image of a first exposure frame; and

processing the statistical information and a RAW image of the video image of a first exposure frame as inputs to be processed by using the AI night algorithm, to obtain a processed RAW image of the video image of a first exposure frame.

4. The video processing method according to claim 1 , further comprises:

periodically obtaining a luminance of a current image in a video shot through the camera lens, and if the luminance is less than a first luminance threshold, displaying the first night mode, or if the luminance is greater than a second luminance threshold, displaying the second night mode, wherein the first luminance threshold is less than the second luminance threshold.

5. The video processing method according to claim 4 , wherein

in the first night mode, the video is obtained in a manner of non-overlapping exposure; and

in the second night mode, the video is obtained in a manner of overlapping exposure.

6. The video processing method according to claim 2 , wherein

a process of processing the fused video by using a logarithm LOG curve corresponding to a current photosensitivity ISO of the camera lens, to obtain a LOG video, and a process of processing the LOG video based on a look up table LUT, to obtain a video processed by using the LUT are performed in a first video processing procedure;

the video processing method further comprises a second video processing procedure, and the second video processing procedure comprises:

processing the fused video by using the logarithm LOG curve corresponding to the current photosensitivity ISO of the camera lens, to obtain a LOG video; and

processing the LOG video based on the look up table LUT, to obtain a video processed by using the LUT; and

the video processing method further comprises:

storing the video processed by using the LUT in the first video processing procedure; and

previewing the video processed by using the LUT in the second video processing procedure.

7. An electronic device, comprising:

a camera lens, a processor and a memory, wherein the memory is configured to store at least one instruction, and when the instruction is loaded and executed by the processor, the video processing method comprises:

in a first night mode or a second night mode, obtaining a video shot through a camera lens, wherein the video comprises a video image of a first exposure frame and a video image of a second exposure frame that are alternated, and a time for which the video image of a first exposure frame is exposed is greater than a time for which the video image of a second exposure frame is exposed;

in the first night mode, processing the video image of a first exposure frame by using an artificial intelligence AI night algorithm, wherein processing by using the AI night algorithm is used for reducing noise and increasing a luminance;

in the first night mode, fusing a video image of a first exposure frame processed by using the AI night algorithm and the video image of a second exposure frame not processed by using the AI night algorithm, to obtain a fused video, wherein the video image of a first exposure frame has a first weight; and

in the second night mode, fusing the video image of a first exposure frame and the video image of a second exposure frame, to obtain a fused video, wherein the video image of a first exposure frame has a second weight, and the first weight is greater than the second weight.

8. A non-transitory computer-readable storage medium storing a computer program, which when the computer program is run on a computer, the computer is enabled to perform a video processing method, the method comprising:

in a first night mode or a second night mode, obtaining a video shot through a camera lens, wherein the video comprises a video image of a first exposure frame and a video image of a second exposure frame that are alternated, and a time for which the video image of a first exposure frame is exposed is greater than a time for which the video image of a second exposure frame is exposed;

in the first night mode, processing the video image of a first exposure frame by using an artificial intelligence AI night algorithm, wherein processing by using the AI night algorithm is used for reducing noise and increasing a luminance;

in the first night mode, fusing a video image of a first exposure frame processed by using the AI night algorithm and the video image of a second exposure frame not processed by using the AI night algorithm, to obtain a fused video, wherein the video image of a first exposure frame has a first weight; and

in the second night mode, fusing the video image of a first exposure frame and the video image of a second exposure frame, to obtain a fused video, wherein the video image of a first exposure frame has a second weight, and the first weight is greater than the second weight.

9. The electronic device according to claim 7 , further comprising:

in the first night mode, processing the fused video by using a logarithm LOG curve corresponding to a current photosensitivity ISO of the camera lens, to obtain a LOG video; and

processing the LOG video based on a look up table (LUT), to obtain a video processed by using the LUT.

10. The electronic device according to claim 7 , wherein:

the processing the video image of a first exposure frame by using an AI night algorithm comprises:

obtaining statistical information corresponding to the video image of a first exposure frame; and

processing the statistical information and a RAW image of the video image of a first exposure frame as inputs to be processed by using the AI night algorithm, to obtain a processed RAW image of the video image of a first exposure frame.

11. The electronic device according to claim 7 , further comprises:

periodically obtaining a luminance of a current image in a video shot through the camera lens, and if the luminance is less than a first luminance threshold, displaying the first night mode, or if the luminance is greater than a second luminance threshold, displaying the second night mode, wherein the first luminance threshold is less than the second luminance threshold.

12. The electronic device according to claim 11 , wherein

in the first night mode, the video is obtained in a manner of non-overlapping exposure; and

in the second night mode, the video is obtained in a manner of overlapping exposure.

13. The electronic device according to claim 9 , wherein a process of processing the fused video by using a logarithm LOG curve corresponding to a current photosensitivity ISO of the camera lens, to obtain a LOG video, and a process of processing the LOG video based on a look up table LUT, to obtain a video processed by using the LUT are performed in a first video processing procedure;

the video processing method further comprises a second video processing procedure, and the second video processing procedure comprises:

processing the fused video by using the logarithm LOG curve corresponding to the current photosensitivity ISO of the camera lens, to obtain a LOG video; and

processing the LOG video based on the look up table LUT, to obtain a video processed by using the LUT; and

the video processing method further comprises:

storing the video processed by using the LUT in the first video processing procedure; and

previewing the video processed by using the LUT in the second video processing procedure.

14. The computer-readable storage medium according to claim 8 , wherein the method further comprises:

in the first night mode, processing the fused video by using a logarithm LOG curve corresponding to a current photosensitivity ISO of the camera lens, to obtain a LOG video; and

processing the LOG video based on a look up table (LUT), to obtain a video processed by using the LUT.

15. The computer-readable storage medium according to claim 8 , wherein:

the processing the video image of a first exposure frame by using an AI night algorithm comprises:

obtaining statistical information corresponding to the video image of a first exposure frame; and

processing the statistical information and a RAW image of the video image of a first exposure frame as inputs to be processed by using the AI night algorithm, to obtain a processed RAW image of the video image of a first exposure frame.

16. The computer-readable storage medium according to claim 8 , wherein the method further comprises:

periodically obtaining a luminance of a current image in a video shot through the camera lens, and if the luminance is less than a first luminance threshold, displaying the first night mode, or if the luminance is greater than a second luminance threshold, displaying the second night mode, wherein the first luminance threshold is less than the second luminance threshold.

17. The computer-readable storage medium according to claim 16 , wherein

in the first night mode, the video is obtained in a manner of non-overlapping exposure; and

in the second night mode, the video is obtained in a manner of overlapping exposure.

18. The computer-readable storage medium according to claim 14 , wherein

a process of processing the fused video by using a logarithm LOG curve corresponding to a current photosensitivity ISO of the camera lens, to obtain a LOG video, and a process of processing the LOG video based on a look up table LUT, to obtain a video processed by using the LUT are performed in a first video processing procedure;

the video processing method further comprises a second video processing procedure, and the second video processing procedure comprises:

processing the fused video by using the logarithm LOG curve corresponding to the current photosensitivity ISO of the camera lens, to obtain a LOG video; and

processing the LOG video based on the look up table LUT, to obtain a video processed by using the LUT; and

the video processing method further comprises:

storing the video processed by using the LUT in the first video processing procedure; and

previewing the video processed by using the LUT in the second video processing procedure.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 11, 2023
From: CUI, HANTAO; XU, JIRUN; CHEN, BIN; REN, XIAOCHAO
To: HONOR DEVICE CO., LTD.
Reel/Frame 065827/0251 →
Priority Claims (1)
CN 202110926901.3 · Aug 12, 2021 · national
Continuity (1)
Related Publication 20240187744A1 · Jun 6, 2024
References Cited (18)
US 11089207B2 · Wang · 2021 [cited by applicant]
US 20090303343A1 · Drimbarean · 2009 [cited by applicant]
US 20170034520A1 · Rosewarne · 2017 [cited by applicant]
US 20210120164A1 · Aokage · 2021 [cited by examiner]
CN 105763814A · 2016 [cited by applicant]
CN 109005366A · 2018 [cited by applicant]
CN 109618099A · 2019 [cited by applicant]
CN 110113539A · 2019 [cited by applicant]
CN 110121882A · 2019 [cited by applicant]
CN 110166708A · 2019 [cited by applicant]
CN 110266954A · 2019 [cited by applicant]
CN 110611750A · 2019 [cited by applicant]
CN 112437235A · 2021 [cited by applicant]
CN 113824914A · 2021 [cited by applicant]
EP 3624439A2 · 2020 [cited by applicant]
WO 2020038069A1 · 2020 [cited by applicant]
WO 2020057198A1 · 2020 [cited by applicant]
Harald Brendel;“Alexa Log C Curve Usage in VFX”; Mar. 9, 2017; pp. 1-10; Retrieved from the internet, URL: https://www.arri.com/resource/blob/31918/66f56e6abb6e5b6553929edf9aa7483e/2017-03-alexa-logc-curve-in-vfx-data.p… [cited by applicant]