IP Library › Granted Patent US 10,827,140
Granted Patent B2
US 10,827,140 · App. 16/342,299 · Granted Nov 3, 2020

Photographing method for terminal and terminal

Inventors: Congchao Zhu (Beijing, CN); Wei Luo (Shanghai, CN); Cheng Du (Beijing, CN)
Assignee: Huawei Technologies Co., Ltd.
H04N5/357H04N5/232H04N5/235H04N5/2351H04N5/2354H04N5/23245H04N5/243
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,827,140
App. No.
16/342,299
Granted
Nov 3, 2020
Kind
B2
Abstract

A photographing method for a terminal that comprises a monochrome camera and a color camera, the method including simultaneously photographing a same to-be-photographed scene using the monochrome camera and the color camera and separately obtaining K frames of images, where the monochrome camera uses a full-size operation mode, where the color camera uses a binning operation mode, and where K≥1, obtaining a first image corresponding to the monochrome camera and a second image corresponding to the color camera, obtaining high-frequency information according to the first image, obtaining low-frequency information according to the second image, and fusing the first image and the second image according to the high-frequency information and the low-frequency information, and generating a composite image of the to-be-photographed scene.

Claims (80)

1. A method, comprising:

simultaneously photographing, by a terminal comprising a monochrome camera and a color camera, a to-be-photographed scene using the monochrome camera and the color camera;

obtaining first K frames of images corresponding to the monochrome camera, wherein the monochrome camera uses a full-size operation mode;

obtaining second K frames of images corresponding to the color camera, wherein the color camera uses a binning operation mode, and wherein K≥1;

obtaining a first image corresponding to the monochrome camera and a second image corresponding to the color camera;

obtaining high-frequency information according to the first image;

obtaining low-frequency information according to the second image; and

fusing the first image and the second image according to the high-frequency information and the low-frequency information to generate a composite image of the to-be-photographed scene, wherein fusing the first image and the second image according to the high-frequency information and the low-frequency information comprises:

processing a brightness of the first image according to the low-frequency information and using the second image as a first reference image to obtain a third image; and

performing upsampling processing on the second image according to the high-frequency information to obtain a fourth image.

2. The method according to claim 1 , wherein the fusing the first image and the second image according to the high-frequency information and the low-frequency information further comprises:

performing registration on the fourth image using the third image as a second reference image to obtain a fifth image.

3. The method according to claim 2 , wherein the fusing the first image and the second image according to the high-frequency information and the low-frequency information further comprises:

fusing the fifth image and the third image to generate the composite image of the to-be-photographed scene.

4. The method according to claim 1 , wherein the obtaining the first image corresponding to the monochrome camera and the second image corresponding to the color camera comprises:

obtaining the first K frames of images corresponding to the monochrome camera;

obtaining the second K frames of images corresponding to the color camera, wherein K≥2;

performing first temporal noise reduction on the first K frames of images corresponding to the monochrome camera to obtain the first image; and

performing second temporal noise reduction on the second K frames of images corresponding to the color camera to obtain the second image.

5. The method according to claim 4 , wherein the performing the first temporal noise reduction on the first K frames of images corresponding to the monochrome camera comprises:

performing a global image registration operation on the first K frames of images corresponding to the monochrome camera using a global motion relationship corresponding to the color camera.

6. The method according to claim 5 , wherein the method further comprises:

performing spatial noise reduction on the composite image of the to-be-photographed scene.

7. A terminal, comprising:

a monochrome camera;

a color camera, the monochrome camera and the color camera configured to:

simultaneously photograph a to-be-photographed scene,

the monochrome camera further configured to:

obtain first K frames of images corresponding to the monochrome camera, wherein the monochrome camera uses a full-size operation mode,

the color camera further configured to:

obtain second K frames of images corresponding to the color camera, wherein the color camera uses a binning operation mode, and wherein K≥1; and

a computer including a non-transitory computer-readable medium storing program modules executable by the computer, the program modules including:

an obtaining module, configured to:

obtain a first image corresponding to the monochrome camera and a second image corresponding to the color camera,

obtain high-frequency information according to the first image, and

obtain low-frequency information according to the second image; and

a fusion module, configured to:

fuse the first image and the second image according to the high-frequency information and the low-frequency information to generate a composite image of the to-be-photographed scene;

Process a brightness of the first image according to the low-frequency information and using the second image as a first reference image to obtain a third image; and

perform upsampling processing on the second image according to the high-frequency information to obtain a fourth image.

8. The terminal according to claim 7 , wherein the fusion module is configured to:

perform registration on the fourth image using the third image as a second reference image to obtain a fifth image.

9. The terminal according to claim 8 , wherein the fusion module is configured to:

fuse the fifth image and the third image to generate the composite image of the to-be-photographed scene.

10. The terminal according to claim 7 , wherein the obtaining module is configured to:

obtain the first K frames of images corresponding to the monochrome camera; and

obtain the second K frames of images corresponding to the color camera, wherein K≥2;

and wherein the program modules further include a noise reduction module configured to:

perform first temporal noise reduction on the first K frames of images corresponding to the monochrome camera to obtain the first image; and

perform second temporal noise reduction on the second K frames of images corresponding to the color camera to obtain the second image.

11. The terminal according to claim 10 , wherein the noise reduction module is further configured to:

perform spatial noise reduction on the composite image of the to-be-photographed scene.

12. A terminal, comprising:

a monochrome camera;

a color camera;

a processor; and

a non-transitory computer-readable storage medium storing a program to be executed by the processor, the program including instructions to:

cause the monochrome camera and the color camera to simultaneously photograph a to-be-photographed scene;

obtain first K frames of images corresponding to the monochrome camera, wherein the monochrome camera uses a full-size operation mode;

obtain second K frames of images corresponding to the color camera, wherein the color camera uses a binning operation mode, and wherein K≥1;

obtain a first image corresponding to the monochrome camera and a second image corresponding to the color camera;

obtain high-frequency information according to the first image;

obtain low-frequency information according to the second image; and

fuse the first image and the second image according to the high-frequency information and the low-frequency information to generate a composite image of the to-be-photographed scene; and

wherein the instructions to fuse the first image and the second image include instructions to:

process brightness of the first image according to the low-frequency information and using the second image as a first reference image to obtain a third image; and

perform upsampling processing on the second image according to the high-frequency information to obtain a fourth image.

13. The terminal according to claim 12 , wherein the instructions to fuse the first image and the second image further include instructions to:

perform registration on the fourth image by using the third image as a second reference image, to obtain a fifth image.

14. The terminal according to claim 13 , wherein the instructions to fuse the first image and the second image further include instructions to:

fuse the fifth image and the third image to generate the composite image of the to-be-photographed scene.

15. The terminal according to claim 12 , wherein the instructions to obtain the first image and the second image corresponding to the color camera further include instructions to:

obtain the first K frames of images corresponding to the monochrome camera; and

obtain the second K frames of images corresponding to the color camera, wherein K≥2;

perform first temporal noise reduction on the first K frames of images corresponding to the monochrome camera to obtain the first image; and

perform second temporal noise reduction on the second K frames of images corresponding to the color camera to obtain the second image.

16. The terminal according to claim 15 , wherein the instructions to perform the first temporal noise reduction comprise:

perform a global image registration operation on the first K frames of images corresponding to the monochrome camera using a global motion relationship corresponding to the color camera.

17. The terminal according to claim 16 , wherein the program further includes instructions to:

perform spatial noise reduction on the composite image of the to-be-photographed scene.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2020
From: ZHU, CONGCHAO; LUO, WEI; DU, CHENG
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 053321/0585 →
Priority Claims (1)
CN 2016 1 0905284 · Oct 17, 2016 · national
Continuity (1)
Related Publication 20190253644A1 · Aug 15, 2019