IP Library Granted Patent US 9,870,602
Granted Patent B2
US 9,870,602 · App. 15/101,759 · Granted Jan 16, 2018

Method and apparatus for fusing a first image and a second image

Inventors: Gang Chen (Beijing, CN); Jian Zhang (Shenzhen, CN); Wei Luo (Shanghai, CN)
Assignee: Huawei Device (Dongguan) Co., Ltd.
G06T3/4053G06T3/20H04N5/211H04N5/23232H04N5/23248H04N5/247H04N5/265H04N5/2621G06T2207/10004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,870,602
App. No.
15/101,759
Granted
Jan 16, 2018
Kind
B2
Abstract

The present invention provides a method to resolve a technical problem of a “ghost”. The method is applied to a terminal that includes a first camera lens and a second camera lens, where the both lenses are located on a same side of the terminal. The method includes: obtaining a first image that is captured by the first camera lens and is about a first area, and a second image that is captured at a same moment by the second camera lens and is about a second area; performing translation compensation on the second image by using the first image as a reference image; and fusing the first image and the second image that is obtained after translation compensation is performed, to generate a third image, where a resolution of the third image is higher than a resolution of the first image and a resolution of the second image.

Claims (54)

1. An image processing method for use with a terminal having a first camera lens and a second camera lens, wherein the first camera lens and the second camera lens are located on a same side of the terminal, the method comprising:

acquiring a first image captured by the first camera lens and is about a first area, and acquiring a second image captured at a same moment by the second camera lens and is about a second area;

performing translation compensation on the second image by using the first image as a reference image; and

fusing the first image and the second image that is obtained after translation compensation is performed, to generate a third image, wherein a resolution of the third image is higher than a resolution of the first image and a resolution of the second image;

wherein performing translation compensation on the second image by using the first image as a reference image comprises:

determining a translation vector between the first image and the second image, and

performing, according to the translation vector, translation compensation on the second image captured by the second camera lens;

wherein the translation vector is determined by using the following formula:

d=B*f/Z ; wherein:

d indicates a translation vector of an object in the second image relative to the first image, wherein a distance between the object and a plane on which the first camera lens and the second camera lens are located is Z,

B indicates a distance between the first camera lens and the second camera lens,

Z indicates a vertical distance between the object and the plane on which the first camera lens and the second camera lens are located, and

f indicates a focal length of the first camera lens or a focal length of the second camera lens.

2. The method according to claim 1 , wherein fusing the first image and the second image that is obtained after translation compensation is performed, to generate a third image comprises:

determining a common area of the first image and the second image according to a result of the translation compensation; and

fusing the common area of the first image and the second image to generate the third image.

3. An image processing apparatus, comprising:

an acquiring module, configured to acquire a first image captured by a first camera lens and is about a first area, and a second image captured at a same moment by a second camera lens and is about a second area, wherein the first camera lens and the second camera lens are located on a same plane of the image processing apparatus;

a translation compensating module, connected to the acquiring module and configured to:

after the acquiring module obtains the first image and the second image, perform translation compensation on the second image by using the first image as a reference image; and

an image fusion module, connected to the translation compensating module and configured to:

after the translation compensating module performs translation compensation on the second image, fuse the first image and the second image that is obtained after translation compensation is performed, to generate a third image, wherein a resolution of the third image is higher than a resolution of the first image and a resolution of the second image;

wherein the translation compensating module comprises:

a first determining unit, configured to determine a translation vector between the first image and the second image, and

a compensating unit, connected to the first determining unit and configured to: after the first determining unit determines the translation vector, perform, according to the translation vector, translation compensation on the second image captured by the second camera lens;

wherein the determining unit is configured to determine the translation vector by using the following formula:

d=B*f/Z ; wherein:

d indicates a translation vector of an object in the second image relative to the first image, wherein a distance between the object and a plane on which the first camera lens and the second camera lens are located is Z,

B indicates a distance between the first camera lens and the second camera lens,

Z indicates a vertical distance between the object and the plane on which the first camera lens and the second camera lens are located, and

f indicates a focal length of the first camera lens or a focal length of the second camera lens.

4. The apparatus according to claim 3 , wherein the image fusion module comprises:

a second determining unit, configured to determine a common area of the first image and the second image according to a result of the translation compensation; and

a fusing unit, connected to the second determining unit and configured to: after the second determining unit determines the common area, fuse the common area of the first image and the second image to generate the third image.

5. A terminal, comprising:

a first camera lens, configured to capture a first area to obtain a first image;

a second camera lens, configured to capture a second area at a same moment when the first camera lens captures the first image, to obtain a second image, wherein the first camera lens and the second camera lens are located on a same side of the ten final; and

a processor, connected to the first camera lens and the second camera lens, and configured to:

perform translation compensation on the second image by using the first image as a reference image,

fuse the first image and the second image that is obtained after translation compensation is performed, to generate a third image, wherein a resolution of the third image is higher than a resolution of the first image and a resolution of the second image,

determine a translation vector between the first image and the second image, and

perform, according to the translation vector, translation compensation on the second image captured by the second camera lens;

wherein the processor is configured to determine the translation vector by using the following formula:

d=B*f/Z ; wherein:

d indicates a translation vector of an object in the second image relative to the first image, wherein a distance between the object and a plane on which the first camera lens and the second camera lens are located is Z,

B indicates a distance between the first camera lens and the second camera lens,

Z indicates a vertical distance between the object and the plane on which the first camera lens and the second camera lens are located, and

f indicates a focal length of the first camera lens or a focal length of the second camera lens.

6. The terminal according to claim 5 , wherein:

an optical axis of the first camera lens is parallel to an optical axis of the second camera lens, and/or

the first camera lens and the second camera lens are disposed on the terminal in a fixed manner.

7. The terminal according to claim 5 , wherein the processor is further configured to:

determine a common area of the first image and the second image according to a result of the translation compensation; and

fuse the common area of the first image and the second image to generate the third image.

Assignments (3)
CHANGE OF NAME Recorded Mar 11, 2019
From: HUAWEI DEVICE (DONGGUAN) CO.,LTD.
To: HUAWEI DEVICE CO.,LTD.
Reel/Frame 048555/0951 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 5, 2017
From: HUAWEI DEVICE CO., LTD.
To: HUAWEI DEVICE (DONGGUAN) CO., LTD.
Reel/Frame 043750/0393 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 23, 2016
From: CHEN, GANG; ZHANG, JIAN; LUO, WEI
To: HUAWEI DEVICE CO., LTD.
Reel/Frame 039506/0503 →
Priority Claims (1)
CN 2013 1 0658550 · Dec 6, 2013 · national
Continuity (1)
Related Publication 20160307300A1 · Oct 20, 2016