IP Library › Granted Patent US 10,728,465
Granted Patent B2
US 10,728,465 · App. 16/311,722 · Granted Jul 28, 2020

Method and device for compositing a plurality of images

Inventor: Lei Wu (Guangdong, CN)
Assignee: GUANGDONG OPPO MOBILE TELECOMMUICATIONS CORP., LTD.
H04N5/2353G06T3/4038G06T5/50H04N5/2356H04N5/23232H04N5/23238H04N5/23277H04N5/23287H04N5/349G06T2207/20216G06T2207/20221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,728,465
App. No.
16/311,722
Granted
Jul 28, 2020
Kind
B2
Abstract

The present disclosure provides a method and a device for compositing a plurality of images. The method includes obtaining a first exposure time t required for current photographing. The first exposure time t is divided into N segments where N is M power of 4, and M is a positive integer. A micro-electro-mechanical system (MEMS) controls an image sensor to move clockwise or anticlockwise according to a step length of a preset number of pixels. The image sensor is controlled to expose for a second exposure time t/N after each movement of the image sensor according to the preset number of pixels, to obtain N images. The N images are composited to obtain a composite picture.

Claims (46)

1. A method for compositing a plurality of images, comprising:

acquiring a first exposure time t required for current photographing, and dividing the first exposure time t into N segments, where N is M power of 4 and M is a positive integer;

controlling by a micro-electro-mechanical system MEMS, an image sensor to move clockwise or counterclockwise according to a step length of a preset number of pixels, and controlling the image sensor to expose for a second exposure time t/N after each movement of the image sensor according to the preset number of pixels, to acquire N images; and

compositing the N images to obtain a composite picture, wherein compositing the N images to obtain the composite picture comprises:

determining an alignment rule of the N images according to a movement rule that the MEMS controls the image sensor to move, and aligning the N images according to the alignment rule; and

for each pixel position in the N images aligned, comparing contents of current pixels in the N images, and performing pixel composition based on a comparison result.

2. The method according to claim 1 , wherein comparing the contents of the current pixels in the N images and performing the pixel composition based on the comparison result comprises:

determining whether each of matching degrees between the contents of N current pixels exceeds a preset threshold; and

superimposing the N current pixels when each of the matching degrees exceeds the preset threshold.

3. The method according to claim 2 , further comprising:

in response to determining that any of the matching degrees between the contents of the N current pixels does not exceed the preset threshold, determining a first current pixel having a maximum difference from other current pixels in the N current pixels, replacing the first current pixel with one of the other current pixels, and superimposing the other current pixels and a replaced first current pixel.

4. The method according to claim 1 , wherein the preset number of pixels comprises one pixel.

5. The method according to claim 1 , wherein N is set in advance according to a pixel requirement required for current photographing.

6. The method according to claim 1 , wherein compositing the N images to obtain the composite picture comprises:

compositing the N images using a principle of multi-image composition, to obtain the composite picture.

7. A device for compositing a plurality of images, comprising:

a processor, and

a memory, having instructions executable by the processor stored thereon,

wherein the processor is configured to:

acquire a first exposure time t required for current photographing, and divide the first exposure time t into N segments, where N is M power of 4 and M is a positive integer;

control via a micro-electro-mechanical system MEMS, an image sensor to move clockwise or counterclockwise according to a step length of a preset number of pixels, and control the image sensor to expose for a second exposure time t/N after each movement of the image sensor according to the preset number of pixels, to acquire N images; and

composite the N images to obtain a composite picture;

wherein the processor is configured to:

determine an alignment rule of the N images according to a movement rule that the MEMS controls the image sensor to move, and align the N images according to the alignment rule; and

for each position in the N images aligned, compare contents of current pixels in the N images, and perform pixel composition based on a comparison result.

8. The device according to claim 7 , wherein the processor is configured to:

determine whether each of matching degrees between the contents of N current pixels exceeds a preset threshold; and superimpose the N current pixels when each of the matching degrees exceeds the preset threshold.

9. The device according to claim 8 , wherein the processor is configured to:

in response to determining that any of the matching degrees between the contents of the N current pixels does not exceed the preset threshold, determine a first current pixel having a maximum difference from other current pixels in the N current pixels, replace the first current pixel with one of the other current pixels, and superimpose the other current pixels and a replaced first current pixel.

10. The device according to claim 7 , wherein the preset number of pixels comprises one pixel.

11. The device according to claim 7 , wherein N is set in advance according to a pixel requirement required for current photographing.

12. The device according to claim 7 , wherein the processor is configured to:

composite the N images using a principle of multi-image composition, to obtain the composite picture.

13. A mobile terminal, comprising a housing, a processor, a memory, a circuit board and a power circuity, wherein the circuit board is arranged in a space enclosed by the housing; the processor and the memory are arranged on the circuit board; the power circuity is configured to provide power to various circuities and components of the mobile terminal; the memory is configured to store executable program codes; the processor is configured to run programs corresponding to the executable computer codes by reading the executable program codes stored in the memory, to:

acquire a first exposure time t required for current photographing, and divide the first exposure time t into N segments, where N is M power of 4 and M is a positive integer;

control by a micro-electro-mechanical system MEMS, an image sensor to move clockwise or counterclockwise according to a step length of a preset number of pixels, and control the image sensor to expose for a second exposure time t/N after each movement of the image sensor according to the preset number of pixels, to acquire N images; and

composite the N images to obtain a composite picture, wherein the processor is configured to composite the N images to obtain the composite picture by:

determining an alignment rule of the N images according to a movement rule that the MEMS controls the image sensor to move, and aligning the N images according to the alignment rule; and

for each pixel position in the N images aligned, comparing contents of current pixels in the N images, and performing pixel composition based on a comparison result.

14. The mobile terminal according to claim 13 , wherein the processor is configured to compare the contents of the current pixels in the N images and perform the pixel composition based on the comparison result by acts of:

determining whether each of matching degrees between the contents of N current pixels exceeds a preset threshold; and

superimposing the N current pixels when each of the matching degrees exceeds the preset threshold.

15. The mobile terminal according to claim 14 , wherein the processor is further configured to:

in response to determining that any of the matching degrees between the contents of the N current pixels does not exceed the preset threshold, determine a first current pixel having a maximum difference from other current pixels in the N current pixels, replace the first current pixel with one of the other current pixels, and superimpose the other current pixels and a replaced first current pixel.

16. The mobile terminal according to claim 13 , wherein the preset number of pixels comprises one pixel.

17. The mobile terminal according to claim 13 , wherein N is set in advance according to a pixel requirement required for current photographing.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2018
From: WU, LEI
To: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
Reel/Frame 047833/0947 →
Priority Claims (1)
CN 2016 1 0616329 · Jul 29, 2016 · national
Continuity (1)
Related Publication 20190208103A1 · Jul 4, 2019