IP Library › Granted Patent US 9,609,221
Granted Patent B2
US 9,609,221 · App. 14/304,294 · Granted Mar 28, 2017

Image stabilization method and electronic device therefor

Inventors: Pyo-Jae Kim (Hwaseong-si, KR); Ki-Huk Lee (Yongin-si, KR); Young-Kwon Yoon (Seoul, KR)
Assignee: Samsung Electronics Co., Ltd.
H04N5/23277H04N5/2353H04N5/2354H04N5/23254
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,609,221
App. No.
14/304,294
Granted
Mar 28, 2017
Kind
B2
Abstract

An apparatus and method for reducing or preventing image degradation due to shaking of a camera upon image acquisition is provided. The method includes determining illuminance corresponding to a subject, automatically determining a capturing mode of an electronic device based on at least the illuminance, acquiring a first resulting image of the subject based on a first exposure time, if the capturing mode is a first capturing mode, and acquiring a plurality of images of the subject based on a second exposure time, if the capturing mode is a second capturing mode, and generating a second resulting image based on at least two images among the plurality of images.

Claims (72)

1. A method for an operation of an electronic device, the method comprising:

determining illuminance corresponding to a subject;

automatically determining a capturing mode of an electronic device based on at least the illuminance;

acquiring a first resulting image of the subject based on a first exposure time, if the capturing mode is a first capturing mode; and

acquiring a plurality of images of the subject based on a second exposure time, if the capturing mode is a second capturing mode, and generating a second resulting image based on at least two images among the plurality of images,

wherein the generating of the second resulting image based on the at least two images comprises synthesizing the at least two images, and

wherein the synthesizing of the at least two images comprises:

selecting a least blurred image as a reference image among the at least two images,

arranging at least one remaining image with reference to the reference image, and

correcting pixel values of the reference image based on pixel values of the at least one remaining image.

2. The method of claim 1 , wherein the second exposure time is shorter than the first exposure time.

3. The method of claim 1 , wherein the determining of the illuminance comprises determining an exposure value based on the illuminance.

4. The method of claim 1 , wherein the acquiring of the first resulting image comprises applying a first sensor gain.

5. The method of claim 4 , wherein the acquiring of the plurality of images of the subject based on the second exposure time comprises applying a second sensor gain different from the first sensor gain.

6. The method of claim 1 , wherein the acquiring of the plurality of images of the subject based on the second exposure time comprises one of increasing a number of the plurality of images as the illuminance is lowered, and decreasing the number of the plurality of images as the illuminance is increased.

7. The method of claim 1 , wherein the acquiring of the plurality of images of the subject based on the second exposure time comprises:

applying a first sensor gain if the illuminance is in a first range; and

applying a second sensor gain higher than the first sensor gain if the illuminance is in a second range lower than the first range.

8. The method of claim 1 , wherein the synthesizing of the at least two images comprises:

determining regions corresponding to a local motion associated with at least a part of the subject in each of the at least two images;

determining regions other than the regions in each of the at least two images;

synthesizing the regions determined in each of the at least two images; and

synthesizing the other regions determined in each of the at least two images.

9. The method of claim 8 , wherein the synthesizing of the regions comprises arranging at least a part of the regions based on a direction of the local motion.

10. The method of claim 8 , wherein the synthesizing of the other regions comprises arranging at least a part of the other regions based on a direction of motion of at least another part of the subject included in the other regions.

11. The method of claim 1 , wherein, if the illuminance is less than a set threshold value, the synthesizing of the at least two images comprises enhancing brightness of all or part of the at least two images or brightness of the second resulting image.

12. The method of claim 1 , wherein, if the illuminance is less than a set threshold value, the acquiring of the plurality of images comprises flashing light upon acquisition of at least a part of the plurality of images.

13. The method of claim 1 ,

wherein the at least two images comprise at least one image acquired with light flashing, and

wherein the generating of the second resulting image comprises:

separating the subject into a main subject and a sub subject based on a brightness difference between images acquired with the light flashing and the other images among the at least two images;

synthesizing regions corresponding to the main subject of the at least two images by applying a first weight value, and

synthesizing regions corresponding to the sub subject of the at least two images by applying a second weight value.

14. The method of claim 1 ,

wherein the at least two images comprise at least one image acquired with light flashing, and

wherein the generating of the second resulting image comprises increasing a number of the images acquired with light flashing as the illuminance is lowered, or decreasing the number of the images acquired with light flashing as the illuminance is increased.

15. An electronic device comprising:

an image sensor configured to acquire an image of a subject; and

at least one processor configured to:

determine illuminance corresponding to the subject,

automatically determine a capturing mode based on at least the illuminance,

acquire a first resulting image of the subject based on a first exposure time, if the capturing mode is a first capturing mode,

acquire a plurality of images of the subject based on a second exposure time, if the capturing mode is a second capturing mode, and

generate a second resulting image of the subject based on at least two images among the plurality of images,

wherein the generating of the second resulting image based on the at least two images comprises synthesizing the at least two images, and

wherein the synthesizing of the at least two images comprises:

selecting a least blurred image as a reference image among the at least two images,

arranging at least one remaining image with reference to the reference image, and

correcting pixel values of the reference image based on pixel values of the at least one remaining image.

16. The electronic device of claim 15 , wherein the second exposure time is shorter than the first exposure time.

17. The electronic device of claim 15 , wherein the at least one processor is further configured to determine an exposure value based on the illuminance.

18. The electronic device of claim 15 , wherein the at least one processor is further configured to:

acquire the first resulting image by applying a first sensor gain, and

acquire the plurality of images by applying a second sensor gain different from the first sensor gain.

19. The electronic device of claim 15 , wherein, if the illuminance is less than a set threshold value, the at least one processor is further configured to perform image synthesis by enhancing brightness of all or part of the at least two images or brightness of the second resulting image.

20. The electronic device of claim 15 , wherein, if the illuminance is less than a set threshold value, the at least one processor is further configured to flash light upon acquisition of at least a part of the plurality of images.

21. The electronic device of claim 15 ,

wherein the at least two images comprise at least one image acquired with light flashing, and

wherein the at least one processor is further configured to:

separate the subject into a main subject and a sub subject, based on a brightness difference between images acquired with the light flashing and the other images among the at least two images,

synthesize regions corresponding to the main subject of the at least two images by applying a first weight value, and

synthesize regions corresponding to the sub subject of the at least two images by applying a second weight value.

22. At least one non-transitory computer-readable recording medium storing instructions for executing a process comprising:

determining illuminance corresponding to a subject;

automatically determining a capturing mode of an electronic device, based on at least the illuminance;

acquiring a first resulting image of the subject based on a first exposure time, if the capturing mode is a first capturing mode; and

acquiring a plurality of images of the subject based on a second exposure time, if the capturing mode is a second capturing mode, and generating a second resulting image of the subject based on at least two images among the plurality of images;

wherein the generating of the second resulting image based on the at least two images comprises synthesizing the at least two images, and

wherein the synthesizing of the at least two images comprises:

selecting a least blurred image as a reference image among the at least two images,

arranging at least one remaining image with reference to the reference image, and

correcting pixel values of the reference image based on pixel values of the at least one remaining image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 13, 2014
From: KIM, PYO-JAE; LEE, KI-HUK; YOON, YOUNG-KWON
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 033100/0407 →
Priority Claims (1)
KR 10-2013-0104861 · Sep 2, 2013 · national
Continuity (1)
Related Publication 20150062410A1 · Mar 5, 2015