IP Library › Granted Patent US 10,070,113
Granted Patent B2
US 10,070,113 · App. 15/336,064 · Granted Sep 4, 2018

Image processing device and operational method thereof

Inventors: Dongsoo Kim (Gyeonggi-do, KR); Hwayong Kang (Gyeonggi-do, KR); Jian Chang (Gyeonggi-do, KR); Youngkwon Yoon (Seoul, KR); Donghoon Jang (Gyeonggi-do, KR)
Assignee: Samsung Electronics Co., Ltd
H04N9/735H04N5/2257H04N5/232H04N5/349H04N9/045H04N9/07H04N2209/045
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,070,113
App. No.
15/336,064
Granted
Sep 4, 2018
Kind
B2
Abstract

An image processing method and device are provided. The image processing device includes an image sensor module including a lens and an image sensor; and a processor configured to obtain, using the image sensor module, a first image having first color information, the first image corresponding to an external object, by; move at least one of the lens and the image sensor based on a designated pixel unit; obtain, using the image sensor module with the moved at least one of the lens and the image sensor, a second image having second color information, the second image corresponding to the external object; and generate a third image having third color information based on the first color information and the second color information, the third image corresponding to the external object.

Claims (50)

1. An image processing device, comprising:

an image sensor module including a lens and an image sensor;

an actuator; and

a processor configured to:

obtain, using the image sensor module, a first image having first color information, the first image corresponding to an external object;

move at least one of the lens and the image sensor based on a designated pixel unit;

obtain, using the image sensor module with the moved at least one of the lens and the image sensor, a second image having second color information, the second image corresponding to the external object;

generate a third image having third color information based on the first color information and the second color information, the third image corresponding to the external object; and

when the first color information includes white information, control the actuator to move the at least one of the lens and the image sensor so that the second color information includes red information, green information, or blue information.

2. The image processing device of claim 1 , wherein the processor is further configured to:

obtain at least one of a property of the external object, settings of the image processing device, and context information associated with an environment around the image processing device; and

dynamically adjust the designated pixel unit based on the at least one of the property of the external object, the settings of the image processing device, and the context information.

3. The image processing device of claim 1 , wherein the image sensor comprises a pixel that senses white information.

4. The image processing device of claim 1 , wherein the processor is further configured to generate the third color information by combining at least some of the first color information and at least some of the second color information.

5. The image processing device of claim 1 ,

wherein the processor is further configured to control the actuator to move the at least one of the lens and the image sensor so that the second color information includes different color information than the first color information.

6. The image processing device of claim 1 ,

wherein the processor is further configured to control the actuator to move the at least one of the lens and the image sensor so that the second color information includes color information that is substantially the same the first color information.

7. The image processing device of claim 1 , wherein the processor is further configured to:

obtain brightness information using the image sensor; and

obtain the second image based on the sensed brightness information.

8. The image processing device of claim 1 , wherein the processor is further configured to combine white information from the first color information, and one of red information, green information, and blue information from the second color information.

9. The image processing device of claim 1 ,

wherein the processor is further configured to,

when the first color information includes cyan color information, magenta color information, or yellow color information, control the actuator to move the at least one of the lens and the image sensor so that the second color information includes red information, green information, or blue information.

10. A method of image processing by an image processing device that includes an image sensor module and a processor, the method comprising:

obtaining, using the image sensor module, which includes a lens and an image sensor, a first image having first color information, the first image corresponding to an external object;

moving at least one of the lens and the image sensor based on a designated pixel unit;

obtaining, using the image sensor module with the moved at least one of the lens and the image sensor, a second image having second color information, the second image corresponding to the external object; and

generating, by using the processor, a third image having third color information based on at least the first color information and the second color information, the third image corresponding to the external object,

wherein moving the at least one of the lens and the image sensor based on the designated pixel unit comprises, when the first color information includes white information, moving the at least one of the lens and the image sensor so that the second color information includes red information, green information, or blue information.

11. The method of claim 10 , wherein obtaining the second image comprises:

obtaining at least one of a property of the external object, settings of the image processing device, and context information associated with an environment around the image processing device; and

dynamically adjusting the designated pixel unit based on the at least one of the property of the external object, the settings of the image processing device, and the context information.

12. The method of claim 10 , wherein the first image and the second image include white information.

13. The method of claim 10 , wherein generating the third image comprises generating the third color information by combining at least some of the first color information and at least some of the second color information.

14. The method of claim 10 , wherein the image processing device further comprises an actuator, and

wherein obtaining the second image comprises the processor controlling the actuator to move the at least one of the lens and the image sensor so that the second color information includes color information that is different from the first color information.

15. The method of claim 14 ,

wherein obtaining of the second image comprises the processor controlling the actuator to move the at least one of the lens and the image sensor so that the second color information includes color information that is substantially the same as the first color information.

16. The method of claim 10 , wherein obtaining the second image comprises:

obtaining brightness information by using the image sensor; and

obtaining the second image based on the sensed brightness information.

17. The method of claim 10 , wherein generating the third image comprises combining white information from the first color information, and one of red information, green information, and blue information from the second color information.

18. A non-transitory computer readable recording medium that records a program for implementing operations in an image processing device including an image sensor module and a processor, the operations comprising:

obtaining, using the image sensor module, which includes a lens and an image sensor, a first image having first color information, the first image corresponding to an external object;

moving at least one of the lens and the image sensor based on a designated pixel unit;

obtaining, using the image sensor module with the moved at least one of the lens and the image sensor, a second image having second color information, the second image corresponding to the external object;

generating, by using the processor, a third image having third color information based on at least the first color information and the second color information, the third image corresponding to the external object; and

wherein moving the at least one of the lens and the image sensor based on the designated pixel unit comprises, when the first color information includes white information, moving the at least one of the lens and the image sensor so that the second color information includes red information, green information, or blue information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 7, 2016
From: KIM, DONGSOO; KANG, HWAYONG; CHANG, JIAN; YOON, YOUNGKWON; JANG, DONGHOON
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 040242/0445 →
Priority Claims (1)
KR 10-2015-0149319 · Oct 27, 2015 · national
Continuity (1)
Related Publication 20170118453A1 · Apr 27, 2017