IP Library Granted Patent US 10,057,563
Granted Patent B2
US 10,057,563 · App. 14/974,952 · Granted Aug 21, 2018

Image pick-up apparatus, portable terminal having the same and image pick-up method using apparatus

Inventors: Eun Sung Seo (Seoul, KR); Young Woon Kim (Seoul, KR); Young Seop Moon (Seoul, KR); Yu Kyeong Jeong (Seoul, KR)
Assignee: LG INNOTEK CO., LTD.
H04N13/0296G06T7/593G06T7/80H04N5/23212H04N13/0225H04N13/0271G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,057,563
App. No.
14/974,952
Granted
Aug 21, 2018
Kind
B2
Abstract

Embodiments provide an image pick-up apparatus including an optical unit configured to output optical information acquired from a lens having a fixed focal distance, an image sensor unit configured to convert the optical information into electrical signals and including a plurality of phase difference detection pixels, an image information processing unit configured to generate interest image information by processing the electrical signals converted by the image sensor unit, a memory unit configured to store depth values matched with reference image information, a calculation unit configured to extract the depth value matched with the reference image information corresponding to the interest image information, and an image information output unit configured to output the depth value extracted by the calculation unit and, thus, depth information may be easily acquired using only one image pick-up apparatus.

Claims (80)

1. An image pick-up apparatus comprising:

an optical unit configured to output optical information acquired from a lens having a fixed focal distance;

an image sensor unit configured to convert the optical information into electrical signals and including a plurality of color pixels, wherein each of particular color pixels of the plurality of color pixels comprises a shielded region to serve as phase difference detection pixels;

an image information processing unit configured to generate interest image information by processing the electrical signals converted by the image sensor unit;

a memory unit configured to store depth values matched with reference image information;

a calculation unit configured to extract the depth value matched with the reference image information corresponding to the interest image information; and

an image information output unit configured to output the depth value extracted by the calculation unit;

wherein each of the particular color pixels further comprises:

a photodiode;

a mask layer disposed over the photodiode and spaced apart from the photodiode; and

a micro-lens disposed over the mask layer;

wherein the photodiode, the mask layer, and the micro-lens are aligned at a side of their respective particular color pixel; and

wherein at least two color pixels of the plurality of color pixels have micro-lenses inclined at different angles with respect to a corresponding mask lam of the color pixel.

2. The image pick-up apparatus according to claim 1 , wherein the phase difference detection pixels include:

a first group pixels, each having the shielded region deviated to one side thereof; and

a second group pixels, each having the shielded region deviated to the other side thereof.

3. The image pick-up apparatus according to claim 2 , wherein the interest image information includes a phase difference between a first electrical signal of the first group pixels and a second electrical signal of the second group pixels having the same luminous intensity level.

4. The image pick-up apparatus according to claim 2 , wherein the first group pixels are separated from each other by a designated interval in the row direction and disposed in a first arrangement line, the second group pixels are separated from each other by a designated interval in the row direction and disposed in a second arrangement line, and the first arrangement line and the second arrangement line intersect each other in the column direction.

5. The image pick-up apparatus according to claim 1 , wherein the plurality of color pixels are disposed in a lattice pattern,

wherein the plurality of color pixels comprises:

a plurality of first lattice units, each including a first red pixel, two first green pixels, and a first blue pixel, all generating image information; and

a plurality of second lattice units, each including a second red pixel and a second blue pixel, each generating the image information, and two second green pixels which are served as the phase difference detection pixels and generate the image information.

6. The image pick-up apparatus according to claim 5 , wherein the image information output unit outputs the image information generated by the plurality of color pixels, and

wherein the second green pixels are diagonally faced with each other in each second lattice unit.

7. The image pick-up apparatus according to claim 1 , wherein the image information output unit outputs a depth map including the depth value extracted by the calculation unit.

8. A portable terminal comprising:

an optical unit configured to output optical information acquired from a lens having a fixed focal distance;

an image sensor unit configured to convert the optical information into electrical signals and including a plurality of color pixels, wherein each of particular color pixels of the plurality of color pixels comprises a shielded region to serve as phase difference detection pixels;

an image information processing unit configured to generate interest image information by processing the electrical signals converted by the image sensor unit;

a memory unit configured to store depth values matched with reference image information;

a calculation unit configured to extract the depth value matched with the reference image information corresponding to the interest image information;

an image information output unit configured to output the depth value extracted by the calculation unit; and

a display device configured to display an image including the depth value output from the image information output unit;

wherein each of the particular color pixels further comprises:

a photodiode;

a mask layer disposed over the photodiode and spaced apart from the photodiode; and

a micro-lens disposed over the mask layer;

wherein the photodiode, the mask layer, and the micro-lens are aligned at a side of their respective particular color pixel; and

wherein at least two color pixels of the plurality of color pixels have micro-lenses inclined at different angles with respect to a corresponding mask layer of the color pixel.

9. The portable terminal according to claim 8 , wherein the phase difference detection pixels include:

a first group pixels, each having the shielded region deviated to one side thereof; and

a second group pixels, each having the shielded region deviated to the other side thereof.

10. The portable terminal according to claim 9 , wherein the interest image information includes a phase difference between a first electrical signal of the first group pixels and a second electrical signal of the second group pixels having the same luminous intensity level.

11. The portable terminal according to claim 9 , wherein the first group pixels are separated from each other by a designated interval in the row direction and disposed in a first arrangement line, the second group pixels are separated from each other by a designated interval in the row direction and disposed in a second arrangement line, and the first arrangement line and the second arrangement line intersect each other in the column direction.

12. The portable terminal according to claim 8 , wherein the plurality of color pixels are disposed in a lattice pattern together,

wherein the plurality of color pixels comprises:

a plurality of first lattice units, each including a first red pixel, two first green pixels, and a first blue pixel, all generating image information; and

a plurality of second lattice units, each including a second red pixel and a second blue pixel, each generating the image information, and two second green pixels which are served as the phase difference detection pixels and generate the image information.

13. The portable terminal according to claim 12 , wherein the image information output unit outputs the image information generated by the plurality of color pixels, and

wherein the second green pixels are diagonally faced with each other in each second lattice unit.

14. An image pick-up method using an image pick-up apparatus comprising:

an optical unit configured to output optical information acquired from a lens having a fixed focal distance;

an image sensor unit configured to convert the optical information into electrical signals and including a plurality of color pixels, wherein each of particular color pixels of the plurality of color pixels comprises a shielded region to serve as phase difference detection pixels;

an image information processing unit configured to generate interest image information by processing the electrical signals converted by the image sensor unit;

a memory unit configured to store depth values matched with reference image information;

a calculation unit configured to extract the depth value matched with the reference image information corresponding to the interest image information; and

an image information output unit configured to output the depth value extracted by the calculation unit,

the image pick-up method comprising:

acquiring optical information;

converting the optical information into electrical signals;

processing the converted electrical signals to generate the interest image information;

extracting a corresponding depth value by comparing the interest image information with the reference image information stored in the memory; and

providing the extracted depth value;

wherein each of the particular color pixels further comprises:

a photodiode;

a mask layer disposed over the photodiode and spaced apart from the photodiode; and

a micro-lens disposed over the mask layer;

wherein the photodiode, the mask layer, and the micro-lens are aligned at a side of their respective particular color pixel;

wherein at least two color pixels of the plurality of color pixels have micro-lenses inclined at different angles with respect to a corresponding mask layer of the color pixel.

15. The image pick-up method according to claim 14 , wherein, in provision of the extracted depth value, a depth map using the extracted depth value is provided.

16. The image pick-up method according to claim 14 , wherein the phase difference detection pixels include:

a first group pixels, each having the shielded region deviated to one side thereof; and

a second group pixels, each having the shielded region deviated to the other side thereof.

17. The image pick-up method according to claim 16 , wherein the interest image information includes a phase difference between a first electrical signal of the first group pixels and a second electrical signal of the second group pixels having the same luminous intensity level.

18. The image pick-up method according to claim 16 , wherein the first group pixels are separated from each other by a designated interval in the row direction and disposed in a first arrangement line, the second group pixels are separated from each other by a designated interval in the row direction and disposed in a second arrangement line, and the first arrangement line and the second arrangement line intersect each other in the column direction.

19. The image pick-up method according to claim 14 , wherein the plurality of color pixels are disposed in a lattice pattern,

wherein the plurality of color pixels comprises:

a plurality of first lattice units, each including a first red pixel, two first green pixels, and a first blue pixel, all generating image information; and

a plurality of second lattice units, each including a second red pixel and a second blue pixel, each generating the image information, and two second green pixels which are served as the phase difference detection pixels and generate the image information.

20. The image pick-up method according to claim 19 , wherein the image information output unit outputs the image information generated by the plurality of color pixels, and wherein the second green pixels are diagonally faced with each other in each second lattice unit.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 22, 2016
From: SEO, EUN SUNG; KIM, YOUNG WOON; MOON, YOUNG SEOP; JEONG, YU KYEONG
To: LG INNOTEK CO., LTD.
Reel/Frame 038350/0284 →
Priority Claims (1)
KR 10-2014-0183281 · Dec 18, 2014 · national
Continuity (1)
Related Publication 20160182896A1 · Jun 23, 2016