IP Library Granted Patent US 10,356,380
Granted Patent B2
US 10,356,380 · App. 15/140,716 · Granted Jul 16, 2019

Apparatus and method for acquiring depth information

Inventors: Jangwoo You (Seoul, KR); Yonghwa Park (Yongin-si, KR); Heesun Yoon (Seoul, KR); Myungjae Jeon (Yongin-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
H04N13/106G01S7/4816G01S7/4914G01S7/4915G01S17/36G01S17/89H04N5/2256H04N5/353H04N13/254H04N13/296H04N5/33H04N5/3532
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,356,380
App. No.
15/140,716
Granted
Jul 16, 2019
Kind
B2
Abstract

An apparatus and a method for acquiring depth information are disclosed. To acquire depth information, illumination light of which an amount of light has been modulated by a modulation signal is emitted towards a subject, and an image is captured using an image sensor. An image signal is sequentially acquired from a plurality of rows while shifting a phase of the illumination light at a start exposure time of a row belonging to an intermediate region of a pixel array region of the image sensor. Depth information is calculated from image signals acquired during a plurality of frames while shifting a phase of the modulation signal.

Claims (33)

1. A depth information acquisition method comprising:

emitting illumination light, of which an amount has been modulated by a modulation signal, towards a subject;

receiving, by an image sensor, reflective light reflected from the subject, the image sensor having a pixel array region including a plurality of rows, the plurality of rows including a first region including a first row of the plurality of rows, a second region including a last row of the plurality of rows, and an intermediate region including a center row of the plurality of rows;

for a plurality of frames:

sequentially acquiring an image signal from each of the plurality of rows by staggering a start exposure time for each of the plurality of rows; and

shifting a phase of the illumination light at a start exposure time of a row belonging to the intermediate region of the pixel array region; and

calculating depth information of the subject from the image signal acquired during the plurality of frames,

wherein an exposure time during which the center row is exposed to the illumination light before the phase of the illumination light is shifted, is set to zero so that the center row is exposed to the illumination light after the phase of the illumination light is shifted, and an amplitude of the image signal is maximized at the center row and gradually decreases with distance from the center row.

2. The depth information acquisition method of claim 1 , wherein the phase of the illumination light is shifted at a start exposure time of the center row of the pixel array region.

3. The depth information acquisition method of claim 1 , wherein the shifting the phase of the illumination light comprises shifting the phase of the illumination light by 90°, such that each row of the pixel array region is exposed during a first period r before the phase shift of the illumination light and a second period (1−r) after the phase shift of the illumination light, and the amplitude of the image signal acquired from each row of the pixel array region of the image sensor is proportional to √{square root over (r 2 +(1−r) 2 )}.

4. A depth information acquisition method comprising:

emitting illumination light, of which an amount has been modulated by a modulation signal, towards a subject;

receiving, by an image sensor, reflective light reflected from the subject, the image sensor having a pixel array region including a plurality of rows, the plurality of rows including a first region including a first row of the plurality of rows, a second region including a last row of the plurality of rows, and an intermediate region including a center row of the plurality of rows;

for a plurality of frames:

sequentially acquiring an image signal from each of the plurality of rows b staggering a start exposure time for each of the plurality of rows;

shifting a phase of the illumination light at a start exposure time of a row belonging to the intermediate region of the pixel array region; and

calculating depth information of the subject from the image signal acquired during the plurality of frames,

wherein an exposure time during which the row belonging to the intermediate region is exposed to the illumination light before the phase of the illumination light is shifted, is set to zero so that the row belonging to the intermediate region is exposed to the illumination light after the phase of the illumination light is shifted,

wherein the illumination light is burst-driven and emitted in predetermined time units, and further comprising shifting the phase of the illumination light and starting an emission of the illumination light after a start exposure time of the center row of the pixel array region.

5. The depth information acquisition method of claim 4 , wherein the image signal corresponds to only a single phase of the illumination light.

6. The depth information acquisition method of claim 1 , wherein the shifting the phase of the illumination light comprises shifting the phase of the illumination light by 90°, and further comprising calculating the depth information from the image signal acquired from four frames.

7. A depth information acquisition apparatus comprising:

a light source configured to emit illumination light, of which an amount has been modulated by a modulation signal, towards a subject;

an image sensor configured to receive reflective light reflected from the subject, the image sensor having a pixel array region including a plurality of rows, the plurality of rows including a first region including a first row of the plurality of rows, a second region including a last row of the plurality of rows, and an intermediate region including a center row of the plurality of rows; and

a depth image processor configured to, for a plurality of frames, sequentially acquire an image signal from each of the plurality of rows by staggering a start exposure time for each of the plurality of rows, and to calculate a distance to the subject by using the image signal, and

a controller configured to shift a phase of the illumination light at a start exposure time of the center row, and set an exposure time during which the center row is exposed to the illumination light before the phase of the illumination light is shifted, to zero so that the center row is exposed to the illumination light after the phase of the illumination light is shifted, and an amplitude of the image signal is maximized at the center row and gradually decreases with distance from the center row.

8. The depth information acquisition apparatus of claim 7 , wherein the image sensor is further configured to operate in a rolling shutter scheme.

9. The depth information acquisition apparatus of claim 7 , further comprising a light source driver configured to drive the light source by using the modulation signal and shift the phase of the modulation signal by synchronizing with a frame rate of the image sensor.

10. The depth information acquisition apparatus of claim 7 , wherein the image sensor is any one of a charge-coupled device (CCD) image sensor, a complementary metallic oxide semiconductor (CMOS) image sensor, and a photodiode array.

11. A three-dimensional (3D) image acquisition apparatus comprising the depth information acquisition apparatus of claim 7 and an image acquisition apparatus for sensing image information.

12. The 3D image acquisition apparatus of claim 11 , wherein the image sensor of the depth information acquisition apparatus is further configured to operate in a rolling shutter scheme.

13. The 3D image acquisition apparatus of claim 11 , wherein the depth information acquisition apparatus further comprises a light source driver configured to drive the light source by using the modulation signal and shift the phase of the modulation signal by synchronizing with a frame rate of the image sensor.

14. The 3D image acquisition apparatus of claim 11 , wherein the image sensor of the depth information acquisition apparatus is any one of a charge-coupled device (CCD) image sensor, a complementary metallic oxide semiconductor (CMOS) image sensor, and a photodiode array.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 28, 2016
From: YOU, JANGWOO; PARK, YONGHWA; YOON, HEESUN; JEON, MYUNGJAE
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 038403/0108 →
Priority Claims (1)
KR 10-2015-0151102 · Oct 29, 2015 · national
Continuity (1)
Related Publication 20170127036A1 · May 4, 2017
Cited By (1)
US 12,376,752