IP Library Granted Patent US 9,568,607
Granted Patent B2
US 9,568,607 · App. 14/150,361 · Granted Feb 14, 2017

Depth sensor and method of operating the same

Inventors: Kwang Hyuk Bae (Seoul, KR); Kyu Min Kyung (Seoul, KR); Tae Chan Kim (Yongin-si, KR); Shung Han Cho (Seoul, KR)
Assignee: Samsung Electronics Co., Ltd.
G01S17/89G01S7/4915
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,568,607
App. No.
14/150,361
Granted
Feb 14, 2017
Kind
B2
Abstract

A method of operating a depth sensor includes generating a first photo gate signal and second through fourth photo gate signals respectively having 90-, 180- and 270-degree phase differences from the first photo gate signal, applying the first photo gate signal and the third photo gate signal to a first row of a pixel array and the second photo gate signal and the fourth photo gate signal to a second row adjacent to the first row in a first frame using a first clock signal, and applying the first photo gate signal and the third photo gate signal to a first column of the pixel array and the second photo gate signal and the fourth photo gate signal to a second column adjacent to the first column in a second frame using a second clock signal.

Claims (47)

1. A method of operating a depth sensor, the method comprising:

generating a first photo gate signal and second through fourth photo gate signals respectively having 90-, 180- and 270-degree phase differences from the first photo gate signal;

applying the first photo gate signal and the third photo gate signal to a first row of a pixel array and the second photo gate signal and the fourth photo gate signal to a second row adjacent to the first row in a first frame using a first clock signal; and

applying the first photo gate signal and the third photo gate signal to a first column of the pixel array and the second photo gate signal and the fourth photo gate signal to a second column adjacent to the first column in a second frame using a second clock signal,

wherein a frequency of the first clock signal is different from a frequency of the second clock signal.

2. The method of claim 1 , further comprising:

interpolating pixel signals output from respective pixels comprised in the pixel array; and

generating image data based on interpolated pixel signals.

3. The method of claim 2 , wherein the interpolating the pixel signals comprises:

interpolating a pixel signal of a pixel in the first row based on a pixel signal of at least one pixel in the second row in the first frame; and

interpolating a pixel signal of a pixel in the second row based on a pixel signal of at least one pixel in the first row in the first frame.

4. The method of claim 3 , wherein the interpolating the pixel signal of the pixel in the first row based on the pixel signal of the at least one pixel in the second row comprises applying a weight corresponding to an offset of the at least one pixel in the second row to the pixel signal of the at least one pixel in the second row; and

the interpolating the pixel signal of the pixel in the second row based on the pixel signal of the at least one pixel in the first row comprises applying a weight corresponding to an offset of the at least one pixel in the first row to the pixel signal of the at least one pixel in the first row.

5. The method of claim 4 , wherein the weight is calculated based on a Gaussian function.

6. The method of claim 3 , wherein the interpolating the pixel signals further comprises:

interpolating a pixel signal of a pixel in the first column based on a pixel signal of at least one pixel in the second column in the second frame; and

interpolating a pixel signal of a pixel in the second column based on a pixel signal of at least one pixel in the first column in the second frame.

7. The method of claim 6 , wherein the interpolating the pixel signal of the pixel in the first column based on the pixel signal of the at least one pixel in the second column comprises applying a weight corresponding to an offset of the at least one pixel in the second column to the pixel signal of the at least one pixel in the second column; and

the interpolating the pixel signal of the pixel in the second column based on the pixel signal of the at least one pixel in the first column comprises applying a weight corresponding to an offset of the at least one pixel in the first column to the pixel signal of the at least one pixel in the first column.

8. The method of claim 7 , wherein the weight is calculated based on a Gaussian function.

9. A depth sensor comprising:

a photo gate signal generator configured to generate a first photo gate signal and second through fourth photo gate signals respectively having 90-, 180- and 270-degree phase differences from the first photo gate signal; and

a row and column selector configured to apply the first through fourth photo gate signals to rows or columns of a pixel array, the row and column selector being configured to apply the first photo gate signal and the third photo gate signal to a first row of the pixel array and the second photo gate signal and the fourth photo gate signal to a second row adjacent to the first row in a first frame using a first clock signal and being configured to apply the first photo gate signal and the third photo gate signal to a first column of the pixel array and the second photo gate signal and the fourth photo gate signal to a second column adjacent to the first column in a second frame using a second clock signal,

wherein a frequency of the first clock signal is different from a frequency of the second clock signal.

10. The depth sensor of claim 9 , further comprising an image signal processor configured to interpolate pixel signals output from respective pixels comprised in the pixel array and to generate image data based on interpolated pixel signals.

11. The depth sensor of claim 10 , wherein the image signal processor is configured to interpolate a pixel signal of a pixel in the first row based on a pixel signal of at least one pixel in the second row in the first frame and is configured to interpolate the pixel signal of a pixel in the second row based on a pixel signal of at least one pixel in the first row in the first frame.

12. The depth sensor of claim 11 , wherein the image signal processor is configured to apply a weight corresponding to an offset of the at least one pixel in the second row to the pixel signal of the at least one pixel in the second row when interpolating the pixel signal of the pixel in the first row based on the pixel signal of the at least one pixel in the second row and is configured to apply a weight corresponding to an offset of the at least one pixel in the first row to the pixel signal of the at least one pixel in the first row when interpolating the pixel signal of the pixel in the second row based on the pixel signal of the at least one pixel in the first row.

13. The depth sensor of claim 10 , wherein the image signal processor is configured to interpolate a pixel signal of a pixel in the first column based on a pixel signal of at least one pixel in the second column in the second frame and is configured to interpolate a pixel signal of a pixel in the second column based on a pixel signal of at least one pixel in the first column in the second frame.

14. The depth sensor of claim 13 , wherein the image signal processor is configured to apply a weight corresponding to an offset of the at least one pixel in the second column to the pixel signal of the at least one pixel in the second column when interpolating the pixel signal of the pixel in the first column based on the pixel signal of the at least one pixel in the second column and is configured to apply a weight corresponding to an offset of the at least one pixel in the first column to the pixel signal of the at least one pixel in the first column when interpolating the pixel signal of the pixel in the second column based on the pixel signal of the at least one pixel in the first column.

15. A method of operating a depth sensor, the method comprising:

interpolating pixel signals output from pixels of first and second adjacent rows of a pixel array in a first frame, wherein the pixels of the first and second adjacent rows of the pixel array generate the pixel signals in response to an optical signal reflected from a scene;

interpolating pixel signals output from pixels of first and second adjacent columns of the pixel array in a second frame, wherein the pixels of the first and second adjacent columns of the pixel array generate the pixel signals in response to an optical signal reflected from the scene, and wherein the pixel signals of the first frame are generated using a first clock signal and the pixel signals of the second frame are generated using a second clock signal different than the first clock signal; and

generating image data based on the interpolated pixel signals,

wherein the pixel signals of the first row are generated by a first pair of photo gate signals out of phase with each other and the pixel signals of the second row are generated by a second pair of photo gate signals out of phase with each other, and

wherein the pixel signals of the first column are generated by the first pair of photo gate signals and the pixel signals of the second column are generated by the second pair of photo gate signals.

16. The method of claim 15 , wherein the first pair of photo gate signals comprise first and third photo gate signals, and the second pair of photo gate signals comprise second and fourth photo gate signals, and

wherein the second, third and fourth photo gate signals respectively have 90-, 180- and 270-degree phase differences from the first photo gate signal.

17. The method of claim 15 , wherein the interpolating the pixel signals comprises:

interpolating a pixel signal of a first pixel in the first row based on a pixel signal of a second pixel in the second row;

interpolating the pixel signal of the second pixel in the second row based on the pixel signal of the first pixel in the first row;

interpolating a pixel signal of a first pixel in the first column based on a pixel signal of a second pixel in the second column: and

interpolating the pixel signal of the second pixel in the second column based on the pixel signal of the first pixel in the first column.

18. The method of claim 17 , wherein the interpolating the pixel signal of the first pixel in the first row based on the pixel signal of the second pixel in the second row comprises applying a weight corresponding to a reflected signal offset of the second pixel to the pixel signal of the second pixel;

the interpolating the pixel signal of the second pixel in the second row based on the pixel signal of the first pixel in the first row comprises applying a weight corresponding to a reflected signal offset of the first pixel to the pixel signal of the first pixel;

the interpolating the pixel signal of the first pixel in the first column based on the pixel signal of the second pixel in the second column comprises applying a weight corresponding to a reflected signal offset of the second pixel to the pixel signal of the second pixel; and

the interpolating the pixel signal of the second pixel in the second column based on the pixel signal of the first pixel in the first column comprises applying a weight corresponding to a reflected signal offset of the first pixel to the pixel signal of the first pixel.

19. The method of claim 15 , wherein a frequency of the first clock signal is different from a frequency of the second clock signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2014
From: BAE, KWANG HYUK; KYUNG, KYU MIN; KIM, TAE CHAN; CHO, SHUNG HAN
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 031936/0365 →
Priority Claims (1)
KR 10-2013-0137176 · Nov 12, 2013 · national
Continuity (1)
Related Publication 20150130904A1 · May 14, 2015