IP Library Granted Patent US 12,032,065
Granted Patent B2
US 12,032,065 · App. 16/940,237 · Granted Jul 9, 2024

System and method for histogram binning for depth detection

Inventors: Chunji Wang (Pasadena, CA); Yibing Michelle Wang (Temple City, CA)
Assignee: Samsung Electronics Co., Ltd.
G01S17/89G01S7/4816G01S7/4863G01S7/4865G01S17/10G01S17/42
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,032,065
App. No.
16/940,237
Granted
Jul 9, 2024
Kind
B2
Abstract

Provided is a depth detection system and method of histogram binning for depth detection. The depth detection system includes a light source configured to emit a light pulse toward an object, an optical sensor configured to detect the light pulse reflecting off the object, the optical sensor including a first sensing pixel configured to detect the light pulse for a first event count according to the light pulse reflecting off the object, and a second sensing pixel configured to detect the light pulse for a second event count according to the light pulse reflecting off the object, and a processing circuit configured to determine a first aggregated histogram corresponding to the first sensing pixel based on the first event count and the second event count and determine a first peak of the first aggregated histogram to determine a first time of flight associated with the first sensing pixel.

Claims (48)

1. A depth detection system comprising:

a light source configured to emit a light pulse toward an object;

an optical sensor configured to detect the light pulse reflecting off the object, the optical sensor comprising a first sensing pixel configured to detect the light pulse for a first event count according to the light pulse reflecting off the object, and a second sensing pixel configured to detect the light pulse for a second event count according to the light pulse reflecting off the object; and

a processing circuit configured to:

determine a first histogram based on the first event count;

determine a second histogram based on the second event count;

determine a first aggregated histogram corresponding to the first sensing pixel based on the first event count and the second event count by binning the second histogram with the first histogram in response to whether a threshold for signal quality corresponding to an allowable range of outer limits of a spread or range of relative time of flights indicated by the second histogram is satisfied; and

determine a first peak of the first aggregated histogram to determine a first time of flight associated with the first sensing pixel.

2. The depth detection system of claim 1 , wherein each of the first sensing pixel and the second sensing pixel comprises a single SPAD.

3. The depth detection system of claim 1 , wherein the processing circuit is further configured to determine a second peak of the first aggregated histogram to determine a second time of flight associated with the first sensing pixel.

4. The depth detection system of claim 1 , further comprising a third sensing pixel configured to detect the light pulse for a third event count according to the light pulse reflecting off the object,

wherein the first sensing pixel, the second sensing pixel, and the third sensing pixel are arranged in a sensing pixel row, and

wherein the processing circuit is further configured to determine the first aggregated histogram corresponding to the first sensing pixel based on the first event count, the second event count, and the third event count.

5. The depth detection system of claim 1 , further comprising a third sensing pixel configured to detect the light pulse for a third event count according to the light pulse reflecting off the object,

wherein the first sensing pixel, the second sensing pixel, and the third sensing pixel are arranged in a sensing pixel column, and

wherein the processing circuit is further configured to determine the first aggregated histogram corresponding to the first sensing pixel based on the first event count, the second event count, and the third event count.

6. The depth detection system of claim 1 , wherein the processing circuit is further configured to determine the first aggregated histogram corresponding to the first sensing pixel based on the first event count and the second event count by applying a weight to the first event count or the second event count.

7. The depth detection system of claim 1 , wherein the processing circuit is further configured to:

determine the first aggregated histogram corresponding to the first sensing pixel based on the first event count and the second event count by binning the second histogram with the first histogram in response to whether a threshold for correlation between the first histogram and the second histogram is satisfied, the threshold for correlation being distinct from the threshold for signal quality.

8. A method of histogram binning, the method comprising:

emitting, by a light source, a light pulse toward an object;

detecting, by an optical sensor, the light pulse reflecting off the object;

detecting the light pulse for a first event count, by a first sensing pixel of the optical sensor, according to the light pulse reflecting off the object;

detecting the light pulse for a second event count, by a second sensing pixel of the optical sensor, according to the light pulse reflecting off the object;

determining, by a processing circuit, a first histogram based on the first event count;

determining, by the processing circuit, a second histogram based on the second event count;

determining, by the processing circuit, a first aggregated histogram corresponding to the first sensing pixel based on the first event count and the second event count by binning the second histogram with the first histogram in response to whether a threshold for signal quality corresponding to an allowable range of outer limits of a spread or range of relative time of flights indicated by the second histogram is satisfied; and

determining, by the processing circuit, a first peak of the first aggregated histogram to determine a first time of flight associated with the first sensing pixel.

9. The method of claim 8 , wherein each of the first sensing pixel and the second sensing pixel comprises a single SPAD.

10. The method of claim 8 , the method further comprising determining, by the processing circuit, a second peak of the first aggregated histogram to determine a second time of flight associated with the first sensing pixel.

11. The method of claim 8 , the method further comprising:

detecting the light pulse for a third event count, by a third sensing pixel of the optical sensor, according to the light pulse reflecting off the object,

wherein the first sensing pixel, the second sensing pixel, and the third sensing pixel are arranged in a sensing pixel row,

wherein the determining, by the processing circuit, the first aggregated histogram corresponding to the first sensing pixel is based on the first event count, the second event count, and the third event count.

12. The method of claim 8 , the method further comprising:

detecting the light pulse for a third event count, by a third sensing pixel of the optical sensor, according to the light pulse reflecting off the object,

wherein the first sensing pixel, the second sensing pixel, and the third sensing pixel are arranged in a sensing pixel column,

wherein the determining, by the processing circuit, the first aggregated histogram corresponding to the first sensing pixel is based on the first event count, the second event count, and the third event count.

13. The method of claim 8 , wherein the determining, by the processing circuit, the first aggregated histogram corresponding to the first sensing pixel based on the first event count and the second event count comprises applying a weight to the first event count or the second event count.

14. The method of claim 8 ,

wherein the determining, by the processing circuit, the first aggregated histogram corresponding to the first sensing pixel based on the first event count and the second event count further comprises binning the second histogram with the first histogram in response to whether a threshold for correlation between the first histogram and the second histogram is satisfied, the threshold for correlation being distinct from the threshold for signal quality.

15. A method of histogram binning, the method comprising:

selecting, by a processing circuit, a first sensing pixel of interest;

generating, by the processing circuit, a first histogram for a sensing pixel of interest and a second histogram for a sensing pixel adjacent to the sensing pixel of interest based on signals received by an optical sensor;

generating, by the processing circuit, a first aggregated histogram for the first sensing pixel of interest based on the first histogram and the second histogram, by binning the first histogram with the second histogram in response to a threshold for signal quality corresponding to an allowable range of outer limits of a spread or range of relative time of flights indicated by the second histogram being satisfied; and

determining, by the processing circuit, a first peak of the first aggregated histogram to determine a first time of flight associated with the sensing pixel of interest.

16. The method of claim 15 , the method further comprising determining, by the processing circuit, a second peak of the first aggregated histogram to determine a second time of flight associated with the sensing pixel of interest.

17. The method of claim 15 , wherein the generating, by the processing circuit, the first aggregated histogram for the first sensing pixel of interest based on the first histogram and the second histogram comprises applying a weight to the first histogram or the second histogram prior to binning the first histogram with the second histogram.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 16, 2020
From: WANG, CHUNJI; WANG, YIBING MICHELLE
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 054665/0168 →
Continuity (2)
Provisional Application 63037244 · Jun 10, 2020
Related Publication 20210389462A1 · Dec 16, 2021