IP Library › Granted Patent US 12,080,008
Granted Patent B2
US 12,080,008 · App. 18/322,803 · Granted Sep 3, 2024

Time-of-flight depth measurement using modulation frequency adjustment

Inventors: Gal Bitan (Petach-Tikva, IL); Roy Yam (Ramat Gan, IL); Gershi Koltun (Giva't Ada, IL)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06T7/521G01S17/10G01S17/89G06V40/161H04N23/56G06T2207/10028G06T2207/10048G06T2207/10152G06T2207/20104G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,080,008
App. No.
18/322,803
Granted
Sep 3, 2024
Kind
B2
Abstract

In a method for time-of-flight (ToF) based measurement, a scene is illuminated using a ToF light source modulated at a first modulation frequency F MOD (1) . While the light is modulated using F MOD (1) , depths are measured to respective surface points within the scene, where the surface points are represented by a plurality of respective pixels. At least one statistical distribution parameter is computed for the depths. A second modulation frequency F MOD (2) higher than F MOD (1) is determined based on the at least one statistical distribution parameter. The depths are then re-measured using F MOD (2) to achieve a higher depth accuracy.

Claims (60)

1. An apparatus comprising:

a touchscreen interface configured to select a region of interest (RoI) of a scene; and

at least one time-of-flight (ToF) camera,

wherein the at least one ToF camera comprises:

an illuminator configured to illuminate a scene with modulated light;

an image sensor configured to capture the modulated light reflected from surface points in the scene; and

an image signal processor configured to identify the RoI through the touchscreen interface in a second ToF measurement of the RoI, measure depths of the RoI by performing ToF operations using the modulated light and output depth information with a precision different from a first ToF measurement of the RoI.

2. The apparatus of claim 1 , wherein the RoI is measured at a higher degree of accuracy than other areas of the scene in the second ToF measurement.

3. The apparatus of claim 1 , wherein accuracy of the second ToF measurement is higher than accuracy of the first ToF measurement.

4. The apparatus of claim 3 , wherein the image signal processor controls the accuracy of the second ToF measurement by adjusting a modulation frequency of the modulated light.

5. The apparatus of claim 1 , wherein the image signal processor measures first depths of the RoI based on a first ToF light source in the first ToF measurement and second depths of the RoI based on a second ToF light source in the second ToF measurement, and determines a second modulation frequency based on at least one statistical distribution parameter for the first depths,

wherein the second modulation frequency is different from the first modulation frequency.

6. The apparatus of claim 1 , wherein the ToF camera is configured as a stand-alone camera or an n-tap ToF camera, where n is two or four.

7. The apparatus of claim 1 , wherein the ToF camera further comprises an image sensor having a pixel array,

wherein pixels of the pixel array corresponding to the RoI are selected for iterative depth measurements, where each iteration provides a more precise measurement.

8. The apparatus of claim 1 ,

wherein the illuminator illuminates the scene using a ToF light source modulated at a first modulation frequency, and

wherein the image signal processor is further configured to:

measure depths to respective surface points within the scene using the first modulation frequency, the surface points being represented by a plurality of respective pixels;

compute at least one statistical distribution parameter for the depths;

determine a second modulation frequency higher than the first modulation frequency based on the at least one statistical distribution parameter; and

remeasure depths of the RoI using the second modulation frequency in the second ToF measurement.

9. The apparatus of claim 8 , wherein the at least one statistical distribution is a standard deviation of the depths.

10. The apparatus of claim 1 , wherein the touchscreen interface selects the RoI in a RoI depth mode to perform depth measurements over the RoI.

11. An operating method of an apparatus having at least one time-of-flight (ToF) camera, comprising,

performing a first ToF measurement of a scene using a first modulation frequency;

selecting a Region of Interest (RoI) of the scene through a touchscreen interface;

identifying the RoI through the touchscreen interface;

performing a second ToF measurement of the RoI using a first modulation frequency; and

outputting depth information with a precision different from the first ToF measurement.

12. The operating method of claim 11 , wherein the performing the first ToF measurement includes:

illuminating the scene using a ToF light source modulated at the first modulation frequency; and

measuring depths to respective surface points within the scene using the first modulation frequency, the surface points being represented by a plurality of respective pixels.

13. The operating method of claim 12 , wherein the performing the second ToF measurement includes:

computing at least one statistical distribution parameter for the depths;

determining the second modulation frequency higher than the first modulation frequency based on the at least one statistical distribution parameter; and

remeasuring depths of the RoI using the second modulation frequency.

14. The operating method of claim 13 , wherein further comprising:

recomputing the statistical distribution parameter for the depths that were remeasured;

determining whether the recomputed statistical parameter is above or below a threshold corresponding to a target depth accuracy;

providing the remeasured depths using the second modulation frequency as final measured depths when the recomputed statistical parameter is below the threshold;

determining a third modulation frequency higher than the second modulation frequency based on the recomputed statistical distribution parameter when the recomputed statistical parameter is above the threshold; and

remeasuring the depths of the RoI using the third modulation frequency.

15. The operating method of claim 11 , further comprising activating an RoI depth mode of the ToF camera.

16. A time-of-flight (ToF) camera embedded on a smart phone comprising:

an illuminator configured to illuminate a scene with modulated light;

an image sensor having pixels to capture the modulated light reflected from surface points in the scene and output voltages representing the same; and

an image signal processor configured to:

identify a region of interest (RoI) through a touchscreen interface in a second ToF measurement of the RoI;

measure depths of the RoI by performing ToF operations using the modulated light; and

output depth information with a precision different from a first ToF measurement of the RoI.

17. The ToF camera of claim 16 , wherein the modulated light includes infrared light,

wherein a second modulation frequency of the second ToF measurement is higher than a first modulation frequency of the first ToF measurement.

18. The ToF camera of claim 17 , wherein the image signal processor measures first depths of the RoI based on a first ToF light source in the first ToF measurement and second depths of the RoI based on a second ToF light source in the second ToF measurement, and determines the second modulation frequency based on at least one statistical distribution parameter for the first depths.

19. The ToF camera of claim 16 , wherein the illuminator illuminates the scene using a first ToF light source modulated at a first modulation frequency and illuminates the RoI using a second ToF light source modulated at a second modulation frequency.

20. The ToF camera of claim 16 , wherein the image signal processor is further configured to:

measure depths to respective surface points within the scene using a first modulation frequency, the surface points being represented by a plurality of respective pixels;

compute at least one statistical distribution parameter for the depths;

determine a second modulation frequency based on the at least one statistical distribution parameter; and

remeasure depths of the RoI using the second modulation frequency.

Continuity (3)
Continuation 17109439 · Dec 2, 2020
Continuation 16401285 · May 2, 2019
Related Publication 20230298190A1 · Sep 21, 2023