IP Library Granted Patent US 10,901,090
Granted Patent B2
US 10,901,090 · App. 15/317,367 · Granted Jan 26, 2021

TOF camera system and a method for measuring a distance with the system

Inventor: Ward Van Der Tempel (Keerbergen, BE)
Assignee: Sony Depthsensing Solutions SA/NV
G01S17/89G01S7/4876G01S7/493G01S7/4911G01S17/10G01S17/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,901,090
App. No.
15/317,367
Granted
Jan 26, 2021
Kind
B2
Abstract

The invention relates to a method for measuring a distance between an object of a scene and a Time-Of-Flight camera system, and providing a depth map of the object, the Time-Of-Flight camera system comprising an illumination unit, an imaging sensor having a matrix of pixels and image processing means, the method being characterized by the following steps: modifying in a discrete way the illumination of said illumination unit in order to illuminate elementary areas of the scene with different incident intensities, respectively, for distinguishing the direct incident light beams from the indirect incident light beams; receiving onto the pixels of the matrix of the sensor the beams reflected by said elementary areas and providing the image processing means with corresponding data; processing the said corresponding data for eliminating the influence of the indirect light beams in the depth map of the object.

Claims (30)

1. A method for measuring a distance between an object within a scene and a Time-Of-Flight camera system, and providing a depth map of the object, the Time-Of-Flight camera system comprising a light source, an imaging sensor having a matrix of pixels and an image processor, the method comprising:

modifying in a discrete way light output from said light source to form a pattern on the scene that illuminates elementary areas of the scene with different incident intensities;

receiving by the matrix of pixels of the imaging sensor, light reflected by said elementary areas of the scene and providing the image processor with data corresponding to the received reflected light, wherein the reflected light includes first reflected light associated with direct light beams incident on the scene and second reflected light associated with indirect light beams incident on the scene;

generating, based the data corresponding to the received reflected light, a first depth map;

determining a location of one or more peaks in the first depth map caused, at least in part, by the second reflected light;

determining, based on the determined location of one or more peaks in the first depth map, at least one pixel in the matrix of pixels that received exclusively or primarily only second reflected light; and

processing the data corresponding to the received reflected light to generate a second depth map in which an influence of the indirect light beams incident on the scene on a depth map of the object has been reduced, wherein generating the second depth map comprises:

determining, based on the at least one determined pixel in the matrix of pixels that received exclusively or primarily only second reflected light, an indirect component function; and

generating the second depth map by adjusting values in the data corresponding to the received reflected light based on the indirect component function.

2. The method of claim 1 , wherein modifying the light output from said light source comprises arranging a mask between the light source and the scene.

3. The method of claim 2 , wherein the first depth map and the second depth map are generated based on arranging a same mask between the light source and the scene.

4. The method of claim 1 , wherein determining, based on the first depth map, at least one pixel in the matrix of pixels that received exclusively or primarily only second reflected light comprises determining at least one pixel that only received second reflected light.

5. The method according to claim 1 , further comprising determining two different spatial zones of areas on the scene, associated with different sets of pixels of said matrix of pixels, respectively.

6. The method of claim 1 , wherein generating the second depth map comprises subtracting data associated with the determined at least one pixel in the matrix of pixels that received exclusively or primarily only second reflected light from one or more other pixels in the matrix of pixels that received a combination of first reflected light and second reflected light.

7. A Time-Of-Flight (TOF) camera system for measuring a distance between an object within a scene and the TOF camera system, and providing a depth map of the object, the TOF camera system comprising:

a light source arranged to illuminate the scene with a pattern of modulated light;

an imaging sensor having a matrix of pixels arranged to receive light reflected by one or more objects in the scene when the scene is illuminated by the modulated light output form the light source, wherein the reflected light includes first reflected light associated with direct light beams incident on the scene and second reflected light associated with indirect light beams incident on the scene;

an image processor programmed to:

receive from the imaging sensor, data corresponding to the reflected light received by the matrix of pixels

generate, based on the data corresponding to the reflected light, a first depth map;

determine a location of one or more peaks in the first depth map caused, at least in part, by the second reflected light;

determine, based on the determined location of one or more peaks in the first depth map, at least one pixel in the matrix of pixels that received exclusively or primarily only secondary reflected light; and

process the data corresponding to the received reflected light to generate a second depth map in which an influence of the indirect light beams incident on the scene on a depth map of the object has been reduced, wherein generating the second depth map comprises:

determining, based on the at least one determined pixel in the matrix of pixels that received exclusively or primarily only second reflected light, an indirect component function; and

generating the second depth map by adjusting values in the data corresponding to the received reflected light based on the indirect component function.

8. The TOF camera system of claim 7 , further comprising a mask associated with the light source to generate the pattern of modulated light.

9. The TOF camera system of claim 8 , wherein the mask comprises a series of identical pattern groups.

10. The TOF camera system of claim 8 , wherein the mask is configured such that the direct incident beams output from the light source impinge on particular areas of the scene.

11. The TOF camera system of claim 8 , wherein the first depth map and the second depth map are generated based on associating a same mask with the light source.

12. The TOF camera system of claim 7 , wherein generating the second depth map comprises-subtracting data associated with the determined at least one pixel in the matrix of pixels that received exclusively or primarily only second reflected light from one or more other pixels in the matrix of pixels that received a combination of first reflected light and second reflected light.

Assignments (2)
CHANGE OF NAME Recorded Dec 6, 2018
From: SOFTKINETIC SENSORS NV
To: SONY DEPTHSENSING SOLUTIONS SA/NV
Reel/Frame 047695/0319 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 24, 2017
From: VAN DER TEMPEL, WARD
To: SOFTKINETIC SENSORS NV
Reel/Frame 041372/0334 →
Priority Claims (1)
EP 14171985 · Jun 11, 2014 · regional
Continuity (1)
Related Publication 20170123067A1 · May 4, 2017
Cited By (1)
US 12,196,888