IP Library Granted Patent US 9,720,089
Granted Patent B2
US 9,720,089 · App. 13/356,618 · Granted Aug 1, 2017

3D zoom imager

Inventors: Sagi Katz (Yokneam Ilit, IL); Avishai Adler (Kiryat Haim, IL); Giora Yahav (Haifa, IL); David Cohen (Nesher, IL); Eli Larry (Beit She'an, IL); Shlomo Felzenshtein (Nesher, IL)
Assignee: Microsoft Technology Licensing, LLC
G01S17/89G01S17/10G01S17/87H04N13/0239
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,720,089
App. No.
13/356,618
Granted
Aug 1, 2017
Kind
B2
Abstract

A 3D imager comprising two cameras having fixed wide-angle and narrow angle FOVs respectively that overlap to provide an active space for the imager and a controller that determines distances to features in the active space responsive to distances provided by the cameras and a division of the active space into near, intermediate, and far zones.

Claims (41)

1. A three-dimensional (3D) imaging system that images features in an active space and determines distances to the features, the imaging system comprising:

a light source that illuminates the active space with at least one light pulse;

first and second three dimensional (3D) cameras having optical centers and comprising first and second photosensors respectively having pixels on which the cameras image light reflected from the at least one light pulse to acquire distance images of the features, wherein the first and second 3D cameras have wide-angle and narrow-angle fields of view (FOVs) respectively, which overlap to provide the active space and each camera is operable to acquire distance images of the features in the active space independent of the other 3D camera;

a plurality of range bounds that divide the active space into zones, the range bounds comprising a near range upper bound, “NR U ”, and a far range lower bound “FR L ”; and

a controller that processes the distance images responsive to the zones to determine distances to the features.

2. The 3D imaging system according to claim 1 wherein the range bounds satisfy a relationship FR L <NR U and divide the active space into near, intermediate, and far zones, for which distances to features in the active space are less than FR L , between FR L and NR U , and greater than NR U respectively.

3. The 3D imaging system according to claim 2 wherein to provide a range image comprising distances to features in the active space, the controller:

designates one of the 3D cameras a prime camera and the other a secondary camera;

determines for each of a plurality of pixels in the prime camera a trial distance for a feature in the active space that is imaged on the pixel;

determines the distance to the feature to be the trial distance if the prime camera is the first camera and the determined distance is in the near zone or the prime camera is the second camera and the trial distance is in the far zone;

determines the distance responsive to the trial distance and a distance provided by a pixel in the secondary camera if the prime camera is the first camera and the determined distance is not in the near zone or the prime camera is the second camera and the trial distance is not in the far zone; and

uses the distances determined for the pixels in the prime camera for the distances in the range image.

4. The 3D imaging system according to claim 3 wherein the trial distance lies in the intermediate zone.

5. The 3D imaging system according to claim 4 wherein the controller determines the distance to the feature as an average of the trial distance and the distance provided by the pixel in the secondary camera.

6. The 3D imaging system according to claim 5 wherein the average is a weighted average.

7. The 3D imaging system according to claim 3 wherein the prime camera is the first camera and the trial distance lies in the far zone or the prime camera is the second camera and the trial distance lies in the near zone.

8. The 3D imaging system according to claim 7 wherein the controller determines which pixels in the secondary camera image points along a line that passes through the pixel in the prime camera and the optical center of the prime camera.

9. The 3D imaging system according to claim 8 , wherein the controller determines a distance for each of the determined pixels in the secondary camera responsive to a distance image acquired by the pixel with light from the at least one light pulse.

10. The 3D imaging system according to claim 9 wherein the controller determines a probability distribution that a given distance along a line that passes through the optical center of the secondary camera and the determined pixel is an actual distance of the feature imaged on the determined pixel from the secondary camera.

11. The 3D imaging system according to claim 10 wherein the controller determines a probability distribution that a given distance along the line in the prime camera is an actual distance of the feature imaged on the prime camera pixel from the prime camera.

12. The 3D imaging system according to claim 11 wherein the controller uses the probability distributions determined for the given distances from the prime camera and the secondary camera to determine a distance of the feature imaged on the prime camera pixel from the prime camera.

13. The 3D imaging system according to claim 1 wherein a camera of the first and second 3D cameras is a time of flight (TOF) camera.

14. A method of determining distance to features located in an active space, the method comprising:

illuminating the active space with at least one light pulse;

imaging features in the active space using first and second three dimensional (3D) cameras having optical centers and comprising first and second photosensors respectively having pixels on which the cameras image light reflected from the at least one light pulse to acquire distance images of the features, wherein the first and second 3D cameras have wide-angle and narrow-angle fields of view (FOVs) respectively, which overlap to provide the active space, and each camera is operable independent of the other to acquire distance measurements for the features in the active space;

dividing the active space into zones delimited by a plurality of range bounds the range bounds comprising a a near range upper bound, “NR U ”, and a far range lower bound “FR L ”; and

processing the distance images responsive to the zones to determine distances to the features.

15. A method according to claim 14 wherein the range bounds satisfy a relationship FR L <NR U and divide the active space into near, intermediate, and far zones, for which distances to features in the active space are less than FR L , between FR L and NR U , and greater than NR U respectively.

16. The method according to claim 15 and comprising:

designating one of the 3D cameras a prime camera and the other a secondary camera;

determining for each of a plurality of pixels in the prime camera a trial distance for a feature in the active space that is imaged on the pixel;

determining the distance to the feature to be the trial distance if the prime camera is the first camera and the determined distance is in the near zone or the prime camera is the second camera and the trial distance is in the far zone;

determining the distance responsive to the trial distance and a distance provided by a pixel in the secondary camera if the prime camera is the first camera and the determined distance is not in the near zone or the prime camera is the second camera and the trial distance is not in the far zone; and

using the distances determined for the pixels in the prime camera for the distances in the range image.

17. The method according to claim 16 wherein the trial distance lies in the intermediate zone.

18. The method according to claim 17 and determining the distance to the feature as an average of the trial distance and the distance provided by the pixel in the secondary camera.

19. A 3D imaging system that images features in an active space and determines distances to the features, the imaging system comprising:

a light source that illuminates the active space with at least one light pulse;

first and second three dimensional (3D) cameras having optical centers and comprising first and second photosensors respectively having pixels on which the cameras image light reflected from the at least one light pulse to acquire distance images of the features, wherein the first and second 3D cameras have wide-angle and narrow-angle fields of view (FOVs) respectively, which overlap to provide the and divide the active space into zones, in which the overlap region is an intermediate range zone located between a near range zone and a far range zone, and each 3D camera is operable to acquire distance images of the features in the active space independent of the other 3D camera; and

a controller that processes the distance images responsive to the zones to determine distances to the features.

20. The 3D imaging system according to claim 19 wherein the first and second 3D cameras are different types of 3D cameras.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 9, 2014
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 034544/0541 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2012
From: KATZ, SAGI; ADLER, AVISHAI; YAHAV, GIORA; COHEN, DAVID; LARRY, ELI; FELZENSHTEIN, SHLOMO
To: MICROSOFT CORPORATION
Reel/Frame 027579/0564 →
Continuity (1)
Related Publication 20130188022A1 · Jul 25, 2013