IP Library Granted Patent US 9,377,533
Granted Patent B2
US 9,377,533 · App. 14/823,668 · Granted Jun 28, 2016

Three-dimensional triangulation and time-of-flight based tracking systems and methods

Inventor: Gerard Dirk Smits (Los Gatos, CA)
G01S17/66G01S7/4815G01S7/4817G01S7/4863G01S17/10G01S17/42G01S17/48G01S7/497
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,377,533
App. No.
14/823,668
Granted
Jun 28, 2016
Kind
B2
Abstract

A three-dimension position tracking system is presented. The system includes transmitters and receivers. A transmitter scans continuous or pulsed coherent light beams across a target. The receiver detects the reflected beams. The system recursively determines the location of the target, as a function of time, via triangulation and observation of the time-of-flight of the incoming and outgoing beams. The transmitter includes ultra-fast scanning optics to scan the receiver's field-of-view. The receiver includes arrays of ultra-fast photosensitive pixels. The system determines the angles of the incoming beams based on the line-of-sight of the triggered pixels. By observing the incoming angles and correlating timestamps associated with the outgoing and incoming beams, the system accurately, and in near real-time, determines the location of the target. By combining the geometry of the scattered beams, as well as the beams' time-of-flight, ambiguities inherent to triangulation and ambiguities inherent to time-of-flight location methods are resolved.

Claims (88)

1. A system for tracking a target, comprising:

one or more transmitters that transmit one or more outgoing light beams at one or more outgoing angles towards the target;

one or more receivers that detect one or more incoming light beams at one or more incoming angles, wherein the one or more incoming light beams correspond to the one or more outgoing light beams that are reflected at the target;

a memory device for storing instructions; and

a processor device that executes the instructions to enable actions, comprising:

transmitting, by the one or more transmitters, the one or more outgoing light beams at the one or more outgoing angles towards the target;

detecting, by the one or more receivers, the one or more incoming light beams at the one or more incoming angles;

determining a proximate location of the target based on one or more of a location or a velocity of the target;

modifying the one or more outgoing angles based on the proximate location of the target; and

determining a precision location of the target based on iteratively determining one or more of a triangulation value for the one or more incoming light beams that correspond to the one or more outgoing light beams transmitting at the one or more modified outgoing angles, a time interval corresponding to a time-of-flight (ToF) of the one or more outgoing light beams transmitting at the one or more modified outgoing angles, or a combination of the triangulation value and the time interval.

2. The system of claim 1 , wherein

the one or more transmitters include one or more transmitting optical components that scan the one or more outgoing light beams across a range of outgoing azimuth angles and a range of outgoing elevation angles of the one or more outgoing angles;

the one or more receivers include one or more receiving optical components that receive the one or more incoming light beams within a range of incoming elevation angles of the one or more incoming angles and focus the one or more incoming light beams to within a range of focused elevation angles that is less than the range of incoming elevation angles; and

a phase difference between the one or more receiving optical components and the one or more transmitting optical components is based on the time interval.

3. The system of claim 1 , wherein transmitting the one or more outgoing light beams includes:

transmitting a first outgoing light beam of the one or more outgoing light beams, wherein wavelengths included in the first outgoing light beam are outside of a visible portion of an electromagnetic (EM) spectrum;

determining one or more first incoming angles based on detecting a first incoming light beam of the one or more incoming light beams, wherein the first incoming light beam corresponds to the first outgoing light beam that is reflected at the target; and

in response to detecting the first incoming light beam, transmitting a second outgoing light beam of the one or more outgoing light beams, wherein the second outgoing light beam is transmitted at one or more second outgoing angles based on the one or more first incoming angles.

4. The system of claim 1 , wherein the one or more transmitters include one or more transmitting optical components that collimate and scan the one or more outgoing light beams in a first direction and fan-out the one or more outgoing light beams in a second direction that is substantially orthogonal to the first direction.

5. The system of claim 1 , wherein the actions further comprise:

determining one or more physical dimensions of the target, relative to one or more physical dimensions of a beam spot of the one or more outgoing light beams at the target, based on at least an intensity-temporal profile of the one or more incoming light beams.

6. The system of claim 1 , wherein the actions further comprise:

determining a first incoming angle of a first incoming light beam of the one or more incoming light beams, wherein the first incoming light beam is detected at a first detection location;

determining a second incoming angle of a second incoming light beam of the one or more incoming light beams, wherein the second incoming light beam is detected at a second detection location and both the first and the second incoming light beams correspond to a first outgoing light beam of the one or more outgoing light beams that is reflected at the target; and

determining the triangulation value based on the first incoming angle, the second incoming angle, and a distance between the first detection location and the second detection location.

7. The system of claim 1 , wherein the actions further comprise:

transmitting a first outgoing light beam of the one or more outgoing light beams, wherein the first outgoing light beam is transmitted at a first location;

determining a first incoming angle based on a first incoming light beam of the one or more incoming light beams, wherein the first incoming light beam is detected at a second location and corresponds to the first outgoing light beam that is reflected at the target;

transmitting a second outgoing light beam of the one or more outgoing light beams, wherein the second outgoing light beam is transmitted at the first incoming angle and the second location;

determining a second incoming angle of a second incoming light beam of the one or more incoming light beams, wherein the second incoming light beam is detected at the first location and corresponds to the second outgoing light beam that is reflected at the target; and

determining the triangulation value based on the first incoming angle, the second incoming angle, and a distance between the first and the second locations.

8. The system of claim 1 , wherein the one or more outgoing light beams are scanned in a Lissajous scanning pattern based on at least one of a proximate distance or a proximate physical dimension of the target.

9. A method for tracking a target, comprising:

transmitting, by one or more transmitters, one or more outgoing light beams at one or more outgoing angles towards the target;

detecting, by one or more receivers, one or more incoming light beams at one or more incoming angles;

determining a proximate location of the target based on one or more of a location or a velocity of the target;

modifying the one or more outgoing angles based on the proximate location of the target; and

determining a precision location of the target based on iteratively determining one or more of another triangulation value for the one or more incoming light beams that correspond to the one or more outgoing light beams transmitting at the one or more modified outgoing angles, a time interval corresponding to a time-of-flight (ToF) of the one or more outgoing light beams transmitting at the one or more modified outgoing angles, or a combination of the other triangulation value and the time interval.

10. The method of claim 9 , wherein

the one or more transmitters include one or more transmitting optical components that scan the one or more outgoing light beams across a range of outgoing azimuth angles and a range of outgoing elevation angles of the one or more outgoing angles;

the one or more receivers include one or more receiving optical components that receive the one or more incoming light beams within a range of incoming elevation angles of the one or more incoming angles and focus the one or more incoming light beams to within a range of focused elevation angles that is less than the range of incoming elevation angles; and

a phase difference between the one or more receiving optical components and the one or more transmitting optical components is based on the time interval.

11. The method of claim 9 , wherein transmitting the one or more outgoing light beams includes:

transmitting a first outgoing light beam of the one or more outgoing light beams, wherein wavelengths included in the first outgoing light beam are outside of a visible portion of an electromagnetic (EM) spectrum;

determining one or more first incoming angles based on detecting a first incoming light beam of the one or more incoming light beams, wherein the first incoming light beam corresponds to the first outgoing light beam that is reflected at the target; and

in response to detecting the first incoming light beam, transmitting a second outgoing light beam of the one or more outgoing light beams, wherein the second outgoing light beam is transmitted at one or more second outgoing angles based on the one or more first incoming angles.

12. The method of claim 9 , wherein the one or more transmitters include one or more transmitting optical components that collimate and scan the one or more outgoing light beams in a first direction and fan-out the one or more outgoing light beams in a second direction that is substantially orthogonal to the first direction.

13. The method of claim 9 , further comprising:

determining one or more physical dimensions of the target, relative to one or more physical dimensions of a beam spot of the one or more outgoing light beams at the target, based on at least an intensity-temporal profile of the one or more incoming light beams.

14. The method of claim 9 , further comprising:

determining a first incoming angle of a first incoming light beam of the one or more incoming light beams, wherein the first incoming light beam is detected at a first detection location;

determining a second incoming angle of a second incoming light beam of the one or more incoming light beams, wherein the second incoming light beam is detected at a second detection location and both the first and the second incoming light beams correspond to a first outgoing light beam of the one or more outgoing light beams that is reflected at the target; and

determining the triangulation value based on the first incoming angle, the second incoming angle, and a distance between the first detection location and the second detection location.

15. The method of claim 9 , further comprising:

transmitting a first outgoing light beam of the one or more outgoing light beams, wherein the first outgoing light beam is transmitted at a first location;

determining a first incoming angle based on a first incoming light beam of the one or more incoming light beams, wherein the first incoming light beam is detected at a second location and corresponds to the first outgoing light beam that is reflected at the target;

transmitting a second outgoing light beam of the one or more outgoing light beams, wherein the second outgoing light beam is transmitted at the first incoming angle and the second location;

determining a second incoming angle of a second incoming light beam of the one or more incoming light beams, wherein the second incoming light beam is detected at the first location and corresponds to the second outgoing light beam that is reflected at the target; and

determining the triangulation value based on the first incoming angle, the second incoming angle, and a distance between the first and the second locations.

16. The method of claim 9 , wherein the one or more outgoing light beams are scanned in a Lissajous scanning pattern based on at least one of a proximate distance or a proximate physical dimension of the target.

17. A computer readable non-transitory storage medium that includes instructions for tracking a target, wherein the execution of the instructions by a processor enables actions, comprising:

transmitting, by one or more transmitters, the one or more outgoing light beams at the one or more outgoing angles towards the target;

detecting, by one or more receivers, the one or more incoming light beams at the one or more incoming angles;

determining a proximate location of the target based on one or more of a location or a velocity of the target;

modifying the one or more outgoing angles based on the proximate location of the target; and

determining a precision location of the target based on iteratively determining one or more of another triangulation value for the one or more incoming light beams that correspond to the one or more outgoing light beams transmitting at the one or more modified outgoing angles, a time interval corresponding to a time-of-flight (ToF) of the one or more outgoing light beams transmitting at the one or more modified outgoing angles, or a combination of the other triangulation value and the time interval.

18. The medium of claim 17 , wherein

the one or more transmitters include one or more transmitting optical components that scan the one or more outgoing light beams across a range of outgoing azimuth angles and a range of outgoing elevation angles of the one or more outgoing angles;

the one or more receivers include one or more receiving optical components that receive the one or more incoming light beams within a range of incoming elevation angles of the one or more incoming angles and focus the one or more incoming light beams to within a range of focused elevation angles that is less than the range of incoming elevation angles; and

a phase difference between the one or more receiving optical components and the one or more transmitting optical components is based on the time interval.

19. The medium of claim 17 , wherein transmitting the one or more outgoing light beams includes:

transmitting a first outgoing light beam of the one or more outgoing light beams, wherein wavelengths included in the first outgoing light beam are outside of a visible portion of an electromagnetic (EM) spectrum;

determining one or more first incoming angles based on detecting a first incoming light beam of the one or more incoming light beams, wherein the first incoming light beam corresponds to the first outgoing light beam that is reflected at the target; and

in response to detecting the first incoming light beam, transmitting a second outgoing light beam of the one or more outgoing light beams, wherein the second outgoing light beam is transmitted at one or more second outgoing angles based on the one or more first incoming angles.

20. The medium of claim 17 , wherein the one or more transmitters include one or more transmitting optical components that collimate and scan the one or more outgoing light beams in a first direction and fan-out the one or more outgoing light beams in a second direction that is substantially orthogonal to the first direction.

21. The medium of claim 17 , the actions further comprising:

determining one or more physical dimensions of the target, relative to one or more physical dimensions of a beam spot of the one or more outgoing light beams at the target, based on at least an intensity-temporal profile of the one or more incoming light beams.

22. The medium of claim 17 , the actions further comprising:

determining a first incoming angle of a first incoming light beam of the one or more incoming light beams, wherein the first incoming light beam is detected at a first detection location;

determining a second incoming angle of a second incoming light beam of the one or more incoming light beams, wherein the second incoming light beam is detected at a second detection location and both the first and the second incoming light beams correspond to a first outgoing light beam of the one or more outgoing light beams that is reflected at the target; and

determining the triangulation value based on the first incoming angle, the second incoming angle, and a distance between the first detection location and the second detection location.

23. The medium of claim 17 , the actions further comprising:

transmitting a first outgoing light beam of the one or more outgoing light beams, wherein the first outgoing light beam is transmitted at a first location;

determining a first incoming angle based on a first incoming light beam of the one or more incoming light beams, wherein the first incoming light beam is detected at a second location and corresponds to the first outgoing light beam that is reflected at the target;

transmitting a second outgoing light beam of the one or more outgoing light beams, wherein the second outgoing light beam is transmitted at the first incoming angle and the second location;

determining a second incoming angle of a second incoming light beam of the one or more incoming light beams, wherein the second incoming light beam is detected at the first location and corresponds to the second outgoing light beam that is reflected at the target; and

determining the triangulation value based on the first incoming angle, the second incoming angle, and a distance between the first and the second locations.

24. The medium of claim 17 , wherein the one or more outgoing light beams are scanned in a Lissajous scanning pattern based on at least one of a proximate distance or a proximate physical dimension of the target.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 9, 2023
From: SAMSUNG ELECTRONICS CO., LTD.
To: SMITS, GERARD DIRK
Reel/Frame 063587/0144 →
CORRECTION BY DECLARATION OF ERRONEOUSLY FILED PATENT ASSIGNMENT ON REEL 051757 FRAME 0900 Recorded Sep 9, 2020
From: SMITS, GERARD DIRK
To: SMITS, GERARD DIRK
Reel/Frame 054067/0970 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2020
From: SMITS, GERARD DIRK
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 051757/0900 →
Continuity (2)
Provisional Application 62070011 · Aug 11, 2014
Related Publication 20160041266A1 · Feb 11, 2016