IP Library Granted Patent US 10,591,605
Granted Patent B2
US 10,591,605 · App. 16/165,631 · Granted Mar 17, 2020

Methods and systems for navigating a vehicle including a novel fiducial marker system

Inventor: Gerard Dirk Smits (Los Gatos, CA)
G01S17/936G01C21/3461G01C21/3626G01S17/026G05D1/0236B60G17/00B60G17/019B60G17/0165B60G2400/60B60G2400/821B60G2400/84B60G2400/841B60G2400/842B60G2400/843B60G2401/142B60G2401/16B60G2401/174B60G2500/30G05D1/0231G05D1/101G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,591,605
App. No.
16/165,631
Granted
Mar 17, 2020
Kind
B2
Abstract

Methods and systems for navigating a vehicle along a surface employ a scanner to scan a light beam over the surface; employ light reflected by one or more fiducial markers on the surface onto pixels of a receiver to determine a spatial arrangement of the fiducial markers on the surface; and compare the spatial arrangement of the fiducial markers with a predetermined map of the fiducial markers to determine a location of the vehicle.

Claims (46)

1. A method for navigating a vehicle along a surface, the method comprising:

employing a scanner to scan a strobed light beam over the surface, wherein the strobed light beam provides strobed illumination of a plurality of lines across the surface to reduce motion blur, and wherein a stripe is formed by at least a portion of the plurality of lines having a width and a length across a field of view on a portion of the surface that is directly ahead of the vehicle;

employing light reflected by one or more fiducial markers on the surface onto pixels of a receiver to determine a spatial arrangement of the fiducial markers on the surface;

comparing the spatial arrangement of the fiducial markers with a predetermined map of the fiducial markers to determine a location of the vehicle; and

detecting a reflection of the stripe from the portion of the surface with the receiver, wherein the stripe's reflection is employed to determine three-dimensional spatial information and visual contrast information that is added in real time to the predetermined map for the portion of the surface that is directly ahead of the vehicle.

2. The method of claim 1 , wherein employing the scanner comprises employing the scanner to sequentially scan the light beam along a line or region of the surface.

3. The method of claim 1 , wherein the scanner is configured to simultaneously illuminate a line across the surface with the light beam, wherein employing the scanner comprises employing the scanner to sequentially scan a series of lines on the surface.

4. The method of claim 1 , wherein each of the fiducial markers has one of a plurality of different colors, wherein employing light reflected by one or more fiducial markers comprises determining a color of each of the one or more fiducial markers using the reflected light.

5. The method of claim 1 , further comprising employing light reflected from an additional object on the surface onto pixels of the receiver to determine a position of, or to identify, the additional object.

6. The method of claim 5 , further comprising determining a path to avoid the additional object.

7. The method of claim 1 , further comprising employing light reflected from the surface onto pixels of the receiver to determine condition of the surface.

8. The method of claim 7 , further comprising adjusting operation of the vehicle in view of the determined condition of the surface.

9. The method of claim 7 , further comprising adjusting a suspension system in view of the determined condition of the surface.

10. The method of claim 1 , wherein employing light comprises sequentially observing subsets of the pixels of the receiver in coordination with the scanning of the light beam.

11. A system to navigate a vehicle along a surface, comprising:

a scanner configured to scan light over a field of view;

a receiver that comprises a plurality of pixels configured to detect light;

one or more memory devices that store instructions; and

one or more processor devices that execute the stored instructions to perform actions, including:

employing a scanner to scan a strobed light beam over the surface, wherein the strobed light beam provides strobed illumination of a plurality of lines across the surface to reduce motion blur, and wherein a stripe is formed by at least a portion of the plurality of lines having a width and a length across a field of view on a portion of the surface that is directly ahead of the vehicle;

employing light reflected by one or more fiducial markers on the surface onto pixels of a receiver to determine a spatial arrangement of the fiducial markers on the surface;

comparing the spatial arrangement of the fiducial markers with a predetermined map of the fiducial markers to determine a location of the vehicle; and

detecting a reflection of the stripe from the portion of the surface with the receiver, wherein the stripe's reflection is employed to determine three-dimensional spatial information and visual contrast information that is added in real time to the predetermined map for the portion of the surface that is directly ahead of the vehicle.

12. The system of claim 11 , wherein employing the scanner comprises employing the scanner to sequentially scan the light beam along a line or region of the surface.

13. The system of claim 11 , wherein the scanner is configured to simultaneously illuminate a line across the surface with the light beam, wherein employing the scanner comprises employing the scanner to sequentially scan a series of lines on the surface.

14. The system of claim 11 , wherein each of the fiducial markers has one of a plurality of different colors, wherein employing light reflected by one or more fiducial markers comprises determining a color of each of the one or more fiducial markers using the reflected light.

15. The system of claim 11 , wherein the actions further comprise employing light reflected from an additional object on the surface onto pixels of the receiver to determine a position of, or to identify, the additional object.

16. The system of claim 15 , wherein the actions further comprise determining a path to avoid the additional object.

17. The system of claim 11 , wherein the actions further comprise employing light reflected from the surface onto pixels of the receiver to determine condition of the surface.

18. The system of claim 17 , wherein the actions further comprise adjusting operation of the vehicle in view of the determined condition of the surface.

19. The system of claim 17 , wherein the actions further comprise adjusting a suspension system in view of the determined condition of the surface.

20. The system of claim 11 , wherein employing light comprises sequentially observing subsets of the pixels of the receiver in coordination with the scanning of the light beam.

21. A non-transitory processor readable storage media that includes instructions for navigating a vehicle along a surface, wherein execution of the instructions by one or more processor devices cause the one or more processor devices to perform actions, comprising:

employing a scanner to scan a strobed light beam over the surface, wherein the strobed light beam provides strobed illumination of a plurality of lines across the surface to reduce motion blur, and wherein a stripe is formed by at least a portion of the plurality of lines having a width and a length across a field of view on a portion of the surface that is directly ahead of the vehicle;

employing light reflected by one or more fiducial markers on the surface onto pixels of a receiver to determine a spatial arrangement of the fiducial markers on the surface;

comparing the spatial arrangement of the fiducial markers with a predetermined map of the fiducial markers to determine a location of the vehicle; and

detecting a reflection of the stripe from the portion of the surface with the receiver, wherein the stripe's reflection is employed to determine three-dimensional spatial information and visual contrast information that is added in real time to the predetermined map for the portion of the surface that is directly ahead of the vehicle.

22. The non-transitory processor readable storage media of claim 21 , wherein employing the scanner comprises employing the scanner to sequentially scan the light beam along a line or region of the surface.

23. The non-transitory processor readable storage media of claim 21 , wherein the scanner is configured to simultaneously illuminate a line across the surface with the light beam, wherein employing the scanner comprises employing the scanner to sequentially scan a series of lines on the surface.

24. The non-transitory processor readable storage media of claim 21 , wherein each of the fiducial markers has one of a plurality of different colors, wherein employing light reflected by one or more fiducial markers comprises determining a color of each of the one or more fiducial markers using the reflected light.

25. The non-transitory processor readable storage media of claim 21 , wherein the actions further comprise employing light reflected from an additional object on the surface onto pixels of the receiver to determine a position of, or to identify, the additional object.

26. The non-transitory processor readable storage media of claim 25 , wherein the actions further comprise determining a path to avoid the additional object.

27. The non-transitory processor readable storage media of claim 21 , wherein the actions further comprise employing light reflected from the surface onto pixels of the receiver to determine condition of the surface.

28. The non-transitory processor readable storage media of claim 27 , wherein the actions further comprise adjusting operation of the vehicle in view of the determined condition of the surface.

29. The non-transitory processor readable storage media of claim 27 , wherein the actions further comprise adjusting a suspension system in view of the determined condition of the surface.

30. The non-transitory processor readable storage media of claim 21 , wherein employing light comprises sequentially observing subsets of the pixels of the receiver in coordination with the scanning of the light beam.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2023
From: SMITS, GERARD
To: SAMSUNG SEMICONDUCTOR, INC.
Reel/Frame 063571/0817 →
CORRECTION BY DECLARATION OF ERRONEOUSLY FILED PATENT ASSIGNMENT ON REEL 051757 FRAME 0900 Recorded Sep 9, 2020
From: SMITS, GERARD DIRK
To: SMITS, GERARD DIRK
Reel/Frame 054067/0970 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2020
From: SMITS, GERARD DIRK
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 051757/0900 →
Continuity (2)
Provisional Application 62707194 · Oct 19, 2017
Related Publication 20190120967A1 · Apr 25, 2019
Cited By (12)
US 12,244,974 US 12,256,060 US 12,293,548 US 12,322,139 US 12,418,623 US 12,450,777 US 12,477,205 US 12,483,670 US 12,491,907 US 12,618,672 US 12,641,204 US 12,675,035