IP Library Granted Patent US 9,863,775
Granted Patent B2
US 9,863,775 · App. 15/302,857 · Granted Jan 9, 2018

Vehicle localization system

Inventor: Naoki Kojo (Sunnyvale, CA)
Assignee: NISSAN NORTH AMERICA, INC.
G01C21/32F16H59/44G01C21/165G01C21/26G01S19/47G05D1/0088G05D1/0246G05D1/0268G05D1/0274G05D1/0278G06K9/00791G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,863,775
App. No.
15/302,857
Granted
Jan 9, 2018
Kind
B2
Abstract

A vehicle localization system includes a first localization system, a second localization system, and a controller. The first localization system is configured to determine a location of the vehicle using a first set of data. The second localization system is configured to determine a location of the vehicle using a second set of data. The controller is configured to switch from the first localization system to the second localization system when the first set of data is less than a predetermined amount.

Claims (35)

1. An autonomous vehicle localization system, comprising:

a camera configured to capture visible road features in an image of an area at least partially surrounding the vehicle;

a first localization system configured to determine a location of the vehicle using a first set of data, including stored map data by comparing the visible road features with the stored map data to determine the location of the vehicle;

a second localization system configured to determine a location of the vehicle using a second set of data; and

a controller configured to enable autonomous operation of the vehicle based on the location determined by the first localization system and switch from the first localization system to the second localization system when a numerical amount of the stored map data is less than a predetermined amount, such that first localization system is inadequate.

2. The vehicle localization system according to claim 1 , further comprising

a storage device configured to store the map data.

3. A vehicle localization system, comprising:

a camera configured to capture visible features in an image of an area at least partially surrounding the vehicle;

a first localization system configured to determine a position of the vehicle by comparing edge images extracted from the image from the camera and compare each edge image from the camera to a corresponding virtual edge image in the map data stored in the storage device;

a second localization system configured to determine a location of the vehicle using a second set of data;

a controller configured to switch from the first localization system to the second localization system when a numerical amount of the first set of data is less than a predetermined amount; and

a storage device configured to store the map data.

4. The vehicle localization system according to claim 1 , wherein

the second localization system includes at least one of a global positioning system, odometery and simultaneous localization and mapping.

5. The vehicle localization system according to claim 4 , wherein

the second localization system includes the global positioning system.

6. The vehicle localization system according to claim 5 , further comprising

a storage device configured to store the map data.

7. The vehicle localization system according to claim 1 , wherein

the second localization system includes at least one of wheel sensors and inertial measurement unit sensors.

8. The vehicle localization system according to claim 1 , wherein

the controller is configured to switch from the second localization system to the first localization system when the numerical amount of the stored map data is greater than the predetermined amount.

9. A method of operating an autonomous vehicle localization system, the method comprising:

capturing, with a camera, visible road features in an image of an area at least partially surrounding the vehicle;

determining a location of the vehicle with a first localization system by using a first set of data, including stored map data and comparing the visible road features with the stored map data; and

switching from the first localization system to a second localization system when a numerical amount of a set of stored map data is less than a predetermined amount, such that the first localization system is ineffective, to enable autonomous operation of the vehicle.

10. The method according to claim 9 , further including

switching from the second localization system to the first localization system when the numerical amount of the set of stored map data is greater than the predetermined amount.

11. The vehicle localization system according to claim 3 , wherein

the edge images extracted from the image from the camera are areas of the image in which luminance of a pixel changes.

12. The vehicle localization system according to claim 1 , wherein

the first localization system is configured to determine the location of the vehicle by comparing areas of the image in which luminance of a pixel changes with the stored map data.

13. The method according to claim 9 , wherein

the determining the location of the vehicle with the first localization system includes comparing areas of the image in which luminance of a pixel changes with the stored map data.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 15, 2018
From: NISSAN NORTH AMERICA, INC.
To: NISSAN MOTOR CO., LTD.
Reel/Frame 045808/0572 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 7, 2016
From: KOJO, NAOKI
To: NISSAN NORTH AMERICA, INC.
Reel/Frame 039967/0976 →
Continuity (1)
Related Publication 20170030722A1 · Feb 2, 2017