IP Library Patent Application 15955524
Patent Application
App. No. 15/955,524

SYSTEM AND METHOD FOR VEHICULAR LOCALIZATION RELATING TO AUTONOMOUS NAVIGATION

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
15/955,524
Abstract

A system for use in a vehicle, the system comprising one or more sensors; one or more processors coupled to the one or more sensors; and a memory including instructions, which when executed by the one or more processors, cause the one or more processors to perform a method. The method comprising determining an estimated location of the vehicle, obtaining map information based on the estimated location of the vehicle, obtaining sensor information relating the vehicle's proximate surroundings from the one or more sensors, detecting a first landmark and a second landmark in physical proximity to the vehicle based on the sensor information, and localizing the vehicle location based on the map information and the first and second landmarks.

Claims (54)

1 . A system for use in a vehicle, the system comprising:

one or more sensors;

one or more processors coupled to the one or more sensors; and

a memory including instructions, which when executed by the one or more processors, cause the one or more processors to perform a method comprising the steps of:

determining an estimated location of the vehicle;

obtaining map information based on the estimated location of the vehicle;

obtaining sensor information relating the vehicle's proximate surroundings from the one or more sensors;

detecting a first landmark and a second landmark in physical proximity to the vehicle based on the sensor information; and

localizing the vehicle location based on the map information and the first and second landmarks.

2 . The system of claim 1 , wherein the map information includes information about a plurality of landmarks.

3 . The system of claim 2 , wherein localizing the vehicle based on the map information and the first and second landmarks comprises the steps of:

matching the first landmark to a third landmark of the plurality of landmarks and the second landmark to a fourth landmark of the plurality of landmarks; and

determining a location and heading of the vehicle based on the vehicle's distance and orientation to the first and second landmarks.

4 . The system of claim 3 , wherein the first and second landmarks comprise street light-poles.

5 . The system of claim 3 , wherein the estimated location of the vehicle comprises an error bounds defining an area in which the vehicle is likely located.

6 . The system of claim 5 , wherein obtaining the map information based on the estimated location of the vehicle comprises retrieving map containing the area defined by the error bounds.

7 . The system of claim 6 , wherein the map information is retrieved from the memory.

8 . The system of claim 6 , wherein the map information is retrieved from a remote server.

9 . The system of claim 3 , wherein matching the first landmark to the third landmark and the second landmark to the fourth landmark further comprises the steps of:

comparing the first and second landmarks to the plurality of landmarks; and

identifying the first landmark as the third landmark and second landmark as the fourth landmark by landmark types and dimensions.

10 . The system of claim 3 , wherein matching the first landmark to the third landmark and the second landmark to the fourth landmark comprises:

calculating a first distance between the first and second landmarks;

comparing the first and second landmarks to the plurality of landmarks; and

identifying the first landmark as the third landmark and second landmark as the fourth landmark in accordance with a determination that the first distance matches a second distance between the third landmark and the fourth landmark.

11 . The system of claim 3 , wherein determining the location and heading of the vehicle based on the vehicle's distance and orientation to the first and second landmarks comprises the steps of:

determining a first distance from the vehicle to the first landmark;

determining a first angle from the vehicle to the first landmark relative to an estimated heading of the vehicle;

determining a second distance from the vehicle to the second landmark;

determining a second angle from the vehicle to the second landmark relative to the estimated heading of the vehicle; and

determining the location and heading of the vehicle based on the first distance, the first angle, the second distance, and the second angle.

12 . The system of claim 5 , wherein the first landmark is located within the error bounds and the second landmark is located outside of the error bounds.

13 . The system of claim 1 , wherein the map information comprises a map of a parking lot.

14 . The system of claim 1 , wherein obtaining the map information comprises a step of requesting a map containing the estimated location of the vehicle from a server.

15 . The system of claim 1 , wherein detecting the first landmark and the second landmark near the vehicle based on the sensor information comprises the steps of:

detecting at least one characteristic about the vehicle's surroundings with the one or more sensors;

classifying a first object of the one or more characteristics by landmark type;

classifying a second object of the one or more characteristics by landmark type; and

identifying the first object as the first landmark and the second object as the second landmark.

16 . The system of claim 15 , wherein the landmark types include signal-poles, telephone poles, power-line poles, traffic signs, street signs, traffic signals, trees, lane dividers, road markings, pillars, file hydrants, buildings, walls, and fences.

17 . The system of claim 1 , wherein the step of localizing the vehicle location includes determining a location and heading of the vehicle within a vehicle coordinate system.

18 . The system of claim 1 , wherein the first landmark is a first landmark type and the second landmark is a second landmark type.

19 . A non-transitory computer-readable medium including instructions, which when executed by one or more processors, cause the one or more processors to perform a method comprising:

determining an estimated location of a vehicle;

obtaining map information based on the estimated location of the vehicle;

obtaining sensor information about the vehicle's surroundings from one or more sensors;

detecting a first landmark and a second landmark near the vehicle based on the sensor information; and

localizing the vehicle based on the map information and the first and second landmarks.

20 . A method comprising:

determining an estimated location of a vehicle;

obtaining map information based on the estimated location of the vehicle;

obtaining sensor information about the vehicle's surroundings from one or more sensors;

detecting a first landmark and a second landmark near the vehicle based on the sensor information; and

localizing the vehicle based on the map information and the first and second landmarks.

Assignments (7)
SECURITY INTEREST Recorded Sep 25, 2024
From: FARADAY&FUTURE, INC.
To: SENYUN INTERNATIONAL LTD.
Reel/Frame 068698/0327 →
SECURITY INTEREST Recorded Aug 15, 2022
From: FARADAY&FUTURE INC.
To: FF SIMPLICY VENTURES LLC
Reel/Frame 061176/0756 →
RELEASE OF SECURITY INTEREST RECORDED AT REEL/FRAME 050234/0069 Recorded Jun 8, 2022
From: ARES CAPITAL CORPORATION, AS SUCCESSOR COLLATERAL AGENT
To: CITY OF SKY LIMITED; EAGLE PROP HOLDCO LLC; FARADAY & FUTURE INC.; FARADAY FUTURE LLC; FF EQUIPMENT LLC; FF HONG KONG HOLDING LIMITED; FF INC.; FF MANUFACTURING LLC; ROBIN PROP HOLDCO LLC; SMART KING LTD.; SMART TECHNOLOGY HOLDINGS LTD.; FARADAY SPE, LLC
Reel/Frame 060314/0263 →
ACKNOWLEDGEMENT OF SUCCESSOR COLLATERAL AGENT UNDER INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jul 29, 2021
From: BIRCH LAKE FUND MANAGEMENT, LP, AS RETIRING AGENT
To: ARES CAPITAL CORPORATION, AS SUCCESSOR AGENT
Reel/Frame 057019/0140 →
SECURITY INTEREST Recorded Oct 14, 2020
From: ROYOD LLC
To: BIRCH LAKE FUND MANAGEMENT, LP
Reel/Frame 054076/0157 →
ACKNOWLEDGEMENT OF SUCCESSOR COLLATERAL AGENT UNDER INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 5, 2020
From: BIRCH LAKE FUND MANAGEMENT, LP, AS RETIRING AGENT
To: ROYOD LLC, AS SUCCESSOR AGENT
Reel/Frame 052102/0452 →
SECURITY INTEREST Recorded May 1, 2019
From: CITY OF SKY LIMITED; EAGLE PROP HOLDCO LLC; FARADAY FUTURE LLC; FE EQUIPMENT LLC; FF HONG KONG HOLDING LIMITED; FF INC.; FF MANUFACTURING LLC; ROBIN PROP HOLDCO LLC; SMART KING LTD.; SMART TECHNOLOGY HOLDINGS LTD.; FARADAY SPE, LLC; FARADAY & FUTURE INC.
To: BIRCH LAKE FUND MANAGEMENT, LP
Reel/Frame 050234/0069 →