IP Library Granted Patent US 10,416,682
Granted Patent B2
US 10,416,682 · App. 15/662,655 · Granted Sep 17, 2019

Semi-automated driving using pre-recorded route

Inventor: Chongyu Wang (San Jose, CA)
Assignee: FARADAY & FUTURE INC.
G05D1/0274B60W50/02G05D1/0214G05D1/0246G06K9/00791B60W2050/007
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,416,682
App. No.
15/662,655
Granted
Sep 17, 2019
Kind
B2
Abstract

A system for use in a vehicle, the system comprising one or more sensors, one or more processors coupled to the one or more sensors, and a memory including instructions that cause the one or more processors to perform a method. The method comprises retrieving a stored route for the vehicle that comprises a plurality of waypoints corresponding to different locations along the route, each waypoint associated with features along the route on a feature map, and navigating the vehicle along the stored route by navigating the vehicle from waypoint to waypoint in the stored route using the one or more sensors to: detect one or more features in an area surrounding the vehicle; and localize the vehicle at each waypoint by comparing the one or more features in the area surrounding the vehicle with the one or more features associated with each respective waypoint in the feature map.

Claims (53)

1. A system for use in a vehicle, the system comprising:

one or more sensors;

one or more processors coupled to the one or more sensors; and

a memory including instructions, which when executed by the one or more processors, cause the one or more processors to perform a method comprising:

initially requiring the vehicle to drive a route multiple times in multiple lighting conditions;

subsequently retrieving the route as a stored route for the vehicle, the stored route comprising a plurality of waypoints corresponding to different locations along the route, each waypoint associated with one or more features along the route on a feature map; and

subsequently navigating the vehicle along the stored route by navigating the vehicle from waypoint to waypoint in the stored route using the one or more sensors to:

detect one or more features in an area surrounding the vehicle; and

localize the vehicle at each waypoint by comparing the one or more features in the area surrounding the vehicle with the one or more features associated with each respective waypoint in the feature map.

2. The system of claim 1 , wherein the one or more features in the feature map comprise one or more of a traffic light, a yield sign, a school zone, a building, road markings and a tree.

3. The system of claim 1 , wherein the one or more features in the area surrounding the vehicle comprise one or more of a traffic light, a yield sign, a school zone, a building, road markings and a tree.

4. The system of claim 1 , wherein the one or more sensors comprise one or more cameras.

5. The system of claim 1 , wherein localizing the vehicle at each waypoint is further performed by using a GPS signal.

6. The system of claim 1 , wherein the method further comprises:

prior to retrieving the stored route for the vehicle, creating the stored route for the vehicle by recording one or more locations of the vehicle as the vehicle drives the stored route, and recording one or more features of the area surrounding the vehicle, using the one or more sensors, associated with each of the one or more locations of the vehicle as the vehicle drives the stored route.

7. The system of claim 1 , wherein the one or more features detected in the area surrounding the vehicle at a respective waypoint differ from the one or more features associated with the respective waypoint in the feature map.

8. The system of claim 1 , wherein the method further comprises:

while navigating the vehicle along the stored route:

determining whether the one or more features in the area surrounding the vehicle are indicative of a cautionary scenario;

in response to determining whether the one or more features in the area surrounding the vehicle are indicative of the cautionary scenario:

in accordance with a determination that the one or more features in the area surrounding the vehicle are indicative of the cautionary scenario, performing a precautionary action; and

in accordance with a determination that the one or more features in the area surrounding the vehicle are not indicative of the cautionary scenario, foregoing performing the precautionary action.

9. The system of claim 8 , wherein:

the one or more features in the area surrounding the vehicle comprise a traffic light; and

the traffic light is indicative of the cautionary scenario.

10. The system of claim 8 , wherein:

the one or more features in the area surrounding the vehicle comprise a yield sign; and

the yield sign is indicative of the cautionary scenario.

11. The system of claim 8 , wherein:

the one or more features in the area surrounding the vehicle comprise a school zone; and

the school zone is indicative of the cautionary scenario.

12. The system of claim 8 , wherein:

the one or more features in the area surrounding the vehicle comprise a vulnerable road user on the stored route; and

the vulnerable road user on the stored route is indicative of the cautionary scenario.

13. The system of claim 12 , wherein the vulnerable road user on the stored route comprises one or more of a pedestrian, a motorcycle, and a bicycle.

14. The system of claim 8 , wherein the precautionary action comprises transitioning the vehicle from a first mode of operation to a second mode of operation.

15. The system of claim 14 , wherein the first mode of operation comprises an autonomous mode of operation, and the second mode of operation comprises a manual mode of operation.

16. The system of claim 1 , wherein:

while navigating the vehicle along the stored route:

determining that one or more of the sensors are malfunctioning; and

in response to determining that the one or more sensors are malfunctioning, performing a precautionary action.

17. A non-transitory computer-readable medium including instructions, which when executed by one or more processors, cause the one or more processors to perform a method comprising:

initially requiring a vehicle to drive a route multiple times in multiple lighting conditions;

subsequently retrieving the route as a stored route for the vehicle, the stored route comprising a plurality of waypoints corresponding to different locations along the route, each waypoint associated with one or more features along the route on a feature map; and

subsequently navigating the vehicle along the stored route by navigating the vehicle from waypoint to waypoint in the stored route using one or more sensors on the vehicle to:

detect one or more features in an area surrounding the vehicle; and

localize the vehicle at each waypoint by comparing the one or more features in the area surrounding the vehicle with the one or more features associated with each respective waypoint in the feature map.

18. A method comprising:

initially requiring a vehicle to drive a route multiple times in multiple lighting conditions;

subsequently retrieving the route as a stored route for the vehicle, the stored route comprising a plurality of waypoints corresponding to different locations along the route, each waypoint associated with one or more features along the route on a feature map; and

subsequently navigating the vehicle along the stored route by navigating the vehicle from waypoint to waypoint in the stored route using one or more sensors on the vehicle to:

detect one or more features in an area surrounding the vehicle; and

localize the vehicle at each waypoint by comparing the one or more features in the area surrounding the vehicle with the one or more features associated with each respective waypoint in the feature map.

Assignments (9)
SECURITY INTEREST Recorded Sep 25, 2024
From: FARADAY&FUTURE, INC.
To: SENYUN INTERNATIONAL LTD.
Reel/Frame 069048/0676 →
SECURITY INTEREST Recorded Aug 15, 2022
From: FARADAY&FUTURE INC.
To: FF SIMPLICY VENTURES LLC
Reel/Frame 061176/0756 →
RELEASE OF SECURITY INTEREST RECORDED AT REEL/FRAME 050234/0069 Recorded Jun 8, 2022
From: ARES CAPITAL CORPORATION, AS SUCCESSOR COLLATERAL AGENT
To: CITY OF SKY LIMITED; EAGLE PROP HOLDCO LLC; FARADAY & FUTURE INC.; FARADAY FUTURE LLC; FF EQUIPMENT LLC; FF HONG KONG HOLDING LIMITED; FF INC.; FF MANUFACTURING LLC; ROBIN PROP HOLDCO LLC; SMART KING LTD.; SMART TECHNOLOGY HOLDINGS LTD.; FARADAY SPE, LLC
Reel/Frame 060314/0263 →
ACKNOWLEDGEMENT OF SUCCESSOR COLLATERAL AGENT UNDER INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jul 29, 2021
From: BIRCH LAKE FUND MANAGEMENT, LP, AS RETIRING AGENT
To: ARES CAPITAL CORPORATION, AS SUCCESSOR AGENT
Reel/Frame 057019/0140 →
SECURITY INTEREST Recorded Oct 14, 2020
From: ROYOD LLC
To: BIRCH LAKE FUND MANAGEMENT, LP
Reel/Frame 054076/0157 →
ACKNOWLEDGEMENT OF SUCCESSOR COLLATERAL AGENT UNDER INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 5, 2020
From: BIRCH LAKE FUND MANAGEMENT, LP, AS RETIRING AGENT
To: ROYOD LLC, AS SUCCESSOR AGENT
Reel/Frame 052102/0452 →
SECURITY INTEREST Recorded May 1, 2019
From: CITY OF SKY LIMITED; EAGLE PROP HOLDCO LLC; FARADAY FUTURE LLC; FE EQUIPMENT LLC; FF HONG KONG HOLDING LIMITED; FF INC.; FF MANUFACTURING LLC; ROBIN PROP HOLDCO LLC; SMART KING LTD.; SMART TECHNOLOGY HOLDINGS LTD.; FARADAY SPE, LLC; FARADAY & FUTURE INC.
To: BIRCH LAKE FUND MANAGEMENT, LP
Reel/Frame 050234/0069 →
RELEASE OF SECURITY INTEREST Recorded Jan 14, 2019
From: SEASON SMART LIMITED
To: FARADAY&FUTURE INC.
Reel/Frame 048069/0704 →
SECURITY INTEREST Recorded Dec 28, 2017
From: FARADAY&FUTURE INC.
To: SEASON SMART LIMITED
Reel/Frame 044969/0023 →
Continuity (2)
Provisional Application 62368987 · Jul 29, 2016
Related Publication 20180196442A1 · Jul 12, 2018