IP Library Granted Patent US 10,203,408
Granted Patent B2
US 10,203,408 · App. 15/662,650 · Granted Feb 12, 2019

Method and apparatus for detection and ranging fault detection and recovery

Inventor: Xinghui Sun (San Jose, CA)
Assignee: FARADAY & FUTURE INC.
G01S13/867B60K31/0008G01S7/40G01S13/931G01S15/025G01S15/931G01S17/023G06K9/00805G01S17/936G01S2013/936G01S2013/9364G01S2013/9367
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,203,408
App. No.
15/662,650
Granted
Feb 12, 2019
Kind
B2
Abstract

A system for vehicular detection and ranging fault detection, notification, and recovery is provided. The system may include at least one detection and ranging device, at least one camera, and at least one physical processing unit configured with program instructions. The processing unit may be configured to analyze detection and ranging data of an object from the detection and ranging device, analyze image data received of the object from the at least one camera and, based on a comparison, detect a detection and ranging fault.

Claims (40)

1. A system for a vehicle, the system comprising:

a vehicle detection and ranging device;

a vehicle camera; and

one or more physical processors programmed by computer program instructions that, when executed, cause the one or more physical processors to:

receive detection and ranging data of an object from the vehicle detection and ranging device;

receive image data of the object from the vehicle camera;

analyze the detection and ranging data received from the vehicle detection and ranging device;

analyze the image data received from the vehicle camera; and

determine a detection and ranging device fault based on a comparison between the analyzed image data and the analyzed detection and ranging data.

2. The system of claim 1 , further comprising a notification unit configured to receive the detection and ranging fault notification signal and alert a user of the detection and ranging fault.

3. The system of claim 1 , wherein to analyze the detection and ranging data, the one or more physical processors are further caused to determine a detection-and-ranging-computed distance between the vehicle and the object; and

wherein to analyze the image data, the one or more physical processors are further caused to determine an image-computed distance between the vehicle and the object.

4. The system of claim 3 , wherein to determine a detection and ranging device fault based on a comparison between analyzing results of the image data and the detection and ranging data, the one or more physical processors are further caused to compare the image-computed distance and the detection-and-ranging-computed distance.

5. The system of claim 3 , wherein to determine a detection and ranging device fault based on a comparison between analyzing results of the image data and the detection and ranging data, the one or more physical processors are further configured to compare a known size of the object with a detection-and-ranging-captured size of the object.

6. The system of claim 5 , wherein the one or more physical processors are further caused to query a size database to determine the known size of the object.

7. The system of claim 6 , wherein the one or more physical processors are further configured to query the size database to determine the known size of at least one of: a vehicle length, a vehicle width, a vehicle height, or a license plate.

8. The system of claim 1 , wherein the vehicle detection and ranging device comprises a Lidar device.

9. The system of claim 1 , wherein the vehicle detection and ranging device comprises a Radar device.

10. The system of claim 1 , wherein the one or more physical processors are further configured to augment detection and ranging data received from the fault detection and ranging device with image data from the vehicle camera.

11. A computer implemented method for a vehicle, the method being implemented on a computer system having one or more physical processors programmed with computer program instructions to perform the method, the method comprising:

receiving, via the computer system, detection and ranging data of an object from a vehicle detection and ranging device;

receiving, via the computer system, image data of the object from a vehicle camera;

analyzing, via the computer system, the detection and ranging data received from the vehicle detection and ranging device;

analyzing, via the computer system, the image data received from the vehicle camera; and

determining, via the computer system, a detection and ranging device fault based on a comparison between the analyzed image data and the analyzed detection and ranging data.

12. The method of claim 11 , wherein analyzing the detection and ranging data further comprises determining a detection-and-ranging-computed distance between the vehicle and the object; and

wherein analyzing the image data further comprises determining an image-computed distance between the vehicle and the object.

13. The method of claim 12 , wherein determining, via the computer system, a detection and ranging device fault based on a comparison between analyzing results of the image data and the detection and ranging data comprises comparing, by the computer system, the image-computed distance and the detection-and-ranging-computed distance.

14. The method of claim 12 , wherein determining, via the computer system, a detection and ranging device fault based on a comparison between analyzing results of the image data and the detection and ranging data comprises comparing a known size of the object with a detection-and-ranging-captured size of the object.

15. The method of claim 14 , further comprising querying, by the computer system, a size database to determine the known size of the object.

16. The method of claim 15 , further comprising querying, by the computer system, the size database to determine the known size of at least one of: a vehicle length, a vehicle width, a vehicle height, or a license plate.

17. The method of claim 11 , wherein the vehicle detection and ranging device comprises a Lidar device.

18. The method of claim 11 , wherein the vehicle detection and ranging device comprises a Radar device.

19. The method of claim 11 , further comprising augmenting detection and ranging data received from the fault detection and ranging device with image data from the vehicle camera.

20. A computer implemented method for a vehicle, the method being implemented on a computer system having one or more physical processors programmed with computer program instructions to perform the method, the method comprising:

receiving, via the computer system, detection and ranging data of an object from a vehicle detection and ranging device;

receiving, via the computer system, image data of the object from a vehicle camera;

analyzing, via the computer system, the detection and ranging data received from the vehicle detection and ranging device, to determine a detection-and-ranging-computed distance between the vehicle and the object;

analyzing, via the computer system, the image data received from the vehicle camera, to determine an image-computed distance between the vehicle and the object; comparing, via the computer system, the detection-and-ranging-computed distance with the image-computed distance; and

determining, via the computer system, a detection and ranging device fault if the difference between detection-and-ranging-computed distance and the image-computed distance is above a threshold.

Assignments (9)
SECURITY INTEREST Recorded Sep 25, 2024
From: FARADAY&FUTURE, INC.
To: SENYUN INTERNATIONAL LTD.
Reel/Frame 069048/0676 →
SECURITY INTEREST Recorded Aug 15, 2022
From: FARADAY&FUTURE INC.
To: FF SIMPLICY VENTURES LLC
Reel/Frame 061176/0756 →
RELEASE OF SECURITY INTEREST RECORDED AT REEL/FRAME 050234/0069 Recorded Jun 8, 2022
From: ARES CAPITAL CORPORATION, AS SUCCESSOR COLLATERAL AGENT
To: CITY OF SKY LIMITED; EAGLE PROP HOLDCO LLC; FARADAY & FUTURE INC.; FARADAY FUTURE LLC; FF EQUIPMENT LLC; FF HONG KONG HOLDING LIMITED; FF INC.; FF MANUFACTURING LLC; ROBIN PROP HOLDCO LLC; SMART KING LTD.; SMART TECHNOLOGY HOLDINGS LTD.; FARADAY SPE, LLC
Reel/Frame 060314/0263 →
ACKNOWLEDGEMENT OF SUCCESSOR COLLATERAL AGENT UNDER INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jul 29, 2021
From: BIRCH LAKE FUND MANAGEMENT, LP, AS RETIRING AGENT
To: ARES CAPITAL CORPORATION, AS SUCCESSOR AGENT
Reel/Frame 057019/0140 →
SECURITY INTEREST Recorded Oct 14, 2020
From: ROYOD LLC
To: BIRCH LAKE FUND MANAGEMENT, LP
Reel/Frame 054076/0157 →
ACKNOWLEDGEMENT OF SUCCESSOR COLLATERAL AGENT UNDER INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 5, 2020
From: BIRCH LAKE FUND MANAGEMENT, LP, AS RETIRING AGENT
To: ROYOD LLC, AS SUCCESSOR AGENT
Reel/Frame 052102/0452 →
SECURITY INTEREST Recorded May 1, 2019
From: CITY OF SKY LIMITED; EAGLE PROP HOLDCO LLC; FARADAY FUTURE LLC; FE EQUIPMENT LLC; FF HONG KONG HOLDING LIMITED; FF INC.; FF MANUFACTURING LLC; ROBIN PROP HOLDCO LLC; SMART KING LTD.; SMART TECHNOLOGY HOLDINGS LTD.; FARADAY SPE, LLC; FARADAY & FUTURE INC.
To: BIRCH LAKE FUND MANAGEMENT, LP
Reel/Frame 050234/0069 →
RELEASE OF SECURITY INTEREST Recorded Jan 14, 2019
From: SEASON SMART LIMITED
To: FARADAY&FUTURE INC.
Reel/Frame 048069/0704 →
SECURITY INTEREST Recorded Dec 28, 2017
From: FARADAY&FUTURE INC.
To: SEASON SMART LIMITED
Reel/Frame 044969/0023 →
Continuity (2)
Provisional Application 62368714 · Jul 29, 2016
Related Publication 20180196133A1 · Jul 12, 2018