IP Library Patent Application 15662648
Patent Application
App. No. 15/662,648

METHOD AND APPARATUS FOR CAMERA FAULT DETECTION AND RECOVERY

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
15/662,648
Abstract

A system for camera fault detection, notification, and recovery is provided. The system may include at least one camera and at least one physical processing unit configured with program instructions. The processing unit may be configured to analyze image data received from the at least one camera and, based on the image analysis, detect a camera fault or malfunction.

Claims (92)

1 . A system for camera fault detection, the system comprising:

a camera;

one or more physical processors programmed by computer program instructions that, when executed, cause the one or more physical processors to:

receive image data from the camera;

analyze the image data received from the vehicle camera;

determine a camera malfunction based on the analyzed image data; and

provide a camera malfunction notification signal based on the determined camera malfunction.

2 . The system of claim 1 , wherein to analyze the image data, the one or more physical processors are further caused to:

detect an inactive image area of the image data, and

wherein to detect the camera malfunction, the one or more physical processors are further caused to:

determine the camera malfunction based on the detected inactive image area.

3 . The system of claim 1 , wherein to analyze the image data, the one or more physical processors are further caused to:

detect framerate decline in the image data, and

wherein to detect the camera malfunction, the one or more physical processors are further caused to:

determine the camera malfunction based on the detected framerate decline.

4 . The system of claim 1 , wherein to analyze the image data, the one or more physical processors are further caused to:

detect an image area having an image quality decline in the image data, and

wherein to detect the camera malfunction, the one or more physical processors are further caused to:

determine the camera malfunction based on the detected image quality decline.

5 . The system of claim 1 ,

further comprising an additional camera, and

wherein the one or more physical processors are further caused to:

receive additional image data from the additional camera data;

analyze the additional image data;

compare the image data and the additional image data; and

detect the camera malfunction based on the comparison between the image data and the additional image data.

6 . The system of claim 1 ,

further comprising a detection and ranging device, and

wherein the one or more physical processors are further caused to:

receive detection and ranging data from the detection and ranging device;

analyze the detection and ranging data;

compare the image data and the detection and ranging data; and

detect the camera malfunction based on the comparison between the image data and the detection and ranging data.

7 . The system of claim 1 ,

further comprising an ambient light sensor, and

wherein the one or more physical processors are further caused to:

receive ambient light data from the ambient light sensor;

analyze the ambient light data;

compare the image data and the ambient light data; and

detect the camera malfunction based on the comparison between the image data and the ambient light data.

8 . The system of claim 1 ,

further comprising a camera cleaning device configured to clean a camera viewing area;

wherein the one or more physical processors are further caused to:

activate the camera cleaning device based on the detected camera malfunction.

9 . The system of claim 1 ,

further comprising an additional camera;

wherein the one or more physical processors are further caused to:

receive additional image data from the additional camera, and

in response to a detected camera malfunction, process the additional image data to provide supplemental image data about a defective image area of the image data.

10 . The system of claim 1 ,

further comprising an detection and ranging device;

wherein the one or more physical processors are further caused to:

receive detection and ranging data from the detection and ranging device, and

in response to a detected camera malfunction, process the detection and ranging data to provide supplemental data about a defective image area of the image data.

11 . A computer implemented method for camera fault detection, the method being implemented on a computer system having one or more physical processors programmed with computer program instructions to perform the method, the method comprising:

receiving, via the computer system, image data from a camera;

analyzing, via the computer system, the image data received from the camera;

determining, via the computer system, a camera malfunction based on the analyzed image data;

providing, via the computer system, a camera malfunction notification signal based on the determined camera malfunction.

12 . The method of claim 11 , wherein analyzing the image data further comprises detecting an inactive image area of the image data, and

wherein detecting the camera malfunction further comprises determining the camera malfunction based on the detected inactive image area.

13 . The method of claim 11 , herein analyzing the image data further comprises detecting a framerate decline in the image data, and

wherein detecting the camera malfunction further comprises determining the camera malfunction based on the detected framerate decline.

14 . The method of claim 11 , wherein analyzing the image data further comprises detecting an image area having an image quality decline in the image data, and wherein detecting the camera malfunction further comprises determining the camera malfunction based on the detected image quality decline.

15 . The method of claim 11 , further comprising:

receiving, via the computer system, additional image data from the additional camera data;

analyzing, via the computer system, the additional image data;

comparing, via the computer system, the image data and the additional image data; and

detecting, via the computer system, the camera malfunction based on the comparison between the image data and the additional image data.

16 . The method of claim 11 ,

receiving, via the computer system, detection and ranging data from a detection and ranging device;

analyzing, via the computer system, the detection and ranging data;

comparing, via the computer system, the image data and the detection and ranging data; and

detecting, via the computer system, based on the comparison between the image data and the detection and ranging data.

17 . The method of claim 11 ,

receiving, via the computer system, ambient light data from an ambient light sensor;

analyzing, via the computer system, the ambient light data;

comparing, via the computer system, the image data and the ambient light data; and

detecting, via the computer system, the camera malfunction based on the comparison between the image data and the ambient light data.

18 . The method of claim 11 ,

further comprising receiving, via the computer system, additional image data from an additional camera, and

in response to the detected camera malfunction, processing, via the computer system, the additional image data to provide supplemental image data about a defective image area of the image data.

19 . The method of claim 11 ,

further comprising receiving, via the computer system, detection and ranging data from a detection and ranging device, and

in response to a detected camera malfunction, processing, via the computer system, the detection and ranging data to provide supplemental data about a defective image area of the image data.

20 . A system for camera fault detection on a vehicle, the system comprising:

a vehicle camera;

one or more physical processors programmed by computer program instructions that, when executed, cause the one or more physical processors to:

receive image data from the vehicle camera;

compare the image data received from the vehicle camera with data received from another sensor on the vehicle;

determine a camera malfunction if the image data is not consistent with the data received from the another sensor; and

provide a camera malfunction notification signal based on the determined camera malfunction.

Assignments (7)
RELEASE OF SECURITY INTEREST RECORDED AT REEL/FRAME 050234/0069 Recorded Jun 8, 2022
From: ARES CAPITAL CORPORATION, AS SUCCESSOR COLLATERAL AGENT
To: CITY OF SKY LIMITED; EAGLE PROP HOLDCO LLC; FARADAY & FUTURE INC.; FARADAY FUTURE LLC; FF EQUIPMENT LLC; FF HONG KONG HOLDING LIMITED; FF INC.; FF MANUFACTURING LLC; ROBIN PROP HOLDCO LLC; SMART KING LTD.; SMART TECHNOLOGY HOLDINGS LTD.; FARADAY SPE, LLC
Reel/Frame 060314/0263 →
ACKNOWLEDGEMENT OF SUCCESSOR COLLATERAL AGENT UNDER INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jul 29, 2021
From: BIRCH LAKE FUND MANAGEMENT, LP, AS RETIRING AGENT
To: ARES CAPITAL CORPORATION, AS SUCCESSOR AGENT
Reel/Frame 057019/0140 →
SECURITY INTEREST Recorded Oct 14, 2020
From: ROYOD LLC
To: BIRCH LAKE FUND MANAGEMENT, LP
Reel/Frame 054076/0157 →
ACKNOWLEDGEMENT OF SUCCESSOR COLLATERAL AGENT UNDER INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 5, 2020
From: BIRCH LAKE FUND MANAGEMENT, LP, AS RETIRING AGENT
To: ROYOD LLC, AS SUCCESSOR AGENT
Reel/Frame 052102/0452 →
SECURITY INTEREST Recorded May 1, 2019
From: CITY OF SKY LIMITED; EAGLE PROP HOLDCO LLC; FARADAY FUTURE LLC; FE EQUIPMENT LLC; FF HONG KONG HOLDING LIMITED; FF INC.; FF MANUFACTURING LLC; ROBIN PROP HOLDCO LLC; SMART KING LTD.; SMART TECHNOLOGY HOLDINGS LTD.; FARADAY SPE, LLC; FARADAY & FUTURE INC.
To: BIRCH LAKE FUND MANAGEMENT, LP
Reel/Frame 050234/0069 →
RELEASE OF SECURITY INTEREST Recorded Jan 14, 2019
From: SEASON SMART LIMITED
To: FARADAY&FUTURE INC.
Reel/Frame 048069/0704 →
SECURITY INTEREST Recorded Dec 28, 2017
From: FARADAY&FUTURE INC.
To: SEASON SMART LIMITED
Reel/Frame 044969/0023 →