IP Library Patent Application 15613089
Patent Application
App. No. 15/613,089

AUTOMATIC DETECTION OF VEHICULAR MALFUNCTIONS USING AUDIO SIGNALS

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
15/613,089
Abstract

In some embodiments, a method for determining a vehicle malfunction includes receiving audio data from at least one microphone disposed on a vehicle, inputting the audio data into an analysis module having a trained model, and obtaining, from the analysis module, a hypothesized vehicular malfunction condition based on the audio data. The audio data may corresponding to sounds generated by the vehicle, and the trained model may associate various audio data and corresponding vehicular malfunction conditions. The method can further include inputting sensor data into the analysis module having the trained model, the sensor data from at least one sensor disposed on the vehicle. The trained model can further associates various sensor data, along with the various audio sounds, and the corresponding vehicular malfunction conditions, and the hypothesized vehicular malfunction condition obtained from the analysis module can be based on the audio data and the sensor data.

Claims (51)

1 . A computer-implemented method for determining a vehicle malfunction, the method comprising:

receiving, by a processor, audio data from at least one microphone disposed on a vehicle, the audio data corresponding to sounds generated by the vehicle;

inputting, by the processor, the audio data into an analysis module having a trained model, the trained model associating various audio data and corresponding vehicular malfunction conditions; and

obtaining, by the processor, from the analysis module, a hypothesized vehicular malfunction condition based on the audio data.

2 . The computer-implemented method of claim 1 further comprising:

inputting, by the processor, sensor data into the analysis module having the trained model, the sensor data from at least one sensor disposed on the vehicle,

wherein the trained model further associates various sensor data, along with the various audio sounds, and the corresponding vehicular malfunction conditions, and

wherein the hypothesized vehicular malfunction condition obtained from the analysis module is based on the audio data and the sensor data.

3 . The computer-implemented method of claim 2 wherein the sensor data corresponds to at least one vehicle performance characteristic.

4 . The computer-implemented method of claim 1 wherein the trained model is trained by machine learning.

5 . The computer-implemented method of claim 1 further comprising:

receiving, by the processor, global positioning system (GPS) data corresponding to a present location of the vehicle,

wherein the hypothesized vehicular malfunction condition obtained from the analysis module is based on the audio data and the GPS data.

6 . The computer-implemented method of claim 1 further comprising:

receiving, by the processor, traffic data corresponding to traffic local to a present location of the vehicle,

wherein the hypothesized vehicular malfunction condition obtained from the analysis module is based on the audio data and the traffic data.

7 . The computer-implemented method of claim 1 wherein the various audio data and corresponding vehicular malfunction conditions are stored and retrieved from a database, and wherein the received audio data is added to the various audio data and corresponding vehicular malfunction conditions in the database.

8 . A system comprising:

one or more processors; and

one or more non-transitory computer-readable storage mediums containing instructions configured to cause the one or more processors to perform operations including:

receiving, by a processor, audio data from at least one microphone disposed on a vehicle, the audio data corresponding to sounds generated by the vehicle;

inputting, by the processor, the audio data into an analysis module having a trained model, the trained model associating various audio data and corresponding vehicular malfunction conditions; and

obtaining, by the processor, from the analysis module, a hypothesized vehicular malfunction condition based on the audio data.

9 . The system of claim 8 further comprising instructions configured to cause the one or more processors to perform operations including:

inputting, by the processor, sensor data into the analysis module having a trained model, the sensor data from at least one sensor disposed on the vehicle, wherein the trained model further associates various sensor data, along with the various audio sounds, and the corresponding vehicular malfunction conditions, and

wherein the hypothesized vehicular malfunction condition obtained from the analysis module is based on the audio data and the sensor data.

10 . The system of claim 9 wherein the sensor data corresponds to at least one vehicle performance characteristic.

11 . The system of claim 8 wherein the trained model is trained by machine learning.

12 . The system of claim 8 further comprising instructions configured to cause the one or more processors to perform operations including:

receiving, by the processor, GPS data corresponding to a present location of the vehicle,

wherein the hypothesized vehicular malfunction condition obtained from the analysis module is based on the audio data and the GPS data.

13 . The system of claim 8 further comprising instructions configured to cause the one or more processors to perform operations including:

receiving, by the processor, traffic data corresponding to traffic local to a present location of the vehicle,

wherein the hypothesized vehicular malfunction condition obtained from the analysis module is based on the audio data and the traffic data.

14 . The system of claim 8 wherein the various audio data and corresponding vehicular malfunction conditions are stored and retrieved from a database, and wherein the received audio data is added to the various audio data and corresponding vehicular malfunction conditions in the database.

15 . A system for determining a vehicle malfunction, the system comprising:

means for receiving audio data from at least one microphone disposed on a vehicle, the audio data corresponding to sounds generated by the vehicle;

means for inputting the audio data into an analysis module having a trained model, the trained model associating various audio data and corresponding vehicular malfunction conditions; and

means for obtaining from the analysis module, a hypothesized vehicular malfunction condition based on the audio data.

16 . The system of claim 15 further comprising:

means for inputting sensor data into the analysis module having a trained model, the sensor data from at least one sensor disposed on the vehicle,

wherein the trained model further associates various sensor data, along with the various audio sounds, and the corresponding vehicular malfunction conditions, and

wherein the hypothesized vehicular malfunction condition obtained from the analysis module is based on the audio data and the sensor data.

17 . The system of claim 16 wherein the sensor data corresponds to at least one vehicle performance characteristic.

18 . The system of claim 15 wherein the trained model is trained by machine learning.

19 . The system of claim 15 further comprising:

means for receiving GPS data corresponding to a present location of the vehicle,

wherein the hypothesized vehicular malfunction condition obtained from the analysis module is based on the audio data and the GPS data.

20 . The system of claim 15 further comprising:

means for receiving traffic data corresponding to traffic local to a present location of the vehicle,

wherein the hypothesized vehicular malfunction condition obtained from the analysis module is based on the audio data and the traffic data.

Assignments (7)
RELEASE OF SECURITY INTEREST RECORDED AT REEL/FRAME 050234/0069 Recorded Jun 8, 2022
From: ARES CAPITAL CORPORATION, AS SUCCESSOR COLLATERAL AGENT
To: CITY OF SKY LIMITED; EAGLE PROP HOLDCO LLC; FARADAY & FUTURE INC.; FARADAY FUTURE LLC; FF EQUIPMENT LLC; FF HONG KONG HOLDING LIMITED; FF INC.; FF MANUFACTURING LLC; ROBIN PROP HOLDCO LLC; SMART KING LTD.; SMART TECHNOLOGY HOLDINGS LTD.; FARADAY SPE, LLC
Reel/Frame 060314/0263 →
ACKNOWLEDGEMENT OF SUCCESSOR COLLATERAL AGENT UNDER INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jul 29, 2021
From: BIRCH LAKE FUND MANAGEMENT, LP, AS RETIRING AGENT
To: ARES CAPITAL CORPORATION, AS SUCCESSOR AGENT
Reel/Frame 057019/0140 →
SECURITY INTEREST Recorded Oct 14, 2020
From: ROYOD LLC
To: BIRCH LAKE FUND MANAGEMENT, LP
Reel/Frame 054076/0157 →
ACKNOWLEDGEMENT OF SUCCESSOR COLLATERAL AGENT UNDER INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 5, 2020
From: BIRCH LAKE FUND MANAGEMENT, LP, AS RETIRING AGENT
To: ROYOD LLC, AS SUCCESSOR AGENT
Reel/Frame 052102/0452 →
SECURITY INTEREST Recorded May 1, 2019
From: CITY OF SKY LIMITED; EAGLE PROP HOLDCO LLC; FARADAY FUTURE LLC; FE EQUIPMENT LLC; FF HONG KONG HOLDING LIMITED; FF INC.; FF MANUFACTURING LLC; ROBIN PROP HOLDCO LLC; SMART KING LTD.; SMART TECHNOLOGY HOLDINGS LTD.; FARADAY SPE, LLC; FARADAY & FUTURE INC.
To: BIRCH LAKE FUND MANAGEMENT, LP
Reel/Frame 050234/0069 →
RELEASE OF SECURITY INTEREST Recorded Jan 14, 2019
From: SEASON SMART LIMITED
To: FARADAY&FUTURE INC.
Reel/Frame 048069/0704 →
SECURITY INTEREST Recorded Dec 28, 2017
From: FARADAY&FUTURE INC.
To: SEASON SMART LIMITED
Reel/Frame 044969/0023 →