IP Library Granted Patent US 11,198,446
Granted Patent B2
US 11,198,446 · App. 16/240,571 · Granted Dec 14, 2021

On-board vehicle query system

Inventors: Mario R. Garcia (Long Beach, CA); Eric M. Turano (San Pedro, CA); Jungseop Kim (Cypress, CA)
Assignee: Faraday & Future Inc.
B60W50/10G06F16/90332G10L15/22
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,198,446
App. No.
16/240,571
Granted
Dec 14, 2021
Kind
B2
Abstract

Generally described, the present disclosure relates to the efficient management and compact presentation of data or content with respect to a vehicle. For example, an operator of a vehicle may desire content related to vehicle operation, including, among many other forms of data, user manual information, warranty information, parts data, maintenance logs, etc. The disclosed techniques can use query inputs to optimize data presentation and provide augmented data to a user via an interactive user interface.

Claims (65)

1. A system for accessing content for a vehicle, the system comprising:

a database storing vehicle operational content formatted as a plurality of segmented portions each associated with a set of contextual metadata;

a computer-readable memory storing executable instructions; and

at least a processor in communication with the computer-readable memory and programmed by the executable instructions to at least:

receive, over at least one network, updates to individual segmented portions of the plurality of segmented portions including at least an update to a particular segmented portion;

receive data representing a query spoken by a user;

perform natural language processing on the data representing the query;

determine that the query includes a request for a portion of the vehicle operational content based at least in part on a result of the natural language processing;

identify the particular segmented portion of the plurality of segmented portions based at least in part on the set of contextual metadata of the particular segmented portion and the result of the natural language processing;

generate a user interface for presenting the particular segmented portion on a display associated with the vehicle, wherein the user interface is generated to reflect the update to the particular segmented portion;

determine a driving status of one or both of the vehicle and the user; and

when the driving status indicates that it is safe for the user to view information on the display, cause output of the user interface on the display, or when the driving status indicates that it is not safe for the user to view information on the display, store data representing the user interface for later output on the display.

2. The system of claim 1 , wherein the processor is further configured to:

store a version of the particular segmented portion corresponding to a version of a user manual of the vehicle that is available at a time of storing the version.

3. The system of claim 1 , wherein the processor is further configured to determine the driving status is in motion in response to determining that the vehicle is in motion above a predetermined threshold, and wherein the in-motion driving status indicates that it is not safe for the user to view information on the display.

4. The system of claim 1 , wherein the processor is further configured to:

determine whether the query originates from an operator of the vehicle; and

in response to determining the query originates from the operator, cause output of an audible reading of the particular segmented portion through a speaker.

5. The system of claim 1 , wherein the display is in a field of view of an operator of the vehicle.

6. The system of claim 1 , wherein the processor is further configured to:

determine a set of vehicle controls relevant to the query; and

generate the user interface to include navigational links to the vehicle controls.

7. The system of claim 6 , wherein the processor is further configured to generate the user interface to include an animation of instructions included with the set of vehicle controls to animate the relevant set of vehicle controls.

8. The system of claim 1 , wherein the processor is further configured to:

receive contextual content from at least one remote data source to augment the particular segmented portion; and

present the contextual content as part of the user interface.

9. A computer-implemented method, comprising:

storing a version of vehicle operational content, the vehicle operational content formatted as a plurality of segmented portions each associated with contextual metadata;

receiving, over at least one network, an update to the vehicle operational content including at least an update to a particular segmented portion of the plurality of segmented portions;

receiving data representing a query spoken by a user;

performing natural language processing on the data representing the query;

determining that the query includes a request for a portion of the vehicle operational content based at least in part on a result of the natural language processing;

identifying the particular segmented portion of the plurality of segmented portions based at least in part on the set of contextual metadata of the particular segmented portion and the result of the natural language processing;

generating a user interface for presenting the particular segmented portion on a display associated with the vehicle, wherein the user interface is generated to reflect the update to the particular segmented portion;

determining a driving status of one or both of the vehicle and the user; and

when the driving status indicates that it is safe for the user to view information on the display, cause output of the user interface on the display, or when the driving status indicates that it is not safe for the user to view information on the display, store data representing the user interface for later output on the display.

10. The computer-implemented method of claim 9 ,

wherein the version of vehicle operational content corresponds to a version of a user manual of the vehicle that is available at a time of storing the version.

11. The computer-implemented method of claim 9 , further comprising determining that the driving status is in motion in response to determining that the vehicle is in motion above a predetermined threshold, wherein the in-motion driving status indicates that it is not safe for the user to view information on the display.

12. The computer-implemented method of claim 9 , further comprising:

determining whether the query originates from an operator of the vehicle; and

in response to determining the query originates from the operator, causing output of an audible reading of the particular segmented portion through a speaker.

13. The computer-implemented method of claim 9 , wherein the display is in a field of view of an operator of the vehicle.

14. The computer-implemented method of claim 9 , further comprising:

determining a set of vehicle controls relevant to the query; and

generating the user interface to include navigational links to the vehicle controls.

15. The computer-implemented method of claim 14 , further comprising generating the user interface to include an animation of instructions included with the set of vehicle controls to animate the relevant set of vehicle controls.

16. The computer-implemented method of claim 9 , further comprising:

receiving contextual content from at least one remote data source to augment the particular segmented portion; and

presenting the contextual content as part of the user interface.

17. A non-transitory, computer-readable medium having stored thereon computer-executable software instructions configured to cause a processor of a computing device to perform operations comprising:

storing a version of vehicle operational content, the vehicle operational content formatted as a plurality of segmented portions each associated with contextual metadata;

receiving, over at least one network, an update to the vehicle operational content including at least an update to a particular segmented portion of the plurality of segmented portions;

receiving data representing a query spoken by a user;

performing natural language processing on the data representing the query;

determining that the query includes a request for a portion of the vehicle operational content based at least in part on a result of the natural language processing;

identifying the particular segmented portion of the plurality of segmented portions based at least in part on the set of contextual metadata of the particular segmented portion and the result of the natural language processing;

generating a user interface for presenting the particular segmented portion on a display associated with the vehicle, wherein the user interface is generated to reflect the update to the particular segmented portion;

determining a driving status of one or both of the vehicle and the user; and

when the driving status indicates that it is safe for the user to view information on the display, cause output of the user interface on the display, or when the driving status indicates that it is not safe for the user to view information on the display, store data representing the user interface for later output on the display.

18. The non-transitory, computer-readable medium of claim 17 , wherein determining the driving status of the user comprises determining an origination point for the query.

19. The non-transitory, computer-readable medium of claim 17 , wherein the vehicle content comprises a plurality of interactive content segments, including the first segmented portion, and wherein the plurality of interactive content segments comprises discretely packaged information.

20. The non-transitory, computer-readable medium of claim 17 , wherein the operations further comprise:

receiving contextual content from at least one remote data source to augment the particular segmented portion; and

presenting the contextual content as part of the user interface.

Assignments (8)
SECURITY INTEREST Recorded Sep 25, 2024
From: FARADAY&FUTURE, INC.
To: SENYUN INTERNATIONAL LTD.
Reel/Frame 069048/0736 →
SECURITY INTEREST Recorded Aug 15, 2022
From: FARADAY&FUTURE INC.
To: FF SIMPLICY VENTURES LLC
Reel/Frame 061176/0756 →
RELEASE OF SECURITY INTEREST RECORDED AT REEL/FRAME 050234/0069 Recorded Jun 8, 2022
From: ARES CAPITAL CORPORATION, AS SUCCESSOR COLLATERAL AGENT
To: CITY OF SKY LIMITED; EAGLE PROP HOLDCO LLC; FARADAY & FUTURE INC.; FARADAY FUTURE LLC; FF EQUIPMENT LLC; FF HONG KONG HOLDING LIMITED; FF INC.; FF MANUFACTURING LLC; ROBIN PROP HOLDCO LLC; SMART KING LTD.; SMART TECHNOLOGY HOLDINGS LTD.; FARADAY SPE, LLC
Reel/Frame 060314/0263 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2021
From: GARCIA, MARIO R.; TURANO, ERIC M.; KIM, JUNGSEOP
To: FARADAY&FUTURE INC.
Reel/Frame 058051/0887 →
ACKNOWLEDGEMENT OF SUCCESSOR COLLATERAL AGENT UNDER INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Jul 29, 2021
From: BIRCH LAKE FUND MANAGEMENT, LP, AS RETIRING AGENT
To: ARES CAPITAL CORPORATION, AS SUCCESSOR AGENT
Reel/Frame 057019/0140 →
SECURITY INTEREST Recorded Oct 14, 2020
From: ROYOD LLC
To: BIRCH LAKE FUND MANAGEMENT, LP
Reel/Frame 054076/0157 →
ACKNOWLEDGEMENT OF SUCCESSOR COLLATERAL AGENT UNDER INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 5, 2020
From: BIRCH LAKE FUND MANAGEMENT, LP, AS RETIRING AGENT
To: ROYOD LLC, AS SUCCESSOR AGENT
Reel/Frame 052102/0452 →
SECURITY INTEREST Recorded May 1, 2019
From: CITY OF SKY LIMITED; EAGLE PROP HOLDCO LLC; FARADAY FUTURE LLC; FE EQUIPMENT LLC; FF HONG KONG HOLDING LIMITED; FF INC.; FF MANUFACTURING LLC; ROBIN PROP HOLDCO LLC; SMART KING LTD.; SMART TECHNOLOGY HOLDINGS LTD.; FARADAY SPE, LLC; FARADAY & FUTURE INC.
To: BIRCH LAKE FUND MANAGEMENT, LP
Reel/Frame 050234/0069 →