IP Library › Granted Patent US 9,626,966
Granted Patent B2
US 9,626,966 · App. 14/575,790 · Granted Apr 18, 2017

Voice recognition query response systems and methods for generating query responses using information from a vehicle

Inventors: Joshua Berndt (South Lyon, MI); Tirtha Roy (Lake Zurich, IL); Michael Sieczko (Lake in the Hills, IL); Joshua Slominski (Farmington Hills, MI); Chandra Kant (Bihar, IN)
Assignee: Harman International Industries, Incorporated
G10L15/22
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,626,966
App. No.
14/575,790
Granted
Apr 18, 2017
Kind
B2
Abstract

Embodiments are disclosed for an in-vehicle computing system comprising a communication interface communicatively coupled to a query response server, a processor, and a storage device. The storage device configured to collect and store vehicle and user interaction data and configured to store instructions executable by the processor to receive a voice query from a user, translate the voice query into a text query, send the text query to a query response server, receive a result from the query response server, the result including one or more placeholders representing data to be retrieved from a storage device local to the head unit, replace the one or more placeholders with information from the storage device to form an updated result; and present the updated result to the user.

Claims (50)

1. An in-vehicle computing system of a vehicle, the in-vehicle computing system comprising:

a communication interface communicatively coupled to a query response server;

a processor; and

a storage device, the storage device configured to collect and store vehicle and user interaction data and configured to store instructions executable by the processor to:

receive a voice query from a user;

translate the voice query into a text query;

send the text query to the query response server;

receive, at the in-vehicle computing system, a result from the query response server, the result including information from the query response sever and one or more placeholders representing additional information to be retrieved from a storage device local to the in-vehicle computing system;

replace the one or more placeholders with information from the storage device to form an updated result; and

present the updated result to the user.

2. The in-vehicle computing system of claim 1 , further comprising an inter-vehicle system communication module configured to communicate with one or more vehicle systems via a Controller Area Network (CAN) bus of the vehicle, and wherein the instructions are further executable to replace the one or more placeholders with information from a sensor of the vehicle received via the CAN bus.

3. The in-vehicle computing system of claim 1 , wherein translating the voice query into a text query includes sending the voice query to a voice recognition server external to the vehicle, and wherein the result from the query response server includes predefined text in addition to the one or more placeholders representing additional text to be filled in with data retrieved from the storage device local to the in-vehicle computing system.

4. An in-vehicle computing system comprising:

a communication interface communicatively coupled to a query response server;

a processor; and

a storage device, the storage device configured to collect and store vehicle and user interaction data for a vehicle and configured to store instructions executable by the processor to:

receive a voice query from a user;

send the voice query to a voice recognition server;

receive a text query from the voice recognition server;

send the text query to the query response server;

receive, at the in-vehicle computing system, a result from the query response server, the result including information from the query response server and requesting additional information included in the vehicle and user interaction data;

send the requested additional information to the query response server;

receive an updated result from the query response server; and

present the updated result to the user.

5. The in-vehicle computing system of claim 4 , further comprising a display device and wherein presenting the updated result to the user comprises displaying the updated result to the user.

6. The in-vehicle computing system of claim 4 , wherein receiving the result from the query response server comprises receiving a result from matching the text query to one of a plurality of text queries located in one or more Artificial Intelligence Markup Language (AIML) files associated with one or more pre-defined responses.

7. The in-vehicle computing system of claim 6 , wherein the one or more pre-defined responses includes information for the text query in addition to a marker serving as a placeholder for data to be retrieved by one or more of the in-vehicle computing system and the query response server.

8. The in-vehicle computing system of claim 7 , wherein the marker is recognizable by the query response server as identifying data that is stored in a storage device that is local to the query response server.

9. The in-vehicle computing system of claim 7 , wherein the marker is recognizable by the query response server as identifying data that is stored in a storage device that is local to the in-vehicle computing system.

10. The in-vehicle computing system of claim 7 , wherein the marker is recognizable by the query response server as identifying a correlation request for correlating data in one or more of a storage device local to the query response server and a storage device local to the in-vehicle computing system.

11. A method in an in-vehicle computing system within a passenger compartment of a vehicle, the method comprising:

receiving a voice query from a user;

translating the voice query into a text query;

sending the text query to a query response server;

receiving, at the in-vehicle computing system, a result from the query response server, the result including information for the text query and one or more placeholders representing additional information for the text query to be retrieved from a storage device local to the in-vehicle computing system;

replacing the one or more placeholders with information from the storage device to form an updated result; and

presenting the updated result to the user.

12. The method of claim 11 , further comprising prompting the user for the voice query.

13. The method of claim 11 , further comprising determining if the result from the query response server is a valid result corresponding to a response to the voice query.

14. The method of claim 13 , further comprising confirming the voice query responsive to determining that the result from the query response server is not a valid result.

15. The method of claim 11 , further comprising fetching data requested by the one or more placeholders by querying a sensor identified by the one or more placeholders.

16. A method, comprising:

recording vehicle information for a vehicle onboard the vehicle;

responsive to a voice request, sending a representation of the voice request and the recorded vehicle information to a remote server;

receiving, from the remote server, a response to the voice request, the response including a marker and aggregated data from one or more other vehicles;

updating the response with additional information retrieved from onboard the vehicle responsive to the marker; and

presenting the updated response in the vehicle.

17. The method of claim 16 , wherein the updating includes performing one or more calculations according to a formula represented by the marker with the onboard vehicle data.

18. The method of claim 16 , wherein the updating includes performing one or more calculations according to a formula represented by the marker with the aggregated vehicle data, the updating performed in the vehicle.

19. The method of claim 16 wherein the representation is in the form of human readable text.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 28, 2015
From: BERNDT, JOSHUA; ROY, TIRTHA; SIECZKO, MICHAEL; SLOMINSKI, JOSHUA; KANT, CHANDRA
To: HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
Reel/Frame 035735/0933 →
Continuity (2)
Provisional Application 61917883 · Dec 18, 2013
Related Publication 20150170653A1 · Jun 18, 2015