IP Library Granted Patent US 9,487,167
Granted Patent B2
US 9,487,167 · App. 13/977,535 · Granted Nov 8, 2016

Vehicular speech recognition grammar selection based upon captured or proximity information

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,487,167
App. No.
13/977,535
Granted
Nov 8, 2016
Kind
B2
Abstract

Speech recognition systems and/or techniques are provided in which grammar elements and/or speech inputs are targeted to selected functions. One or more input capture devices facilitate the collection of user input associated with a vehicle, and a vehicle function may be selected based upon received user input. A subset of available grammar elements that are associated with audible commands for the selected function may then be identified and utilized to evaluate received audio input. In this regard, speech recognition may be targeted to the selected function.

Claims (83)

1. A vehicle comprising:

at least one memory configured to store a plurality of grammar elements associated with audible commands for the vehicle;

at least one microphone;

at least one user input capture device, wherein the at least one user input capture device comprises a sensor that detects a proximity of an arm, a hand, or a finger of a user to a vehicle function control input element; and

one or more processors configured to:

identify, based upon information received from the sensor, a user input associated with the vehicle function control input element;

select, based at least in part upon an evaluation of the identified user input, a function associated with the vehicle function control input element, wherein the function is associated with a subset of the plurality of stored grammar elements;

receive audio input from the at least one microphone;

identify, based upon an evaluation of the received audio input, a grammar element associated with the selected function; and

output information associated with the identified grammar element.

2. The vehicle of claim 1 , wherein the identified user input comprises one of a user gesture.

3. The vehicle of claim 2 , wherein the at least one input capture device comprises at least one image capture device, and

wherein the one or more processors are further configured to receive one or more images from the at least one image capture device and determine the user gesture from the one or more images.

4. The vehicle of claim 2 , wherein the user gesture is determined based at least in part upon at least one of: tracking hand movement or determining contact or proximity of a hand or finger to a defined region within the vehicle.

5. The vehicle of claim 1 , wherein the one or more processors are further configured to initiate, based upon the identification of the user input, the receipt of audio input.

6. The vehicle of claim 1 , wherein the output information comprises one or more of a vehicle control command, a climate control command, an audio system command, a window control command, a seat control command, a display control command, a Web command, or a communications control command.

7. The vehicle of claim 1 , wherein the one or more processors are further configured to:

identify a learn new input indication;

track, based at least in part upon identifying the learn new input indication, one or more learn new user inputs; and

associate the tracked one or more learn new user inputs with a learn new input function.

8. The vehicle of claim 7 , wherein the one or more processors are further configured to:

direct an output of a prompt for a user to speak one or more words associated with a first grammar element to be associated with control of the learn new input function;

receive audio data collected in response to the prompt; and

associate at least a portion of the received audio data with the first grammar element.

9. A method comprising executing computer-executable instructions by one or more processors, the method further comprising:

storing a plurality of grammar elements associated with audible commands for a vehicle;

identifying a user input associated with the vehicle function control input element, based at least upon information received from a sensor, wherein the information is indicative of a proximity of an arm, a hand, or a finger of a user to the vehicle function control input element;

selecting, based at least in part upon an evaluation of the identified user input, a function associated with the vehicle function control input element, wherein the function is associated with a subset of the plurality of stored grammar elements;

receiving audio input from at least one audio capture device associated with the vehicle;

identifying, based upon an evaluation of the received audio input, a grammar element associated with the selected function; and

outputting information associated with the identified grammar element.

10. The method of claim 9 , wherein identifying the user input comprises identifying at least one of: a user gesture.

11. The method of claim 10 , wherein identifying the user input comprises:

receiving one or more images from at least one image capture device; and

determining, from the one or more images, the user gesture.

12. The method of claim 10 , wherein determining the user gesture comprises at least one of: determining the gesture based at least in part upon tracking hand movement or determining the gesture based at least in part upon contact or proximity of a hand or finger to a defined region within the vehicle.

13. The method of claim 9 , further comprising:

initiating, based upon the identification of the user input, the receipt of audio input.

14. The method of claim 9 , wherein outputting information comprises outputting one or more of a vehicle control command, a climate control command, an audio system command, a window control command, a seat control command, a display control command, a Web command, or a communications control command.

15. The method of claim 9 , further comprising:

identifying a learn new input indication;

tracking, based at least in part upon identifying the learn new input indication, one or more learn new user inputs; and

associating the tracked one or more learn new user inputs with a learn new input function.

16. The method of claim 15 , further comprising:

prompting a user to speak one or more words associated with a first grammar element to be associated with control of the learn new input function;

receiving audio data in response to the prompting; and

associating at least a portion of the received audio data with the first grammar element.

17. An apparatus comprising one or more processors configured to:

store a plurality of grammar elements associated with audible commands for a vehicle;

identify a user input associated with the vehicle function control input element, based at least upon information received from a sensor, wherein the information is indicative of a proximity of an arm, a hand, or a finger of a user to the vehicle function control input element;

select, based at least in part upon an evaluation of the identified user input, a function associated with the vehicle function control input element, wherein the function is associated with a subset of the plurality of stored grammar elements;

receive audio input;

identify, based upon an evaluation of the received audio input, a grammar element associated with the selected function; and

output information associated with the identified grammar element.

18. The apparatus of claim 17 , wherein the identified user input comprises at least one of a user gesture.

19. The apparatus of claim 18 , wherein the apparatus is further configured to:

receive one or more images from at least one image capture device; and

determine the user gesture from the one or more images.

20. The apparatus of claim 18 , wherein the user gesture is determined based at least in part upon one of tracking hand movement or determining contact or proximity of a hand or finger to a defined region within the vehicle.

21. The apparatus of claim 17 , wherein the apparatus is further configured to initiate, based upon the identification of the user input, the receipt of audio input.

22. The apparatus of claim 17 , wherein the output information comprises one or more of a vehicle control command, a climate control command, an audio system command, a window control command, a seat control command, a display control command, a Web command, or a communications control command.

23. The apparatus of claim 17 , wherein the apparatus is further configured to:

identify a learn new input indication;

track, based at least in part upon identifying the learn new input indication, one or more learn new user inputs; and

associate the tracked one or more learn new user inputs with a learn new function.

24. One or more non-transitory computer-readable media storing computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

identifying a plurality of stored grammar elements associated with audible commands for a vehicle;

identifying a user input associated with the vehicle function control input element, based at least upon information received from a sensor, wherein the information is indicative of a proximity of an arm, a hand, or a finger of a user to the vehicle function control input element;

selecting, based at least in part upon an evaluation of the identified user input, a function associated with the vehicle function control input element, wherein the function is associated with a subset of the plurality of stored grammar elements;

receiving audio input;

identifying, based upon an evaluation of the received audio input, a grammar element associated with the selected function; and

outputting information associated with the identified grammar element.

25. The one or more non-transitory computer-readable media of claim 24 , wherein the identified user input comprises at least one of a user gesture.

26. The one or more non-transitory computer-readable media of claim 25 , wherein the one or more processors are further configured to:

receive one or more images from at least one image capture device; and

determine the user gesture from the one or more images.

27. The one or more non-transitory computer-readable media of claim 25 , wherein the user gesture is determined based at least in part upon one of: tracking hand movement or determining contact or proximity of a hand or finger to a defined region within the vehicle.

28. The one or more non-transitory computer-readable media of claim 24 , wherein the one or more processors are further configured to initiate, based upon the identification of the user input, the receipt of audio input.

29. The one or more non-transitory computer-readable media of claim 24 , wherein the output information comprises one or more of a vehicle control command, a climate control command, an audio system command, a window control command, a seat control command, a display control command, a Web command, or a communications control command.

30. The one or more non-transitory computer-readable media of claim 24 , wherein the one or more processors are further configured to:

identify a learn new input indication;

track, based at least in part upon identifying the learn new input indication, one or more learn new user inputs; and

associate the tracked one or more learn new user inputs with a learn new function.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 15, 2022
From: INTEL CORPORATION
To: TAHOE RESEARCH, LTD.
Reel/Frame 061175/0176 →