Methods and vehicles for processing voice commands and moderating vehicle response
Methods, systems and cloud processing are provided for coordinating and processing user input provided to vehicles during use. One example is a method for processing voice inputs at a vehicle is provided. The method includes determining a profile for a user of the vehicle using electronics of the vehicle. The profile is part of a user account and the vehicle is provided with wireless communication circuitry for accessing a server over a network for exchanging information regarding the vehicle, use of the vehicle and use of the profile. The method includes receiving via a microphone of the vehicle a voice command from the user of the vehicle. The electronics of the vehicle processing the voice command to enable a two-way conversation exchange between the user and the vehicle. The method acts to access, by electronics of the vehicle, data for learned behavior of the user. The learned behavior is associated to the profile for the user. The method processes the voice command to identify a type command. The type of command is one of an instruction to make a change to a setting associated with the vehicle or a request for interfacing with a remote service over the network. The method includes identifying a vehicle response for implementing the type of command identified for the voice command and processing, by the electronics of the vehicle, the vehicle response. The vehicle response is moderated based at least in part on the learned behavior of the user.
1. A method for processing voice inputs at a vehicle, comprising,
determining a profile for a user of the vehicle using electronics of the vehicle, the profile being part of a user account, the vehicle provided with wireless communication circuitry for accessing a server over a network for exchanging information regarding the vehicle, use of the vehicle and use of the profile;
receiving via a microphone of the vehicle a voice input provided by the user of the vehicle, the electronics of the vehicle processing the voice input to enable a two-way conversation exchange between the user and the vehicle that is responsive to the voice input;
accessing, by electronics of the vehicle, data for learned behavior over time of the user, the learned behavior being associated to the profile for the user;
processing the voice input to identify a type of command, the type of command being one of an instruction to make a change to a setting associated with the vehicle or a request for interfacing with a remote service over the network;
identifying a vehicle response for implementing the type of command identified for the voice input; and
processing, by the electronics of the vehicle, the vehicle response, the vehicle response being modified based at least in part on the learned behavior of the user, such that the vehicle response being modified customizes the vehicle response for the user.
2. The method of claim 1 , wherein the vehicle response is further based on current use of the vehicle, use of the vehicle includes one or more of geolocation of the vehicle, speed of the vehicle, direction of the vehicle, a route of the vehicle, a time of day, occupants in the vehicle, historical use of the vehicle, online data of the user accessible to the vehicle or server, or combinations of two or more thereof.
3. The method of claim 1 , wherein determining the profile for the user includes processing credential data obtained from the user, the credential data used by the electronics of the vehicle to associated the user to the user account and to the profile, the electronics of the vehicle configured to interface over the network with the server for use of the profile and associated updates to the profile as made via use of the vehicle or updates associated with said learned behavior.
4. The method of claim 1 , wherein the voice input processed using electronics of the vehicle is at least partially processed by the server, the processing of the voice input includes identifying a tone identifier, the tone identifier used to indicated a mood of the user of the vehicle.
5. The method of claim 4 , wherein the vehicle response is further modified based on the mood of the user, wherein the mood of the user is learned from user actions or reactions monitored over a period of time and from data obtained from sensors of the vehicle.
6. The method of claim 1 , wherein the voice input processed using electronics of the vehicle is at least partially processed by the server, the processing of the voice input includes identifying a mood of the user, the mood includes one or more of a normal mood, a frustrated mood, an agitated mood, an upset mood, a hurried mood, an urgency mood, a rushed mood, a stressed mood, a calm mood, a passive mood, a sleepy mood, a happy mood, or an excited mood, or combinations of two or more thereof, and said mood is configured to change over time.
7. The method of claim 1 , wherein the voice input processed using electronics of the vehicle is at least partially processed by the server, the processing of the voice input includes identifying a dialect of the user, the dialect includes one or more of a language dialect, a geographic region dialect, an age dialect, or combinations of two or more thereof.
8. The method of claim 1 , wherein the user account is accessed using login data at the vehicle, the login data defined by credentials of the user, wherein updates to the profiles is processed periodically or upon login to the vehicle.
9. The method of claim 8 , wherein the login data includes one or more of a password, a wireless login code, a biometric identifier, a gesture, or a pairing between a device of the user and logic of the electronics of the vehicle.
10. The method of claim 1 , wherein the voice input processed using electronics of the vehicle is at least partially processed by the server, the processing of the voice input includes identifying a physical profile of the user, the physical profile includes a touch characteristic of the user when interfacing with a graphical user interface of the vehicle, such that the vehicle response is further modified based on the touch characteristic.
11. The method of claim 1 , wherein processing the voice input further includes,
capturing an audio sample of the voice input;
processing the audio sample to remove ambient noise;
identifying frequency and/or magnitude characteristics in the audio sample to identify a voice profile for the voice input.
12. The method of claim 1 , wherein said leaned behavior are generated based on express inputs by the user and/or learned behavior that is inferred from inputs and/or settings made over time to a vehicle when the user account of the user was active on vehicle, the server stores at least some of the inputs and/or settings made to the vehicle in a database for processing said learned behavior, said processing is configured to use machine learning.
13. The method of claim 1 , further comprising,
monitoring a physical characteristic of the user of the vehicle for a period of time that includes when the voice input was received from the user of the vehicle, the physical characteristic that is monitored being used to further modify the vehicle response.
14. The method of claim 13 , wherein the physical characteristic is detected using one or more sensors/devices of the vehicle or devices worn by the user of the vehicle, or the physical characteristic includes one or more of heart rate of the user, motions of a body of the user, eye gaze patterns, body heat, stress indicators, voice micro tremors, voice inflections or pitches, emotional sounds, skin temperature, changes in face heat, slurred speech, camera captured facial expressions, touch patterns, retina scan sensing, gesture detection, or a combination of two or more thereof.
15. The method of claim 1 , further comprising,
executing a machine learning algorithm by the server to process a history of inputs received from the vehicle for the user when using the vehicle via the profile of the user account, the machine learning algorithm used to identify patterns in inputs made by the user based on a context of use of the vehicle, the patterns being used to predict use patterns of the vehicle by the user and moderate at least one aspect of the vehicle response that is responsive to the voice input, the voice input being one of more spoken words that is part of the two-way conversation exchange between the user and the vehicle.
16. The method of claim 15 , wherein the context of use of the vehicle includes identifying geolocation data of the vehicle and inputs or actions made that correspond to said geolocation data.
17. The method of claim 15 , further comprising,
capturing, via the microphone, a conversation between the user of the vehicle and a passenger of the vehicle, the conversation being analyzed to provide recommendations.
18. The method of claim 1 , wherein the voice input processed using electronics of the vehicle is at least partially processed by the server, the voice input being processed to identify a current voice profile associated with a current voice interaction with the vehicle, the voice profile being indicative of a mood of the user, the mood of the user includes one or more of a normal mood, a frustrated mood, an agitated mood, an upset mood, a hurried mood, an urgency mood, a rushed mood, a stressed mood, a calm mood, a passive mood, a sleepy mood, a happy mood, or an excited mood, or combinations of two or more thereof, the moderation of the vehicle response includes changing a speed or type of response rendered by said vehicle to at least partially correlate said vehicle response to the mood identified by the current voice profile.
19. A method for processing voice inputs at a vehicle, comprising,
determining a profile for a user of the vehicle using electronics of the vehicle, the profile being part of a user account, the vehicle provided with wireless communication circuitry for accessing a server over a network for exchanging information regarding the vehicle, use of the vehicle and use of the profile;
receiving via a microphone of the vehicle a voice input provided by the user of the vehicle, the electronics of the vehicle processing the voice input to enable a two-way conversation exchange between the user and the vehicle that is responsive to the voice input;
accessing, by electronics of the vehicle, data for learned behavior over time of the user, the learned behavior being associated to the profile for the user;
processing the voice input to identify a type of command, the type of command being one of an instruction to make a change to a setting associated with the vehicle or a request for interfacing with a remote service over the network;
identifying a vehicle response for implementing the type of command identified for the voice input; and
processing, by the electronics of the vehicle, the vehicle response, the vehicle response being modified based at least in part on the learned behavior of the user, the vehicle response includes outputting one or more voice responses via a speaker of said vehicle responsive to one or more voice inputs captured by said microphone and processed by the electronics of the vehicle, the one or more voice inputs and said one or more voice responses being part of the two-way conversation exchange between the user and the vehicle, wherein the request for interfacing with the remote service includes accessing a search engine to obtain information to be presented to the user via the vehicle as said vehicle response or provide information to said remote service responsive to said one or more voice inputs captured by said microphone;
wherein a machine learning algorithm is executed by the server to process a history of inputs received from the vehicle for the user when using vehicle via the profile of the user account, the machine learning algorithm used to identify patterns in inputs made by the user based on a context of use of the vehicle.
20. The method of claim 19 , wherein determining the profile for the user includes processing credential data obtained from the user, the credential data used by the electronics of the vehicle to associated the user to the user account and to the profile, the electronics of the vehicle configured to interface over the network with the server for use of the profile and associated updates to the profile as made via use of the vehicle or updates associated with said learned behavior.