Presenting location related information and implementing a task based on gaze, gesture, and voice detection
View Patent ↗Systems and methods for presenting information and executing a task. In an aspect, when a user gazes at a display of a standby device, location related information is presented. In another aspect, when a user utters a voice command and gazes at a device, a task is executed. In some aspects, device names and/or gestures are detected and utilized for implementing tasks. In some other aspects, a voice input, a gesture, and/or user information is used to determine a user command inside an autonomous vehicle.
1. A method performed for determining a command inside an autonomous vehicle, comprising:
1) monitoring a user after the user gets in the autonomous vehicle using a plurality of sensors including a camera and a microphone by a control system, the control system including a processor;
2) identifying the user using an identification technique;
3) detecting a voice input from the user using a voice recognition technique;
4) determining whether the voice input includes an address or a name of a place;
5) when the voice input includes an address or a name of a place, determining a destination based on the voice input;
6) when the voice input does not include an address or a name of a place, retrieving information from a service facility about the user based on the user identification, and determining a destination based on the voice input and the retrieved information about the user, including names of previous destinations of the user; and
7) driving the autonomous vehicle toward the destination autonomously after the destination is determined.
2. The method according to claim 1 further including detecting a gesture of the user and determining a destination based on the voice input, the gesture, and the information about the user when the voice input does not include an address or a name of a place.
3. The method according to claim 1 , wherein the voice input includes category information about a business.
4. The method according to claim 1 , wherein the voice input includes a product name of a business.
5. The method according to claim 1 , wherein the voice input includes a name of a service that is provided by a business.
6. The method according to claim 1 , wherein the voice input includes a word prearranged by a user.
7. The method according to claim 1 , wherein the voice input includes a word that matches an event in records.
8. A method performed for determining a command inside an autonomous vehicle, comprising:
1) monitoring a user after the user gets in the autonomous vehicle using a plurality of sensors including a camera and a microphone by a control system, the control system including a processor;
2) identifying the user using an identification technique;
3) detecting a gesture of the user and detecting a voice input from the user using a voice recognition technique;
4) determining whether the voice input includes an address or a name of a place;
5) when the voice input includes an address or a name of a place, determining a destination based on the voice input;
6) when the voice input does not include an address or a name of a place, determining a destination based on the gesture, the voice input, and information about the user, the information retrieved from a service facility and including names of previous destinations of the user; and
7) driving the autonomous vehicle toward the destination autonomously after the destination is determined.
9. The method according to claim 8 further including detecting that the gesture points to a direction and determining a destination based the direction, the voice input, and the information about the user when the voice input does not include an address or a name of a place.
10. The method according to claim 8 , wherein the voice input includes category information about a business.
11. The method according to claim 8 , wherein the voice input includes a product name of a business.
12. The method according to claim 8 , wherein the voice input includes a name of a service that is provided by a business.
13. The method according to claim 8 , wherein the voice input includes a word prearranged by a user.
14. The method according to claim 8 , wherein the voice input includes a word that matches an event in records.
15. A method performed for determining a command inside an autonomous vehicle, comprising:
1) monitoring a user after the user gets in the autonomous vehicle using a plurality of sensors including a camera and a microphone by a control system, the control system including a processor;
2) identifying the user using an identification technique;
3) detecting a gesture of the user and a direction the gesture points at;
4) determining a destination based on the direction the gesture points at and information about the user, wherein the information is retrieved from a service facility and includes a name of a previous destination of the user, and the direction the gesture points at extends toward the previous destination; and
5) driving the autonomous vehicle toward the destination autonomously.
16. The method according to claim 15 further including detecting a voice input from the user using a voice recognition technique.
17. The method according to claim 16 , further including determining a destination based on the direction, the voice input, and the information about the user.
18. The method according to claim 17 , wherein the voice input includes a product name of a business.
19. The method according to claim 17 , wherein the voice input includes a name of a service that is provided by a business.
20. The method according to claim 17 , wherein the voice input includes a word that matches an event in records.