Gesture recognition for on-board display
View Patent ↗Methods and systems for a complete vehicle ecosystem are provided. Specifically, systems that when taken alone, or together, provide an individual or group of individuals with an intuitive and comfortable vehicular environment. The present disclosure includes a system to recognize the drivers and/or passengers within the automobile. Based on the recognition, the vehicle may change a configuration of the automobile to match predetermined preferences for the driver and/or passenger. The configurations may also include the recognition of a unique set of gestures for the person. Further, the configuration can also include the tracking of health data related to the person.
1. A method, comprising:
automatically identifying, by one or more processors of a vehicle control system of a vehicle, a person;
determining, by the one or more processors of the vehicle control system of the vehicle, which one of two or more zones within the vehicle is occupied by the identified person;
determining, by the one or more processors of the vehicle control system, if there is a gesture to be stored for the identified person;
receiving a gesture made upon a receiving surface of an input device, wherein the received gesture configures the vehicle;
associating the received gesture with the identified person and with the determined zone occupied by the person, wherein the received gesture, if associated with a first zone of the two or more zones, has a first vehicle response and a same gesture, if associated with a second zone of the two or more zones, has a second vehicle response, and wherein the first and second vehicle responses are different; and
storing, by the one or more processors of the vehicle control system, the received gesture in a user record associated with the identified person.
2. The method of claim 1 , wherein the received gesture that is made upon the receiving surface of the input device is a gesture in a gesture capture region or a gesture in a touch-sensitive display.
3. The method of claim 1 , wherein automatically identifying the person comprises:
receiving sensor data from at least one sensor;
comparing the sensor data to feature data in a data structure; and
determining if the sensor data is substantially similar to the feature data.
4. The method of claim 1 , wherein determining if there is a gesture to be stored for the person comprises determining if the person has created a gesture.
5. The method of claim 4 , wherein determining if there is a gesture to be stored for the person further comprises receiving an indication from the person that a gesture is to be created.
6. The method of claim 1 , wherein the gesture is stored in cloud storage.
7. A non-transitory computer-readable medium having stored thereon computer-executable instructions, the computer-executable instructions causing the one or more processors to execute the method of claim 1 .
8. A vehicle system of a vehicle, comprising:
one or more sensors;
a vehicle control system comprising:
one or more processors;
a memory;
wherein the one or more processors are configured to:
receive sensor data from the one or more sensors;
automatically identify a person;
determine which one of two or more zones within the vehicle is occupied by the identified person;
determine if the identified person has made a gesture to be stored;
receive the gesture, wherein the gesture is made upon a receiving surface of an input device and the gesture automatically configures the vehicle;
associate the received gesture with the identified person and with the determined zone occupied by the person, wherein the received gesture, if associated with a first zone of the two or more zones, has a first vehicle response and a same gesture, if associated with a second zone of the two or more zones, has a second vehicle response, and wherein the first and second vehicle responses are different; and
store the received gesture in a user record associated with the identified person.
9. The system of claim 8 , wherein the received gesture that is made upon the receiving surface of the input device is a gesture in a gesture capture region or a gesture in a touch sensitive display.
10. The system of claim 8 , wherein in determining if there is a gesture to be stored for the person, the one or more processors of the vehicle control system are further configured to determine if the person has created a gesture.
11. The system of claim 10 , wherein in determining if there is a gesture to be stored for the person, the one or more processors of the vehicle control system are further configured to receive an indication from the person that a gesture is to be created.
12. The system of claim 8 , wherein the gesture is stored in cloud storage.
13. A method, comprising:
receiving sensor data from one or more sensors;
based on the sensor data, automatically identifying a person;
based on the sensor data, automatically determining which one of two or more zones within a vehicle is occupied by the identified person;
retrieving two or more gestures associated with the determined zone and with the identified person, wherein a retrieved gesture, if associated with a first zone of the two or more zones, has a first vehicle response and a same gesture, if associated with a second zone of the two or more zones, has a second vehicle response, and wherein the first and second vehicle responses are different;
receiving a gesture made upon a receiving surface of an input device, wherein the received gesture automatically configures the vehicle;
comparing the received gesture to the two or more retrieved gestures associated with the determined zone and with the identified person; and
based on the comparison, automatically configuring the vehicle according to the received gesture.
14. The method of claim 1 , wherein a first portion of the user record includes information identifying the person, wherein a second portion of the user record includes the received gesture, and wherein a third portion of the user record includes the determined zone occupied by the identified person.
15. The method of claim 1 , wherein the received gesture is made upon the receiving surface of the input device in a gesture capture region outside of a touch sensitive display.
16. The system of claim 8 , wherein a first portion of the user record includes information identifying the person, wherein a second portion of the user record includes the received gesture, and wherein a third portion of the user record includes the determined zone occupied by the identified person.
17. The system of claim 8 , wherein the received gesture is made upon the receiving surface of the input device in a gesture capture region outside of a touch sensitive display.
18. The method of claim 13 , wherein a first portion of a user record associated with the identified person includes information identifying the person, wherein a second portion of the user record includes the two or more retrieved gestures, and wherein a third portion of the user record includes the determined zone occupied by the identified person.